Filter
6743
Featured
620
1961
Language
6380
217
117
106
61
52
37
24
11
10
8
6
5
5
5
5
4
4
4
4
4
4
4
4
4
3
3
3
3
3
3
2
2
2
2
2
2
2
2
2
2
2
2
2
2
1
1
1
1
1
1
1
1
1
1
1
Document type
4143
901
851
352
272
84
75
34
11
10
8
1
1
Countries
279
258
223
168
154
145
138
137
133
123
122
114
106
105
104
101
93
92
88
80
60
59
56
55
51
48
46
45
43
43
41
40
39
38
36
36
36
33
33
33
31
30
29
29
27
25
22
21
20
20
18
17
17
16
15
14
14
13
13
12
12
12
11
11
11
10
10
10
8
8
8
7
7
7
6
6
6
6
6
6
6
5
5
5
5
5
5
5
4
4
4
4
4
4
4
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
Authors & Publishers
898
398
294
227
187
130
118
116
113
48
46
46
39
38
35
33
32
32
31
30
29
29
29
28
28
27
27
27
26
25
25
24
24
23
23
23
21
21
20
20
20
19
19
19
19
18
16
16
15
15
15
14
14
14
14
14
14
14
14
13
12
12
12
12
12
11
11
11
11
11
11
11
11
11
11
11
10
10
10
10
10
10
10
10
9
9
9
9
9
9
9
9
9
9
9
9
8
8
8
8
8
8
8
8
8
7
7
7
7
7
7
7
7
7
7
7
7
7
7
7
7
7
7
7
7
7
7
7
7
7
7
7
7
7
6
6
6
6
6
6
6
6
6
6
6
6
6
6
6
6
6
6
6
6
6
6
6
6
6
6
6
6
6
6
5
5
5
5
5
5
5
5
5
5
5
5
5
5
5
5
5
5
5
5
5
5
5
5
5
5
5
5
5
5
5
5
5
5
5
5
5
5
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
3
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
Publication Years
1
1498
4542
672
29
1
Category
2637
540
395
349
318
136
69
7
1
Toolboxes
542
433
388
384
267
212
207
198
180
177
155
141
116
106
98
94
94
54
41
36
36
33
5
5
1
1
Together we can Prevent and Control the World's Most Common Diseases
Objectives of the training manual
(1) To improve knowledge of NCD trends, burdens, as well as systems for management and ... monitoring of NCD services for Township Medical Officers (TMOs), Township Public Health Officers (TPHOs), Medical Officers (MOs). The manual can also be used for training of Basic Health staff (BHS), TMOs, TPHOs and MOs,
(2) To equip trainers to train BHS to conduct PEN protocols at the primary care level health centers,
(3) To equip trainers to train in processes to conduct PEN scaling up monitoring , supervision and evaluation activities. more
Objectives of the training manual
(1) To improve knowledge of NCD trends, burdens, as well as systems for management and ... monitoring of NCD services for Township Medical Officers (TMOs), Township Public Health Officers (TPHOs), Medical Officers (MOs). The manual can also be used for training of Basic Health staff (BHS), TMOs, TPHOs and MOs,
(2) To equip trainers to train BHS to conduct PEN protocols at the primary care level health centers,
(3) To equip trainers to train in processes to conduct PEN scaling up monitoring , supervision and evaluation activities. more
The aim of this guidance manual is to introduce the user to project/programme plan- ning in a Red Cross Red Crescent environment. It describes the different stages of the planning phase of the “project/programme cycle” within the context of Results-Based Management (RBM). It also gives an overvi
...
ew of the various components of RBM and explains how to integrate and apply this approach in practice. In addition, the manual summarizes briefly the other key phases of the cycle (assessment, imple- mentation and monitoring, evaluation) and provides references to the key Federation manuals on these phases.
The manual has been developed primarily for use by people managing projects and programmes either in a National Society or the secretariat of the International Federation of Red Cross and Red Crescent Societies (International Federation). Although it is mainly designed for use at the country level, the basic principles can be applied to project and programme planning at any level. The manual draws on two International Red Cross and Red Crescent Movement publications – the International Federation’s Project Planning Process (2002) and the ICRC Economic Security Unit’s Programme/ Project Management: The Results-Based Approach (2008) – reflecting the significant similarity of approach. The International Federation has developed the manual internally to suit the particular needs and uses of project/programme management within the organization.
more
The meeting was held from 26 to 27 March 2018 to review and discuss the following topics:
Advances and challenges in the use of fTLC, and new
...
approaches to detecting mycolactone using monoclonal antibodies (mAbs).
The status of development of rapid diagnostic tests (RDTs) targeting the MUL_3720 protein.
The role of PCR as a reference test, and hurdles in providing a confirmatory diagnosis and in establishing a quality assurance programme.
New molecular tools with potential for implementation at a level lower than in the national or regional reference laboratory, such as loop-mediated isothermal amplification (LAMP) and recombinase polymerase amplification (RPA).
The need to harmonize and standardize methods for collection and preparation of specimens, so samples can be referred for diagnosis and stored for evaluation of new diagnostic tests in optimal conditions.
Barriers to accessing early diagnosis and treatment, including coordination at the programme level, and lack of adequate diagnostic tools.
Defining target product profiles (TPPs) to guide the development of new diagnostic tools that can be applied at different levels of the health system. Participants agreed that two TPPs would be developed to address the current gaps: (i) a rapid test for BU diagnosis at the primary health-care level; and (ii) a test for diagnosis of BU that can also assist in treatment monitoring and differential diagnosis at the district hospital or reference centre.
more
This is only the cover of the book. Download the whole Toolkit at: www.cdc.gov/reproductivehealth/Refugee/
Understanding the reproductive health needs of conflict-affected women will enable organizations to implement and enhance programs
...
and services to improve the health of women and their families. The Reproductive Health Assessment Toolkit (RHA) for Conflict-Affected Women provides user-friendly tools to quantitatively assess the reproductive health needs of conflict-affected women aged 15–49 years. The RHA Toolkit enables field staff to collect data to inform program planning, monitoring, evaluation, and advocacy. It promotes using the collected data to enhance services and improve the reproductive health of women and their families.
more
Module 5
Monitoring and Evaluation
October 2018
Module 5: Monitoring
...
and evaluation. This module is for people responsible for monitoring PrEP programmes at the national and site levels. It provides information on how to monitor PrEP for safety and effectiveness, suggesting core and additional indicators for site-level, national and global reporting.
more
Evaluation of hand hygiene practices and related perception and knowledge at a health-care facility is one vital element of the strategy to improve
...
hand hygiene. Continuous monitoring is very helpful in measuring the changes induced by implementation and to ensure that the interventions have been effective in improving hand hygiene practices, perception and knowledge among health-care workers.
more
Key stakeholders must be involved in the planning, implementation, monitoring and evaluation of NCD plans
...
and programmes. Within a ministry of health there will be different types of stakeholders, such as programme managers and senior managers in departments of prevention, health promotion, and hospital and health services. Other stakeholders may come from ministries for transport, economics, agriculture, and education, funding partners, nongovernmental organizations, civil society and community members. It is critical to ensure that there are clear and accurate descriptions of the policies, plans and programmes, so that all interventions, activities and desired outcomes are clearly understood by all involved in their evaluation.
more
Obesity and diet-related noncommunicable diseases (NCDs) have been steadily increasing globally, and with them, a pressing need to implement effective responses to address the contributing factors.
...
Among the available evidence-based policy options that enable healthier choices and improved diets is the implementation of taxes on sugar-sweetened beverages (SSBs).
This tax manual is a practical guide for policy-makers and others involved in SSB tax policy development to promote healthy diets and populations. It features summaries and case studies of SSB global taxation evidence, and provides support on the policy-cycle development process to implement SSB taxation — from problem identification and situation analysis through policy design, development and implementation to the monitoring and evaluation phase. Additionally, the manual identifies and debunks industry tactics designed to dissuade policy-makers from implementing these taxes.
SSB taxes can be a win-win-win strategy: a win for public health (and averted health-care costs), a win for government revenue, and a win for health equity.
more
Tuberculosis (TB) and particularly drug-resistant TB continue to represent major public health threats in the WHO European Region. This document details the Tuberculosis action plan for the WHO European Region 2023–2030 as well as its
...
monitoring and evaluation framework and outlines the vision and strategic actions for the TB response in the Region for this period. Developed through a Region-wide participatory consultation process, the TB action plan aims to support Member States to implement their national responses to the TB epidemic and provides strategies to enable the Region to reach the global End TB Strategy targets as well as aligning to the priorities of the European Programme of Work, 2020–2025 – “United Action for Better Health in Europe”.
more
This strategic framework marries formerly separate mandates for HIV and TB management in to one, comprehensive collaboration. It provides a structure for how to: strengthen the health care system to respond effectively to both epidemics, reduce the
...
burden of HIV/AIDS in TB patients, and establish a monitoring and evaluation system for the collaborative activities. Activities include: improving TB infection control in health care and other settings, enhancing TB/HIV diagnostic capacity, and harmonize data collection tools and local, national and international TB/HIV indicators.
more
Research Paper.
As the fighting in Syria winds down, international humanitarian organisations (IHOs) operating from Damascus are hopeful that the Syrian government’s interference in their work will decrease. However, the government is attempting to formalise its influence over humanitarian operat
...
ions.
Throughout the Syrian conflict, the government has imposed multiple administrative processes on humanitarian organisations to limit their ability to operate independently. This includes restricting the operational environment; undermining organisational independence; imposing local partners; influencing procurement procedures; and preventing direct monitoring and evaluation.
While some level of coordination with the government might be a pragmatic necessity to ensure the safety of operations in regime-controlled areas, this cooperation should not enable the government to use aid for military or political purposes. Consequently, international humanitarian organisations have an ethical dilemma in how they provide aid in these areas without undermining their principles of humanity, independence, impartiality and neutrality.
more
The toolkit provides practical guidance and tools that can support efforts, including planning and implementation activities, to create dementia-inclusive societies.
The toolkit is divided into t
...
wo parts. Part I contains background information and a conceptual framework for creating dementia-inclusive societies. Part II includes four practical modules, each featuring a series of practical steps and exercises. The four modules focus on: starting a new dementia-friendly initiative (DFI), integrating dementia into an existing initiative, monitoring and evaluation a DFI, and scaling a DFI. The modules can be used together or separately and offer guidance that can be adapted to suit local needs and settings.
more
The Advancing Climate-Resilient Education Technical Guidance builds on the USAID 2022–2030 Climate Strategy and the 2018 USAID Education Policy to support USAID Missions and partners who seek to i
...
ntegrate climate action and awareness into education programs and are committed to achieving climate-resilient education systems and fostering climate-resilient learners. It outlines how to identify opportunities for climate action that respond to known climate hazards through mitigative, adaptive, and transformative actions.
The guidance is designed for use at the activity design and monitoring and evaluation stages of the USAID Program Cycle. It does not prescribe new processes, but rather serves to aid Missions and partners in integrating climate considerations into existing processes
more
This report presents data and outlines best practices and policies that can put governments on the path to providing every child with the best start in life. It outlines the neuroscience of early ch
...
ildhood development (ECD), including the importance of nutrition, protection and stimulation in the early years. And it makes the case for scaling up investment, evaluation and monitoring in ECD programmes. The report concludes with a six-point call to action for governments and their partners to help maximize the potential of the children who will build the future – by making the most of the unparalleled opportunities offered by the early moments in life.
more
This guide provides a comprehensive overview of essential information related to immunization, including technical information about vaccines, a review of immunization program management best practices, guidance on the delivery of immunization services, mo
...
nitoring and evaluation, disease surveillance, and the role of behavior change.
more
Advance Family Planning - Advocacy Portfolio
recommended
Adapted from well-established decision-making concepts and honed through practical application in resource-limited settings, the AFP Advocacy Portfolio includes:
1. Advocate for Family Planning, an introduction to AFP’s approach.
2. Develop a St
...
rategy, featuring a tool to understand your context and AFP SMART: A Guide to Quick Wins, our 9-step approach to developing a focused, collaborative advocacy strategy that leads to quick wins.
3. Implement a Plan, tools to monitor your impact and make your case to decision makers.
4. Capture Results, with the AFP Results Cascade: A User’s Guide, a monitoring and evaluation tool that provides instructions to track a quick win or series of quick wins to long-term impact, and case study writing guidance.
more
Use of chest imaging in COVID-19 (Arab Version)
recommended
This rapid advice guide examines the evidence and makes recommendations for the use of chest imaging in acute care of adult patients with suspected, probable or confirmed COVID-19. Imaging modalities considered are radiography, computed tomography
...
and ultrasound. This guide addresses the care pathway from presentation of the patient to a health facility to patient discharge. It considers different levels of disease severity, from asymptomatic individuals to critically ill patients. Accounting for variations in the benefits and harms of chest imaging in different situations, remarks are provided to describe the circumstances under which each recommendation would benefit patients. The guide also includes implementation considerations for different settings, provides suggestions for impact monitoring and evaluation and identifies knowledge gaps meriting further research.
more
Program Implementation Manual (PIM)
The Save One Million Lives Program for Results (SOML PforR) is a Federal Government of Nigeria maternal and child health program, supported by the World Bank, which provides incentives based on achievement of ... results (health outcomes) and helps to drive institutional processes needed to achieve these results. This Program Implementation Manual provides a description of the program and operational guidelines for effective implementation. The Manual contains guidelines and procedures relating to disbursements and fund flows, institutional arrangements, financial management as well as monitoring and evaluation, while providing clear definition of the roles and responsibilities of all stakeholders. more
The Save One Million Lives Program for Results (SOML PforR) is a Federal Government of Nigeria maternal and child health program, supported by the World Bank, which provides incentives based on achievement of ... results (health outcomes) and helps to drive institutional processes needed to achieve these results. This Program Implementation Manual provides a description of the program and operational guidelines for effective implementation. The Manual contains guidelines and procedures relating to disbursements and fund flows, institutional arrangements, financial management as well as monitoring and evaluation, while providing clear definition of the roles and responsibilities of all stakeholders. more
The primary aim of this assessment is to evaluate current approaches to malaria surveillance in Myanmar and to provide a set of practical and feasible recommendations to further strengthen the surve
...
illance system in the short to medium term. The assessment focuses on the surveillance of malaria cases (as distinct from more general surveillance to support monitoring and evaluation) and, more specifically, on instruments and systems to collect, collate, report and analyse malaria data as a basis for informing malaria control policy and practice.
more
Antimicrobial Resistance Division, Ministry of Health, National Action Plans and Monitoring and Evaluat
...
ion
more
Benchmarking is a strategic process often used by businesses and institutes to standardize performance in relation to the best practices of their sector. The World Health Organization (WHO) and part
...
ners have developed a tool with a list of benchmarks and corresponding suggested actions that can be applied to implement the International Health Regulations 2005 (IHR) and strengthen health emergency prevention, preparedness, response and resilience capacities.
The first edition of the benchmarks was published in 2019 to support countries in developing, implementing and documenting progress of national IHR or health security plans (e.g. national action plan for health security (NAPHS), national action plan for emerging infectious diseases, public health emergencies and health security and other country level plans for health emergencies). The tool has been updated to incorporate lessons from COVID-19 and other health emergencies, to align with the updated IHR monitoring & evaluation framework (IHR MEF) tools and the health systems for health security framework, and to support strengthening health emergency prevention, preparedness, response and resilience (HEPR) capacities and the Preparedness and Resilience for Emerging Threats (PRET) initiative.
more
The Disability inclusion guide for action supports ministries of health and their partners in both advancing health equity for persons with disabilities by identifying entry points, and planning app
...
ropriate actions that strengthen the health system through disability inclusion. It focuses on addressing the contributing factors which relate to the health system – namely, the attitudinal,
institutional, and physical barriers faced by persons with disabilities across all health system building blocks. Such factors include the exclusion of persons with disabilities in governance and decision-making processes in the health sector; gaps in knowledge, negative attitudes, and discriminatory practices among the health and care workforce; inaccessible physical infrastructure, health
information and communication; and a lack of information or data collection and analysis on disability in monitoring and evaluation in the health system.
more
WHO Pharmacovigilance indicators: a practical manual for the assessment of pharmacovigilance systems
This manual provides a practical method for determining the pharmacovigilance indices. It is designed to be simple and can be understood by any worker in pharmacovigilance without formal training in monito
...
ring and evaluation. Pharmacovigilance as a medical discipline is crucial in preventing medicine-related adverse effects in humans, promoting patient safety, and the rational use of medicines. The indicators proposed in this manual are based on the expected functions of pharmacovigilance centres as described in the WHO Mimimum Requirements for a Functional Pharmacovigilance System (1) (see Annex 1 of the manual).
more
Resilience has rapidly become one of the most prominent objectives for the development sector, so ascertaining how best to measure it is an essential task for practioners working in monitoring and
...
evaluation. In this discussion paper, the main insights emerging from the series of large-N Effectiveness Reviews, a set of quantitative studies that aim to evaluate impact and generate learning from a random sample of Oxfam’s projects are outlined. It is also considered how this measurement approach may adapt as ideas about resilience change both within Oxfam and in the development sector at large
more
Punjab Province Report: Nutrition Political Economy, Pakistan
Zaidi, Shehla; Bhutta, Zulfiqar et al.
Institute of Development Studies, Aga Khan University
(2015)
C1
In this report a nutrition governance framework was applied to research and analyse the provincial experience with nutrition policy in Pakistan, looking both at chronic and acute malnutrition. Twent
...
y-one in-depth interviews with key stakeholders were also conducted along with a review of published and grey literature. Findings were validated and supplemented by consultative provincial roundtable meetings. Punjab’s nutritional puzzle is that it has high levels of chronic malnutrition and micro-nutrient deficiencies despite a surplus production of food and a low poverty level. Under-nutrition is mainly linked to insufficient attention to preventive health strategies and to a lack of connection between relevant sectors such as Education, Health, Poverty, Safe Water and Sanitation, and Food. Strategic opportunities are recommended which include cross-party political support and ownership for nutrition, with steering by executive leadership; multi-sectoral action and functional integration of various departments and programmes with the creation of a central convening structure for effective cross-sectoral coordination; broadening of nutritional activities beyond salt iodization and vitamin A coverage; central co-ordination of monitoring and evaluation and effective partnerships between the state and non-state sector around data production, awareness, advocacy, and monitoring.
more
Child Friendly Spaces (CFSs) are used by humanitarian agencies as a means to promote protection and psychosocial wellbeing for children in emergency settings. World Vision International together with Columbia University is conducting a series of stu
...
dies to investigate the effectiveness of CFSs in various humanitarian contexts in order to document evidence of the positive effects they have in relation to child wellbeing and protection, to identify good practice in their design and implementation and to develop improved monitoring and evaluation approaches for CFSs. The case studies have so far all been focused on refugee settings and while internally displaced populations (IDPs) share many of the circumstances and challenges of refugees it was decided that CFSs operating in IDP settings warrant a particular investigation in order to assess their relevance and effectiveness in promoting child protection and psychosocial wellbeing. This report thus presents the findings from an IDP focused study on CFS effectiveness in three camps near Goma, eastern Democratic Republic of Congo (DRC).
more
The Practical Approach to Care Kit is a health systems strategy comprising 4 pillars that support the delivery of primary care:
a guide,
a training strategy,
a health systems strengthening intervention and
a
...
monitoring and evaluation component.
more
Overview
The aim of this guide is to support national immunization programme managers and others responsible for implementing human rabies vaccine programmes to:
inform policy discussions and o
...
perational planning for introducing or expanding rabies post-exposure prophylaxis (PEP) into a national immunization programme (e.g. through the national immunization programme, or other programmes); and
highlight considerations specific to rabies PEP for integration into existing systems, including for implementation, and monitoring and evaluation.
While the guide is mainly intended for programme managers and focuses on human vaccination, complementary animal health measures are highlighted where relevant given the zoonotic nature of rabies.
The guide was developed collaboratively with input from technical experts in rabies and immunization, vaccines and biologicals.
more
The Participation Handbook for humanitarian field workers contains detailed practical advice on the participation of affected people in humanitarian action. It has three sections:
Developing a participatory approach (main issues, key factors, building mutual respect, communication methods
...
and advice on reviewing your approach);
Implementing your participatory approach at every stage of the project cycle (initial assessment, project design, implementation, monitoring and final evaluation);
A list of tools and additional resources (books, internet sites, etc.)
more
The assistive technology capacity assessment (ATA-C) is a system-level tool to evaluate a country’s capacity to finance, regulate, procure and provide assistive technology. It can be used for awareness raising, policy
...
and programme design, and ongoing monitoring and evaluation. This manual provides guidance and practical information on the ATA-C implementation process. The ATA-C is intended to be implemented by an experienced team, in collaboration with relevant ministries and users’ organizations.
more
The purpose of this publication is to to provide a practical, stepwise approach to the implementation of the national action plans on AMR within the human health sector; and to provide a process and
...
collation of existing WHO tools to prioritize, cost, implement, monitor and evaluate national action plan activities. The target audience of the publication are national/subnational stakeholders working on AMR within the human health sector. This includes national health authorities, national multi-sectoral coordination groups, senior technical experts and policymakers involved in implementing AMR activities at all levels of the health system, and implementation partners to accelerate sustainable implementation and monitoring and evaluation of national action plans on AMR.
more
Updated 2022. This guide addresses the care pathway from presentation of the patient to a health facility to patient discharge. It considers different levels of disease severity, from asymptomatic individuals to critically ill patients. Accounting for variations in the benefits
...
and harms of chest imaging in different situations, remarks are provided to describe the circumstances under which each recommendation would benefit patients. The guide also includes implementation considerations for different settings, provides suggestions for impact monitoring and evaluation and identifies knowledge gaps meriting further research.
more
Implementing the global action plan on antimicrobial resistance: first quadripartite biennial report
The first quadripartite biennial report summarizes progress in the implementation of multisectoral national action plans, actions by the quadripartite organizations, actions by the global governance structures, key environmental dimensions, highlights areas for accelerated action,
...
and shares case studies from six countries. An Annex with extensive data on the global action plan’s monitoring and evaluation indicators is included. The report was developed through contributions from all 6 WHO regions, member states, various headquarters departments and units, and technical teams from FAO, WOAH and UNEP.
more
Impact Evaluation Notes No. 1 - Introduction To Impact Evaluation
Patricia J. Rogers, RMIT University (Australia) and BetterEvaluation
InterAction, The Rockefeller Foundation
(2012)
C3
This is the first guidance note in a four-part series of notes produced by InterAction to support management,
program and M&E staff in international NGOs to plan, design, manage, conduct and use im
...
pact evaluations. This first guidance note, Introduction to Impact Evaluation, provides an overview of impact evaluation, explaining how impact evaluation differs from – and complements – other types of evaluation, why impact evaluation should be
done, when and by whom. It describes different methods, approaches and designs that can be used for the different aspects of impact evaluation. The guidance note is also available in French, Arabic and Spanish on https://www.interaction.org/impact-evaluation-notes.
more
This manual is for the beginner/intermediate and advanced EHA courses run by Channel Research on behalf of ALNAP. It is supported by a course specific set of case studies and exercises
...
and by a bibliography of evaluation references
more
This working draft develops guidance on conducting effective evaluations of conflict prevention and peacebuilding work. The current working draft will be used for a one year application phase through 2008. It is the result of an ongoing collaborativ
...
e project by the OECD DAC Networks on Development Evaluation and on Conflict, Peace and Development Co-operation (CPDC). The two Networks began this collaboration in 2005, responding to the need expressed by CPDC members for greater clarity regarding techniques and issues of evaluation in their field. An assessment of past conflict and peace evaluations and a study of current practices were undertaken in 2006 and identified a need for further guidance.
more
This companion to the ALNAP EHA Guide offers protection-specific insights for evaluators and evaluation commissioners across the humanitarian sector. It covers the planning, data management
...
and analysis phases of evaluation and addresses a range of challenges that – whilst not all unique to protection – are often exacerbated by the contexts in which protection activities typically take place. Challenges addressed include those arising from the multi-faceted nature of protection activities, the difficulty understanding cause-effect relationships underlying protection risks, and the challenges of accessing and managing very sensitive data, sometimes drawn from communities in conflict.
more
Reporting system for the general public - This document aims to provide practical guidelines on how to set up national systems for consumers to report adverse reactions to medicines. The purpose is to help countries set up a well-organized and effec
...
tive consumer reporting system within their pharmacovigilance centre. Throughout this document, the phrase “consumer reporting” is used to refer to reporting of adverse drug reactions (ADRs) by the general public.
more
This is the third guidance note in a four-part series of notes related to impact evaluation developed by InterAction with financial support from the Rockefeller Foundation.This third guidance note, Introduction to Mixed Methods in Impact
...
Evaluation, starts by explaining what a mixed methods (MM) impact evaluation design is and what distinguishes this approach from quantitative or qualitative impact evaluation designs. It notes that a mixed methods approach seeks to integrate social science disciplines with predominantly quantitative (QUANT) and predominantly qualitative (QUAL) approaches to theory, data collection, data analysis and interpretation. The guidance note is also available in French and Spanish on https://www.interaction.org/impact-evaluation-notes. ATTENTION: ANNEXES 1 TO 11 TO THIS DOCUMENT CAN BE FOUND IN ENGLISH VERSION ON: https://www.interaction.org/introduction-mixed-methods-impact-evaluation-annexes
more
This is the fourth guidance note in a four-part series of notes related to impact evaluation developed by InterAction with financial support from the Rockefeller Foundation.This fourth guidance note, Use of Impact
...
Evaluation Results, highlights three themes crucial for effective utilization of evaluation results. Theme one states that use does not happen by accident. Impact evaluations are more likely to be used when uses have been anticipated and planned from the earliest stages of the evaluation and, even better, from the planning stages of the work that is being evaluated. Theme two concerns the operations and systems required in an organization to use impact evaluations well. Theme three builds from the premise that the first two themes are necessary but insufficient conditions for the effective and widespread use of impact evaluations. The guidance note is also available in French, Arabic and Spanish on https://www.interaction.org/impact-evaluation-notes.
more
The document contains a set of indicators that can be used for monitoring traditional and complementary medicine (T&CM) systems in a country.
The core indicator set consists of 16 indicators that w
...
ere considered essential and collectively able to provide information on T&CM inputs, processes and outputs. A longer list of reference indicators is also available for countries that wish to monitor more indicators or that want to consider alternative metrics that would better suit each country’s T&CM situation, priorities and monitoring capacities.
Each core and reference indicator is accompanied by a set of metadata. This provides information on the indicator rationale, definitions, data elements (numerator, denominator and data disaggregation), frequency of measurement, and data sources. It is a guide towards more standardized data measurement as well as data interpretation.
more
Effective malaria prevention is threatened by widespread and increasing vector insecticide resistance. Failure to mitigate this threat will likely result in an increased burden of disease, with significant cost implications. This new framework provi
...
des support for the development of a national insecticide resistance monitoring and management plan as part of a national malaria strategic plan.
more
This publication provides guidance to governments, civil society organizations (nongovernmental organizations and community-based organizations) and other partners implementing HIV prevention, care
...
and treatment programs with key populations. This guide is designed to assist these programs in the development of monitoring systems for frontline workers (such as peer outreach workers, staff outreach supervisors and program managers) to understand performance. It includes comprehensive tools and forms that various levels of staff can use to collect and analyze data to manage and improve a program.
more
AIDS Behav (2017) 21:S23–S33 DOI 10.1007/s10461-016-1670-9
Real Time Evaluation of the Ebola Control Programs in Guinea, Sierra Leone and Liberia. Final Report
The scope includes the assessment of activities to improve the response to affected populations, stakeholders, partners and donors, building on lessons learnt so far in this outbreak.
Women and Health Initiative Working Paper No. 1. Women and Health Initiative
Improving maternal health in the context of the sub-Saharan African HIV epidemic requires greater understanding of the ... relationships between HIV disease and maternal morbidity and mortality, integrated and effective responses by the health system, and a social context which promotes quality care and encourages use of MCH and HIV services. Advancing the proposed research agenda will make an invaluable contribution by generating needed evidence for policy and practice that improves the maternal health of women who are living with HIV, as well as those who are not. Bringing together maternal health and HIV researchers, policy-makers and program implementers to reduce HIV-related maternal morbidity and mortality and improve the HIV response for women represents an opportunity and a challenge. more
Improving maternal health in the context of the sub-Saharan African HIV epidemic requires greater understanding of the ... relationships between HIV disease and maternal morbidity and mortality, integrated and effective responses by the health system, and a social context which promotes quality care and encourages use of MCH and HIV services. Advancing the proposed research agenda will make an invaluable contribution by generating needed evidence for policy and practice that improves the maternal health of women who are living with HIV, as well as those who are not. Bringing together maternal health and HIV researchers, policy-makers and program implementers to reduce HIV-related maternal morbidity and mortality and improve the HIV response for women represents an opportunity and a challenge. more
The WHO European Office for the Prevention and Control of Noncommunicable Diseases organized an expert meeting on monitoring of digital marketing of unhealthy products to children
...
and adolescents in June 2018. Based on that meeting, this report aims to provide a tool to support Member States in monitoring digital marketing of unhealthy products to children; the resulting tool – the so-called CLICK monitoring framework – is flexible and can be adapted to national context. The report also describes current digital marketing strategies, the challenges arising from current practices, and some policy options to tackle digital marketing to children and adolescents.
more
The animal health subsector within the agriculture sector is the gatekeeper of antimicrobial resistance (AMR) in livestock, aquaculture, animal products, and the immediate animal environment. In support of member countries taking responsibility for
...
and moving forward with putting AMR monitoring and surveillance in place for the animal sector, the Food and Agriculture Organization of the United Nations Regional Office for Asia and the Pacific (FAO-RAP) developed a regional AMR surveillance framework, each pillar of which is complemented by a guideline to reinforce its progressive implementation. The first of this series, Volume 1: Monitoring and surveillance of antimicrobial resistance in bacteria from healthy food animals intended for consumption, is centered on healthy animals reaching consumers and on the protection of public health.
more
CHWs demonstrated social commitment and purpose in the short term observed. The evaluation of the training of CHWs revealed that most demonstrated the necessary skills for referrals to prevent compl
...
ications, caring for newborns and their mothers at home immediately after discharge from health care centers. CHW upskilling training on maternal-newborn services should be prioritized in the most affected areas.
more
Naicker et al. BMC Palliative Care (2016) 15:41 DOI 10.1186/s12904-016-0114-7
This external performance evaluation of the Malawi Girls’ Empowerment through Education and Health Activity (ASPIRE), conducted 2.5 years after ASPIRE began, establishes the activity’s progress
...
against its objectives, proposes adaptations for the final year, and captures lessons for application in future girls’ empowerment, health, and education programming in Malawi.
more
TB remains one of the world’s deadliest infectious diseases, second only to COVID-19, and drug-resistant TB strains are still a major concern. In the fight against TB, urgent investment is critical, especially in the context of the ongoing pandemi
...
c.
more
The indicators and questions in this document are designed for use by national AIDS programmes and partners to assess the state of a country’s HIV and
...
AIDS response, and to measure progress towards achieving national HIV targets. Countries are encouraged to integrate these indicators and questions into their ongoing monitoring efforts and to report comprehensive national data through the Global AIDS Monitoring (GAM) process. In this way they will contribute to improving understanding of the global response to the HIV epidemic, including progress that has been made towards achieving the commitments and global targets set out in the new United Nations Political Declaration on HIV and AIDS: Ending Inequalities and Getting on Track to End AIDS by 2030, adopted in June 2021, and the linked Sustainable Development Goals.
more
Training in monitoring and epidemiological assessment of mass drug administration for eliminating lymphatic filariasis: learners’ guide. World Health Organization.
Mapping Report - Ireland.
Improving Prison Conditions by Strengthening the Monitoring of HIV, HCV, TB and Harm Reduction (Spain)
C. F. Bessa, G. N. lazo, G. V. Sauret
Observatory of the Penal System and Human Rights (University of Barcelona); European Union
(2015)
C2
Mapping Report - Catalonia (Spain).
Surveillance Report
The Guidance on global monitoring for diabetes prevention and control by WHO provides a comprehensive framework to support countries in tracking and
...
managing diabetes prevention, care, and outcomes. This document outlines indicators across 4 domains: health system determinants, service delivery, risk factors, and outcomes/impacts. The guidance helps countries align their monitoring efforts with WHO’s global diabetes targets, Global Diabetes Compact, and relevant global NCD targets.
more
Kenya Signature Programme Endline Evaluation Report: Bungoma, Busia and WajirCounties.
Obare F., Abuya T., Mukisa S., Odwe G., Kanyuuru L., Cassar C., Mohamed H.
Population Council and Save the Children
(2018)
CC
Cluster performance monitoring: Annex 1: L3 Cluster activation checklist for the first three months
World Health Organization
(2012)
You can download checklists, questionnaire and Cluster monitoring cycle
Monitoring coordination performance at the national
...
and sub-national level in both sudden onset and protracted crises is necessary to ensure that clusters are efficient and effective coordination mechanisms, fulfilling the core cluster functions, meeting the needs of constituent members, and supporting delivery to affected people. It is also necessary for accountability purposes to demonstrate the added value and justify the cost of coordination.
Two tools to monitor coordination performance are elaborated in this introductory note: (1) the Cluster Activation Checklist and (2) the Coordination Performance Monitoring Report. Both have been developed based on the IASC guidance to level 3 emergencies, the commitments to the principles of accountability to affected populations and the six core functions of country clusters.
more
The ITHACA Toolkit for monitoring Human Rights and General Health Care in mental health and social care institutions
Institutional Treatment,Human Rights and CareAssessment (ITHACA)
Health Service and Population Research Department,Institute of Psychiatry, King's College London
(2010)
PLOS Medicine | DOI:10.1371/journal.pmed.1002088 August 23, 2016
3rd edition April 2018 - draft version
This Essential List for Diabetic Retinopathy contains recommendations for a range of essential itemsrequired at community / primary level (for screening); at secondary and tertiary levels (for treatment
...
and follow up). It also contains recommendations for items that are desirable, and efforts should be made to obtain these.
more
A printable copy of the article published in Morbidity and Mortality Weekly Report (MMWR) can be found on the CDC Homepage. Follow the Download Link for redirection to CDC.
Framework for implementation.
The END TB Strategy.
HIV testing in Europe - Evaluation of the impact of the ECDC guidance on HIV testing: increasing uptake and effectiveness in the European Union
European Centre for Disease Prevention and Control (ECDC)
European Centre for Disease Prevention and Control (ECDC)
(2016)
C2
Technical Report
25 February 2021
This technical guidance is a living document that builds on guidelines and reports of the UNAIDS Joint Programme. The definitions contained herein are working definitions that are subject to change. Updates will also be added furth
...
er to the work of the multistakeholder Task Team on community-led AIDS responses that was recently established by the UNAIDS Executive Director and the UNAIDS Joint Programme, and which will conclude its task in December 2021.
more
Community-based strategies play a significant role in many health systems in low- and middle-income countries, especially in light of critical shortages in the health workforce. The term community health worker has been used to refer to volunteers
...
and salaried, professional or lay health workers with a wide range of training, experience, scope of practice and integration in health systems. In the context of this study, we use the term community-based practitioner (CBPs) to reflect the diverse nature of these cadres of health workers.
CBPs provide preventive, promotive, curative and palliative services across a range of areas, including reproductive, maternal, newborn and child health, HIV, tuberculosis, malaria, control of other endemic diseases, and noncommunicable diseases. Significant evidence has emerged over the past two decades on their effectiveness, which has triggered interest in the potential to use their services to expand access to care, in particular in rural and underserved areas where deployment and retention of more qualified health workers is problematic. Calls have been made to integrate CBP programmes in human resources and health strategies, and to scale up rapidly the extent and coverage of CBP initiatives.
more
Over the past twenty years, huge efforts made by a broad coalition of stakeholders curbed the last epidemic and brought the disease to the brink of elimination. In this paper, the latest figures on disease occurrence, geographical distribution
...
and control activities are presented. Strong evidence indicates that the elimination of sleeping sickness ‘as a public health problem’ by 2020 is well within reach. In particular, fewer than one thousand new cases were reported in 2018, and the area where the risk of infection is estimated as moderate, high or very high has shrunk to less than 200,000 km2. More than half of this area is in the Democratic Republic of the Congo. The interruption of transmission of the gambiense form, targeted by the World Health Organization (WHO) for 2030, will require renewed efforts to tackle a range of expected and unexpected challenges. The rhodesiense form of the disease represents a small part of the overall HAT burden. For this form, the problem of under detection is on the rise and, because of an important animal reservoir, the elimination of disease transmission is not envisioned at this stage.
more
The Haiti Earthquake and Cholera Emergency appeal (MDRHT018) was implemented by the International Federation of Red Cross and Red Crescent Societies (IFRC) in collaboration with the Haitian Red Cros
...
s Society (HRCS) following the devastating earthquake on 14 August 2021, and the cholera outbreak on 2 October 2022.
more
USAID/Afghanistan’s $443 million investment in the Afghan Sustainable Water Supply and Sanitation (SWSS) activity is one of the Agency’s largest single investments in sustainable rural water supply delivery. The project installed about 2,123 wel
...
ls with hand pumps across Afghanistan from 2009–2012. This report presents findings from a retrospective evaluation of a random selection of wells with hand pumps installed under the SWSS project.
This evaluation’s key purpose is to identify factors that support and hinder sustainable water service delivery in different contexts. more
This evaluation’s key purpose is to identify factors that support and hinder sustainable water service delivery in different contexts. more
Evaluation on the Unicef valuation of the UNICEF PMTCT / paediatric HIV care and Treatment programme
Unicef
(2017)
Evaluation Report
Evaluation Office
MMWR: Recommendations and Reports / Vol. 62 / No. 9
Morbidity and Mortality Weekly Report
October 25, 2013
Retention of knowledge and application within the community one year later
Guide for coordinators and data collectors - The WHO Operational Package for Assessing, Monitoring and Evaluating Country Pharmaceutical Situations
...
is intended as a useful tool for researchers, policy-makers, planners and others who need to use standardized measurement tools to gather data and other information. In addition, the operational package can be used by international agencies and donors, by professional groups and nongovernmental organizations (NGOs).
more
The Capacity Project worked to strengthen HRIS in several low-resource countries to assist decision-makers and human resources managers in identifying and responding to critical gaps in HRH. The fin
...
dings and recommendations in this report cover the Capacity Project’s implementation of HRIS in Swaziland, Rwanda and Uganda.
more
Руководство по мониторингу и оценке совместной деятельности по борьбе с ТБ/ ВИЧ (russian version: A guide to monitoring and evolution for collaborative TB/HIV activities)
World Health Organization
Департамент "Остановить ТБ" и Департамент по ВИЧСПИДу, Всемирная организация здравоохранения
(2009)
C_WHO
Это руководство по мониторингу и оценке (МиО) было разработано для оказания помощи руководителям программ по борьбе с ТБ и ВИЧ-инфекций в организации совместных де
...
йствий по борьбе с ТБ/ВИЧ. Оно предназначено для того, чтобы облегчить сбор стандартизированных данных и помочь в интерпретации и распространении этих данных для усовершенствования программ.
more
The context of the Ebola epidemic presented extreme challenges for Oxfam, as it did for many organisations. At the onset of the epidemic, there was a general lack of understanding of the disease and how to respond to it effectively
...
and safely. A pervasive and persistent climate of fear, coupled with changing predictions about the likely evolution of the epidemic, influenced analysis and response at all levels. There was strong pressure to treat the epidemic as a medical emergency requiring a medical response – organised through topdown processes – rather than standard humanitarian coordination
more
Education of children with disabilities in India and Pakistan: An analysis of developments since 2000 | Background paper prepared for the Education for All Global Monitoring Report 2015 | Education
...
for All 2000-2015: achievements and challenges
more
Int J Bipolar Disord (2018) 6:6 https://doi.org/10.1186/s40345‑017‑0110‑8
In 2001, the WHO stated that: "The use of mobile and wireless technologies to support the achievement of health objectives (mHealth) has the potential to transform th
...
e face of health service delivery across the globe". Within mental health, interventions and monitoring systems for depression, anxiety, substance abuse, eating disorder, schizophrenia and bipolar disorder have been developed and used. The present paper presents the status and findings from studies using automatically generated objective smartphone data in the monitoring of bipolar disorder, and addresses considerations on the current literature and methodological as well as clinical aspects to consider in the future studies.
more
The guidance document provides a set of indicators for assessing the status of development, implementation and monitoring of key policy interventions for prevention
...
and control of NCDs and injuries. It promotes city-level evidence based decision-making processes to identify gaps and take appropriates actions to strengthen responses. Additionally, using the standardized indicators can facilitate cross-city learning, sharing best practices and lessons learnt in implementing various policy interventions.
more
The NACS User’s Guide is a series of modules that provide program managers and implementers with a package of essential information and resources. These modules are living documents
...
and will be updated as appropriate when new evidence, guidelines, or field experience emerges. Additional modules are slated to be released on such topics as nutrition support, monitoring and reporting, tools, and service implementation. Readers are invited to submit comments and suggestions for improving or updating the guidance.
more