Evaluation Plan Guidance Page 47
ADVERTISEMENT
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68EVALUATION PLAN GUIDANCE
SOCIAL INNOVATION FUND
Sampling Plan and Power Analysis Evaluation
The size and composition of the sample is described and is consistent with the “Budget” section.
Sampling plan is designed to select participants that are representative of the population from which they were selected.
The target population from which the sample was selected and the sample selection procedures, including any geographic
regions targeted are described.
Statistical power is estimated and consistent with the study design.
The statistical power analysis used to arrive at the sample size is described, and includes the minimum detectable effect size
(MDES) that has an 80 percent chance of being statistically significant at a specific alpha level.
Outcome(s) and assumptions used in the statistical power calculations are described.
When there are plans to conduct analyses of subgroups, additional statistical power analyses are presented to estimate those
MDES.
Sample Retention
Strategies to recruit study participants are described.
Alternative strategies that can be implemented if the initial strategy is unsuccessful are outlined.
Plan describes strategies and incentives to recruit and retain study participants (e.g. remuneration for all participants).
Justification is given for amount of remuneration.
A management plan to monitor, track, and troubleshoot issues that arise in retaining the study sample during program
implementation is described.
Measures
How each outcome is aligned with the logic model.
If there are multiple outcomes, as indicated by the logic model and the research questions, the plan differentiates between
confirmatory and exploratory outcomes consistent with the logic model and research questions.
How each variable from the logic model will be measured is detailed.
For each measure, whether the measure will be developed or has already been developed (i.e., a commercially available, off-the-
shelf measure) is explained.
If the outcome measure differs across sites or groups/sub groups of sample members, how the different measures will be
combined is described.
Measure Validity, Reliability and History of Use
Information regarding each measure’s reliability and validity (e.g., Cronbach’s alpha), and validation against outcomes as well as
historical use, if available, is provided.
If reliability and validity of measures have yet to be determined, an analysis plan for doing so is presented.
Data Collection Activities (for each data source the SEP includes)
.
A description of baseline measures is provided
.
The timing of baseline collection relative to start of the intervention is described
Whether baseline measures are adequate for assessing baseline equivalence is explained.
.
A description of who will collect the data is included
A description of the role of staff members delivering the intervention with regard to data collection is described.
The timing of the data collection, relative to delivery of the program is explained.
Discussion of how the data will be collected is included.
B.7
ADVERTISEMENT
0 votes
Related Articles
Related forms
Related Categories
Parent category: Education