Review of Four CARA Programs and Preparing for Future Evaluations (2023) / Chapter Skim
Currently Skimming:
Appendix C: Evaluation Types and Data Requirements
Appendix C: Evaluation Types and Data Requirements
Pages 203-212
The Chapter Skim interface presents what we've algorithmically identified as the most significant single chunk of text within every page in the chapter.
Select key terms on the right to highlight them within pages of the chapter.
From page 203... ...
Appendix C Evaluation Types and Data Requirements INTRODUCTION To obtain information useful for policy making through an effective evaluation requires substantial coordination, support, and data sharing among the stakeholders (e.g., the funding agency, grantees, and the evaluator)
|
From page 204... ...
Formative evaluations can provide early insights into what is working, what is not working, and where modifications to the original program design need to be made. Formative evaluations are also used early in program development to identify relevant process and outcomes measures and the appropriate mechanisms for generating them.
|
From page 205... ...
To answer such specific questions with high levels of confidence, summative evaluations typically use quasi-experimental or experimental research designs and rely on detailed quantitative measurements that have been systematically collected over time. Cost-effectiveness evaluations are one type of summative evaluation and requires additional systematic collection of appropriate cost information.
|
From page 206... ...
INFORMATION AND DATA REQUIRED TO CONDUCT COST-BENEFIT OR COST-EFFECTIVENESS ANALYSES Because the Consolidated Appropriations Act of 2018 specifically mentioned cost-effectiveness, the committee provides a detailed discussion of cost-effectiveness and a related type of evaluation, cost benefit analysis. Cost-benefit analysis (CBA)
|
From page 207... ...
An economic evaluation focused on the effects of providing recovery support, if nonspecific, can include a range of ways in which recovery might be supported including employment support, peer support aids, clean living assistance, and job training, while an economic evaluation focused on the impact of training and using peer support workers would have a narrower set of outcomes and costs to consider. Step 3: Clearly identify the perspective to be taken.
|
From page 208... ...
Thus, a critical component of any CEA or CBA analysis is the identification of the proper time horizon for comparing policy options in terms of their costs, benefits, and outcomes. This is important because the timing of when costs and benefits accrue can differ substantially across programs, making one program look more advantageous when evaluated over a shorter time horizon (those with immediate benefits, and low initial costs)
|
From page 209... ...
Tangible resources, such as personnel, supplies, technology, and services, are the easiest to identify but can still create challenges for analysts assigning unit costs when market prices do not reflect the true opportunity cost of those resources (e.g., donated time as a volunteer)
|
From page 210... ...
Depending on the question being asked and the type of economic evaluation undertaken, different summary measures can be generated, and whether a policy or program is a good investment will depend on the summary measure used. For CBA, when using net benefit as the primary decision rule, the reference decision point may be a net benefit > 0, if comparing a program to the status quo, or it may be a minimal positive value if comparing across programs.
|
From page 211... ...
Equity is not a consideration in these analyses, and yet may be an important consideration for policy makers. Thus, some recent guidelines on how to conduct CEA and CBA recommend subpopulation analyses that focus on particularly vulnerable populations so that policy makers can see what sort of disproportional impacts might be experienced by these groups (WHO, 2006; Wilkinson et al., 2016)
|
From page 212... ...
A Program Manager's Guide for Program Improvement in Ongoing Psychological Health and Traumatic Brain Injury Programs: The RAND Tool kit, Volume 4. RAND Corporation.
|
Key Terms
This material may be derived from roughly machine-read images, and so is provided only to facilitate research.
More
information on Chapter Skim is available.