BOX 5-2

Criteria for Assessing Practices Draft Proposed at Workshop to Facilitate Discussion

  1. Impact

    1. Did the program reduce child or forced labor?

    2. Did it benefit child or forced laborers?

    3. How was impact measured?

    4. Direct, indirect, and unintended consequences?

  1. Program and/or practice effectiveness

    1. Did the program achieve its goals?

  1. Replicability

    1. Could the practice be implemented with modest adaptation in other settings?

    2. What factors limit/encourage replicability?

  1. Sustainability

    1. Is the practice likely to continue (as needed)?

    2. Is the benefit likely to continue effectively?

      1. Is the institutional capacity necessary to sustain benefits or practices?

      2. Local ownership

  1. Cost effectiveness

    1. Were the benefits adequate in relation to likely benefits from comparable investments?

    2. How is cost effectiveness measured?

  1. Relevance

    1. Is there a set of assumptions about how activities will lead to outcomes? (Do you understand why the program works?)

    2. Is there a logical connection between the inputs, activities, and outcomes?

Program or practice effectiveness—the second element—was more focused on the program or intervention and asked whether it achieved its goals. It is a somewhat narrower construction than the notion of impact.

Replicability focuses on the extent to which a practice is unique to a particular situation or can be used elsewhere. What kind of modifications would be needed to have a program that is successful in one venue be successful in other venues without significant adaptation? A related question is to ask which factors limit or encourage replicability, because that helps one to understand the context in which a practice can work or not.

Sustainability is, in a sense, the other side of replicability and focuses on whether a practice can continue beyond an initial outlay of resources (e.g., initial funding). Individual programs or initiatives are often funded for a set period of time and then financing is reduced or eliminated (sometimes with the idea that other sources of funding will be found by the time the initial period ends). This is very common in almost any



The National Academies | 500 Fifth St. N.W. | Washington, D.C. 20001
Copyright © National Academy of Sciences. All rights reserved.
Terms of Use and Privacy Statement