Suggested Citation:"Worksheets for Getting Startedwith Implementation Science." National Academies of Sciences, Engineering, and Medicine. 2021. Evaluating the Effectiveness of Interventions to Prevent and Address Sexual Harassment: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/26279.
×
Appendix E
Worksheets for Getting Started with Implementation Science
This appendix offers four approaches for using implementation science in evaluations of sexual harassment.
Suggested Citation:"Worksheets for Getting Startedwith Implementation Science." National Academies of Sciences, Engineering, and Medicine. 2021. Evaluating the Effectiveness of Interventions to Prevent and Address Sexual Harassment: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/26279.
×
SOURCE: Adapted from Rabin et al. (2019).
Suggested Citation:"Worksheets for Getting Startedwith Implementation Science." National Academies of Sciences, Engineering, and Medicine. 2021. Evaluating the Effectiveness of Interventions to Prevent and Address Sexual Harassment: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/26279.
×
For each item below, select one or more options that describes or is relevant to your project. For each box you check, you should use a separate sheet to add details.
SOURCE: Modified from Rabin et al. (2019).
Suggested Citation:"Worksheets for Getting Startedwith Implementation Science." National Academies of Sciences, Engineering, and Medicine. 2021. Evaluating the Effectiveness of Interventions to Prevent and Address Sexual Harassment: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/26279.
×
TABLE E-1 Worksheet to Guide Application of the Consolidated Framework for Implementation Research (CFIR)
Not all questions need to be (or even should be) answered. Choose the domains and constructs that make the most sense for your project.
| Domain | Constructs | Guiding Questions |
|---|---|---|
| Intervention Characteristics | ||
| Intervention Source | Who developed the intervention? What are stakeholders’ opinions of this group/person? Why is the intervention being implemented in this setting? Who decided to implement the intervention and how was that decision made? |
|
| Strength of Evidence | What kind of information or evidence are you aware of that shows whether the intervention will work in your setting? Where is that evidence from? How does this evidence influence your perception of the intervention? What do administrative or other leaders think of the intervention? What kind of supporting evidence is needed to increase stakeholders’ buy-in? |
|
| Relative Advantage | What advantages and disadvantages does this intervention have compared to other similar existing programs in your setting? How does the intervention compare to other alternatives that may have been considered or that you know about? Is there another intervention that people would rather implement? Why do they have this preference? |
|
Suggested Citation:"Worksheets for Getting Startedwith Implementation Science." National Academies of Sciences, Engineering, and Medicine. 2021. Evaluating the Effectiveness of Interventions to Prevent and Address Sexual Harassment: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/26279.
×
| Adaptability | What kinds of changes or alterations do you think you will need to make to the intervention so it will work effectively in your setting? Are there components that should not be altered? |
|
| Trialability | Can/Will the intervention be piloted prior to full-scale implementation? | |
| Complexity | How complicated is the intervention in terms of duration, scope, intricacy, and number of steps involved? | |
| Design Quality & Packaging | What supports, such as online resources, marketing materials, or a toolkit, are available to help you implement and use the intervention? How will available materials affect implementation in your setting? |
|
| Cost | What costs will be incurred to implement the intervention? | |
| Outer Setting | ||
| Stakeholders’ Needs & Resources | How “in touch” are staff and leadership with the individuals served by your organization? To what extent were the needs and preferences of the individuals served by your organization considered when deciding to implement the intervention? How do you think the individuals served by your organization will respond to the intervention? What barriers will the individuals served by your organization face to participating in the intervention? Have you elicited information from participants regarding their experiences with the intervention? |
|
Suggested Citation:"Worksheets for Getting Startedwith Implementation Science." National Academies of Sciences, Engineering, and Medicine. 2021. Evaluating the Effectiveness of Interventions to Prevent and Address Sexual Harassment: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/26279.
×
| Cosmopolitanism | To what extent do you network with colleagues or people in similar professions/positions outside your setting? What kind of information exchange do you have with others outside your setting, either related to the intervention, or more generally about your profession? To what extent does your organization encourage you to network with colleagues outside your own setting? |
|
| Peer Pressure | What you know about any other organizations that have implemented the intervention or other similar programs? To what extent are other organizations implementing the intervention? To what extent are other units within your organization implementing the intervention? To what extent would implementing the intervention provide an advantage for your organization compared to other organizations in your area? Is there something about the intervention that would bring more individuals into your organization, instead of another one in your area? |
|
| External Policies & Incentives | What kind of local, state, or national performance measures, policies, regulations, or guidelines influenced the decision to implement the intervention? How will the intervention affect your organization’s ability to meet these measures, policies, regulations, or guidelines? What kind of financial or other incentives influenced the decision to implement the intervention? |
Suggested Citation:"Worksheets for Getting Startedwith Implementation Science." National Academies of Sciences, Engineering, and Medicine. 2021. Evaluating the Effectiveness of Interventions to Prevent and Address Sexual Harassment: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/26279.
×
| Inner Setting | ||
| Structural Characteristics | How will the infrastructure of your organization (social architecture, age, maturity, size, or physical layout) affect the implementation of the intervention? What kinds of infrastructure changes will be needed to accommodate the intervention? Changes in scope of practice? Changes in formal policies? Changes in information systems or electronic records systems? |
|
| Networks & Communications | Do you meet (formally or informally) with a team of people? Can you describe your working relationship with leaders? Can you describe your working relationship with influential stakeholders? How do you typically find out about new information, such as new initiatives, accomplishments, issues, new staff, and staff departures? When you need to get something done or to solve a problem, who are your “go-to” people? |
|
| Culture | How would you describe the culture of your organization? Of your own setting or unit? How do you think your organization’s culture (general beliefs, values, assumptions that people embrace) will affect the implementation of the intervention? To what extent are new ideas embraced and used to make improvements in your organization? |
|
Suggested Citation:"Worksheets for Getting Startedwith Implementation Science." National Academies of Sciences, Engineering, and Medicine. 2021. Evaluating the Effectiveness of Interventions to Prevent and Address Sexual Harassment: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/26279.
×
| Implementation Climate | What is the general level of receptivity in your organization to implementing the intervention? | |
| Tension for Change | How essential is this intervention to meet the needs of the individuals served by your organization or other organizational goals and objectives? | |
| Compatibility | How well does the intervention fit with your values and norms and the values and norms within the organization? How well does the intervention fit with existing work processes and practices in your setting? Can you describe how the intervention will be integrated into current processes? Will the intervention replace or complement a current program or process? |
|
| Relative Priority | To what extent might the implementation take a backseat to other high-priority initiatives going on now? How will you juggle competing priorities in your own work? How will your colleagues juggle these priorities? |
|
| Organizational Incentives & Rewards | What kinds of incentives are there to help ensure that the implementation of the intervention is successful? To what extent do you think your supervisor will consider your role in this implementation in your (next) evaluation? In their regard for your work or role? Are there any special recognitions or rewards planned that are related to implementing the intervention? |
Suggested Citation:"Worksheets for Getting Startedwith Implementation Science." National Academies of Sciences, Engineering, and Medicine. 2021. Evaluating the Effectiveness of Interventions to Prevent and Address Sexual Harassment: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/26279.
×
| Goals & Feedback | Have you/your unit/your organization set goals related to the implementation of the intervention? (If yes, what are they?) To what extent does your organization/unit set goals for current programs/initiatives? To what extent are organizational goals monitored for progress? How will you get feedback about the implementation? |
|
| Learning Climate | To what extent do you feel like you can try new things to improve your work processes? | |
| Readiness for Implementation | What level of endorsement or support have you seen or heard from leaders? What kind of support or actions can you expect from leaders in your organization to help make implementation successful? Do you expect to have sufficient resources to implement and administer the intervention? What kind of training is planned for you? For colleagues? Who do you ask if you have questions about the intervention or its implementation? |
|
| Characteristics of Individuals | ||
| Knowledge & Beliefs | What do you know about the intervention or its implementation? Do you think the intervention will be effective in your setting? |
|
Suggested Citation:"Worksheets for Getting Startedwith Implementation Science." National Academies of Sciences, Engineering, and Medicine. 2021. Evaluating the Effectiveness of Interventions to Prevent and Address Sexual Harassment: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/26279.
×
| Self-efficacy | How confident are you that you will be able to successfully implement the intervention? How confident are you that you will be able to use the intervention? How confident do you think your colleagues feel about implementing the intervention? How confident do you think your colleagues feel about using the intervention? |
|
| Individual Stage of Change |
How prepared are you to use the intervention?
|
|
| Individual Identification with the Organization | What are individuals’ buy-in to organizational or intervention-related goals? | |
| Other personal attributes | Other motivational or behavior change constructs that could be related to the intervention. |
Suggested Citation:"Worksheets for Getting Startedwith Implementation Science." National Academies of Sciences, Engineering, and Medicine. 2021. Evaluating the Effectiveness of Interventions to Prevent and Address Sexual Harassment: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/26279.
×
| Process | ||
| Planning | What have you done (or what do you plan to do) to get a plan in place to implement the intervention? Can you describe the plan for implementing the intervention? |
|
| Engaging | Who are the key influential individuals to get on board with this implementation? What are influential individuals saying about the intervention? How did your organization become involved in implementing the intervention? Other than the formal implementation leader, are there people in your organization who are likely to champion (go above and beyond what might be expected) the intervention? Can you describe people’s perception of this champion/individual? Will someone (or a team) outside your organization be helping you with implementing the intervention? What steps have been taken to encourage individuals to commit to using the intervention? Who are the key individuals to get on board with the intervention? |
|
| Executing | (During or post-implementation) Has the intervention been implemented according to the implementation plan? |
|
Suggested Citation:"Worksheets for Getting Startedwith Implementation Science." National Academies of Sciences, Engineering, and Medicine. 2021. Evaluating the Effectiveness of Interventions to Prevent and Address Sexual Harassment: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/26279.
×
| Reflecting & Evaluating | What kind of information do you plan to collect as you implement the intervention? Which measures will you track? How will you track them? How will this information be used? Will you receive feedback reports about the implementation or the intervention itself? How will you assess progress toward implementation or intervention goals? How will results of the evaluation be distributed to stakeholders? |
SOURCE: Modified from the Consolidated Framework for Implementation Research. Available: https://cfirguide.org/guide/app/#/.
Suggested Citation:"Worksheets for Getting Startedwith Implementation Science." National Academies of Sciences, Engineering, and Medicine. 2021. Evaluating the Effectiveness of Interventions to Prevent and Address Sexual Harassment: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/26279.
×
TABLE E-2 Worksheet to Guide Application of the Practical, Robust Implementation and Sustainability Model (PRISM)
Not all questions need to be (or even should be) answered. Choose the domains and constructs that make the most sense for your project.
| Domain | Constructs | Guiding Questions |
|---|---|---|
| Program/Intervention | ||
| Organizational Perspective | Are there any specific staff roles that are needed to support the intervention? Are these already in place or do they need to be created? | |
| Consumer Perspective | How does the intervention affect the intended target(s)? How do the target(s) of the intervention feel about the current situation (pre-intervention)? |
|
| External Environment | To what extent does the intended intervention fit in with national priorities in higher education? | |
| Implementation and Sustainability Infrastructure | What does the ideal setting (e.g., lab, department, college) look/function like? What resources need to be in place to make this happen? How would the intervention continue to persist in the workflow of the organization? Do you have the tools and skills needed to continue to provide and develop the intervention? |
|
Suggested Citation:"Worksheets for Getting Startedwith Implementation Science." National Academies of Sciences, Engineering, and Medicine. 2021. Evaluating the Effectiveness of Interventions to Prevent and Address Sexual Harassment: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/26279.
×
| Recipients | ||
| Organizational | Is sexual harassment prevention explicitly valued in the organization? For the individuals within the organization? How much support is there from institutional leaders to combat this issue? Are there any champions to support the intervention? Does the intervention fit in with institutional priorities? What processes or policies are already in place around this issue? How could they affect implementation of the intervention? What barriers currently exist for addressing sexual harassment in your organization? What are the benefits to the organization of participating in implementation? |
|
| Consumer | How confident are you that you will be able to successfully implement the intervention? How confident are you that you will be able to use the intervention? How confident do you think your colleagues feel about implementing the intervention? How confident do you think your colleagues feel about using the intervention? What is your opinion of how the institution handles sexual harassment and prevention? What are your concerns about these topics? How are you affected by current policies? How would receiving the intervention impact you? |
|
SOURCE: Modified from McCreight et al. (2019).
Suggested Citation:"Worksheets for Getting Startedwith Implementation Science." National Academies of Sciences, Engineering, and Medicine. 2021. Evaluating the Effectiveness of Interventions to Prevent and Address Sexual Harassment: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/26279.
×
Suggested Citation:"Worksheets for Getting Startedwith Implementation Science." National Academies of Sciences, Engineering, and Medicine. 2021. Evaluating the Effectiveness of Interventions to Prevent and Address Sexual Harassment: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/26279.
×
Suggested Citation:"Worksheets for Getting Startedwith Implementation Science." National Academies of Sciences, Engineering, and Medicine. 2021. Evaluating the Effectiveness of Interventions to Prevent and Address Sexual Harassment: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/26279.
×
Suggested Citation:"Worksheets for Getting Startedwith Implementation Science." National Academies of Sciences, Engineering, and Medicine. 2021. Evaluating the Effectiveness of Interventions to Prevent and Address Sexual Harassment: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/26279.
×
Suggested Citation:"Worksheets for Getting Startedwith Implementation Science." National Academies of Sciences, Engineering, and Medicine. 2021. Evaluating the Effectiveness of Interventions to Prevent and Address Sexual Harassment: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/26279.
×
Suggested Citation:"Worksheets for Getting Startedwith Implementation Science." National Academies of Sciences, Engineering, and Medicine. 2021. Evaluating the Effectiveness of Interventions to Prevent and Address Sexual Harassment: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/26279.
×
Suggested Citation:"Worksheets for Getting Startedwith Implementation Science." National Academies of Sciences, Engineering, and Medicine. 2021. Evaluating the Effectiveness of Interventions to Prevent and Address Sexual Harassment: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/26279.
×
Suggested Citation:"Worksheets for Getting Startedwith Implementation Science." National Academies of Sciences, Engineering, and Medicine. 2021. Evaluating the Effectiveness of Interventions to Prevent and Address Sexual Harassment: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/26279.
×
Suggested Citation:"Worksheets for Getting Startedwith Implementation Science." National Academies of Sciences, Engineering, and Medicine. 2021. Evaluating the Effectiveness of Interventions to Prevent and Address Sexual Harassment: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/26279.
×
Suggested Citation:"Worksheets for Getting Startedwith Implementation Science." National Academies of Sciences, Engineering, and Medicine. 2021. Evaluating the Effectiveness of Interventions to Prevent and Address Sexual Harassment: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/26279.
×
Suggested Citation:"Worksheets for Getting Startedwith Implementation Science." National Academies of Sciences, Engineering, and Medicine. 2021. Evaluating the Effectiveness of Interventions to Prevent and Address Sexual Harassment: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/26279.
×
Suggested Citation:"Worksheets for Getting Startedwith Implementation Science." National Academies of Sciences, Engineering, and Medicine. 2021. Evaluating the Effectiveness of Interventions to Prevent and Address Sexual Harassment: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/26279.
×
Suggested Citation:"Worksheets for Getting Startedwith Implementation Science." National Academies of Sciences, Engineering, and Medicine. 2021. Evaluating the Effectiveness of Interventions to Prevent and Address Sexual Harassment: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/26279.
×
Suggested Citation:"Worksheets for Getting Startedwith Implementation Science." National Academies of Sciences, Engineering, and Medicine. 2021. Evaluating the Effectiveness of Interventions to Prevent and Address Sexual Harassment: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/26279.
×
