The National Academies Press

Currently Skimming:

Pages 129-158

The Chapter Skim interface presents what we've algorithmically identified as the most significant single chunk of text within every page in the chapter.
Select key terms on the right to highlight them within pages of the chapter.

From page 129... ... 4 Measurement, Evaluation, and Reporting for Improved Readiness and Resilience In God we trust, all others bring data. -- The Elements of Statistical Learning (Hastie et al., 2009) Read the entire page →
From page 130... ... 130 A READY AND RESILIENT WORKFORCE FOR DHS ment of programs will produce important information on whether the programs are yielding improvements in health, morale, safety, and resilience. This feedback mechanism will, in turn, allow DHS to calculate the potential cost savings for the department in the form of improved worker productivity, reduced turnover, and possibly reduced health care use (Baicker et al., 2010; CDC, 2011) Read the entire page →
From page 131... ... MEASUREMENT, EVALUATION, AND REPORTING 131 sign? Read the entire page →
From page 132... ... 132 A READY AND RESILIENT WORKFORCE FOR DHS FIGURE 4-1 Model of a workplace program measurement schema. SOURCE: Goetzel, 2013. Read the entire page →
From page 133... ... MEASUREMENT, EVALUATION, AND REPORTING 133 DHS was not able to share the action plans, so the committee cannot comment on whether the plans are actionable and measurable. However, on reviewing the action plans, GAO (2012a) Read the entire page →
From page 134... ... 134 A READY AND RESILIENT WORKFORCE FOR DHS discussion with representatives of several offices in OCHCO,2 it became clear that DHS does not have a good understanding of what data are available, how the existing data are currently being used around the department, how the data could potentially be used, and how many of the data that are collected are not readily available to them because of rules and silos. DHS uses few tools and data points to assess the readiness and resilience of its workforce. Read the entire page →
From page 135... ... MEASUREMENT, EVALUATION, AND REPORTING 135  Performance and presenteeism  Psychosocial risk factors, such as stress and depression  Long- and short-term disability  Worker compensation and safety (minimal data available to DHS, but the data are collected by the federal government) (Green, 2013) Read the entire page →
From page 136... ... 136 A READY AND RESILIENT WORKFORCE FOR DHS The Office of Health Affairs (OHA) , which has responsibility for overseeing the DHSTogether program, does not conduct systematic measurement activities related to readiness and resilience. Read the entire page →
From page 137... ... MEASUREMENT, EVALUATION, AND REPORTING 137 BOX 4-2 Use of Federal Employee Viewpoint Survey Data to Identify Top Drivers of Workforce Satisfaction in Immigration and Customs Enforcement The Office of Human Capital, Strategy and Technology (HCT) in Im migration and Customs Enforcement (ICE) Read the entire page →
From page 138... ... 138 A READY AND RESILIENT WORKFORCE FOR DHS Safety and Health (NIOSH) Essential Elements of Effective Workplace Programs (2008) Read the entire page →
From page 139... ... MEASUREMENT, EVALUATION, AND REPORTING 139 understood and actionable, and to make changes in response to the data analyses. The key factors are to determine the data needed for measurement and evaluation, where the data reside, whether new data need to be collected to address information gaps, how the data should be managed, and the frequency of reporting to decision makers. Read the entire page →
From page 140... ... 140 A READY AND RESILIENT WORKFORCE FOR DHS 1. What do we want to know? Read the entire page →
From page 141... ... MEASUREMENT, EVALUATION, AND REPORTING 141 hypotheses. Figure 4-2 shows a logic model of worksite health promotion that was developed by the Centers for Disease Control and Prevention (CDC) Read the entire page →
From page 142... ... 142 A READY AND RESILIENT WORKFORCE FOR DHS finally improved productivity. The model provides a checklist of items that need to be measured and the sequence of events, with arrows indicating the need for structural changes, which lead to process improvements and finally to the desired outcomes. Read the entire page →
From page 143... ... MEASUREMENT, EVALUATION, AND REPORTING 143 turnover and attract the best talent, the medical director may wish to prevent accidents and manage illnesses, and the administrator may wish to improve employee ratings of the agency. It is important to bring key decisionmakers together so that a consensus opinion can be formed on conceptual and operational definitions of program success. Read the entire page →
From page 144... ... 144 A READY AND RESILIENT WORKFORCE FOR DHS BOX 4-4 Requirements for Successful Data Integration 1. Data collection, management, and reporting according to agreed-on protocols and standards. Read the entire page →
From page 145... ... MEASUREMENT, EVALUATION, AND REPORTING 145 Management website includes a "complete workforce planning guide, as well as detailed workforce analysis reports, analytical tools for examining current and past workforce characteristics, and forecasting tools for determining future workforce trends within NASA and across the entire labor market" (Partnership for Public Service, 2005) Read the entire page →
From page 146... ... 146 A READY AND RESILIENT WORKFORCE FOR DHS for data integration; and there needs to be emphasis by and participation of senior leadership to achieve successful data integration. Data integration can be highly technical and labor-intensive, so it requires specific technical expertise. Read the entire page →
From page 147... ... MEASUREMENT, EVALUATION, AND REPORTING 147 measures can cause an organization to lose sight of which measures contribute to meeting strategic objectives and can add noise to the system. In addition, collecting data can be expensive -- both in dollars spent and in staff time spent analyzing and reporting the data. Read the entire page →
From page 148... ... 148 A READY AND RESILIENT WORKFORCE FOR DHS Organizational measures can be constructed by using climate scales that are widely available and tested, including8 the Health Enhancement Research Organization (HERO) Employee Health Management Best Practice Scorecard (HERO Scorecard) Read the entire page →
From page 149... ... MEASUREMENT, EVALUATION, AND REPORTING 149 BOX 4-6 Excerpts from the Johnson & Johnson Health and Performance Index (Excerpts from Section to Be Filled Out by Employees) About Your Health  Would you say that in general your health is. Read the entire page →
From page 150... ... 150 A READY AND RESILIENT WORKFORCE FOR DHS Leading by Example (Indicate the extent to which you Disagree or Agree with the following statements. Please note: consider "leadership" as those in position to influence health and human performance related activities and policies at your organization.) Read the entire page →
From page 151... ... MEASUREMENT, EVALUATION, AND REPORTING 151 7. When needed I am willing to put in the extra effort to get a job done 9. Read the entire page →
From page 152... ... 152 A READY AND RESILIENT WORKFORCE FOR DHS Continuous Improvement Measurement and evaluation are critical for ensuring continuous improvement, which is one of the NIOSH essential elements ("learn from experience") Read the entire page →
From page 153... ... MEASUREMENT, EVALUATION, AND REPORTING 153 can assess the degree of difficulty that an officer is having and take appropriate action to remedy the situation. ADDRESSING THE GAPS Measuring health-improvement processes, understanding their relationship to the well-being of an organization, and designing effective interventions all rely on collecting understandable, valid, timely, accurate, and integrated data. Read the entire page →
From page 154... ... 154 A READY AND RESILIENT WORKFORCE FOR DHS Characteristics of the evaluation strategy should include a. A focus on structure, process, and outcome measures. Read the entire page →
From page 155... ... MEASUREMENT, EVALUATION, AND REPORTING 155 out DHS on the basis of goals adopted for WRR and in alignment with the mission. Component agencies will need to identify other measures or data points on the basis of their unique needs and goals to complement the core measures identified for use DHS-wide. Read the entire page →
From page 156... ... 156 A READY AND RESILIENT WORKFORCE FOR DHS Care Continuum Alliance. Read the entire page →
From page 157... ... MEASUREMENT, EVALUATION, AND REPORTING 157 HERO (Health Enhancement Research Organization) Read the entire page →

From page 129...

... 4 Measurement, Evaluation, and Reporting for Improved Readiness and Resilience In God we trust, all others bring data. -- The Elements of Statistical Learning (Hastie et al., 2009)