10
Recommendations for the Future of O*NET

The preceding chapters have reviewed evidence related to the quality of the O*NET database and its uses, offering many specific recommendations for improvement. Because it may not be possible for the U.S. Department of Labor (DOL) to immediately implement all of these recommendations, this chapter presents the panel’s perspective on the relative importance of its various recommendations. The recommendations are divided into two categories, reflecting the twin goals of O*NET, to develop a high-quality database and to enhance service to O*NET users. The following section presents recommendations for a high-quality database, ranked in order of importance, and the second section of the chapter presents recommendations to enhance service to users, also ranked in order of importance. Although the recommendations can be roughly divided into these two categories, it is important to note that many recommendations are designed to improve database quality and enhance service to users simultaneously.

RECOMMENDATIONS FOR A HIGH-QUALITY DATABASE

The panel offers two primary recommendations aimed at the goal of developing and maintaining a high-quality database of occupational information.

Recommendation: The Department of Labor should focus O*NET resources on the core functions of collecting, maintaining, and publishing high-quality data, leaving development of most new applications and



The National Academies | 500 Fifth St. N.W. | Washington, D.C. 20001
Copyright © National Academy of Sciences. All rights reserved.
Terms of Use and Privacy Statement



Below are the first 10 and last 10 pages of uncorrected machine-read text (when available) of this chapter, followed by the top 30 algorithmically extracted key phrases from the chapter as a whole.
Intended to provide our own search engines and external engines with highly rich, chapter-representative searchable text on the opening pages of each chapter. Because it is UNCORRECTED material, please consider the following text as a useful but insufficient proxy for the authoritative book pages.

Do not use for reproduction, copying, pasting, or reading; exclusively for search engines.

OCR for page 187
10 Recommendations for the Future of O*NET T he preceding chapters have reviewed evidence related to the quality of the O*NET database and its uses, offering many specific recom- mendations for improvement. Because it may not be possible for the U.S. Department of Labor (DOL) to immediately implement all of these recommendations, this chapter presents the panel’s perspective on the relative importance of its various recommendations. The recommenda- tions are divided into two categories, reflecting the twin goals of O*NET, to develop a high-quality database and to enhance service to O*NET users. The following section presents recommendations for a high-quality data- base, ranked in order of importance, and the second section of the chapter presents recommendations to enhance service to users, also ranked in order of importance. Although the recommendations can be roughly divided into these two categories, it is important to note that many recommendations are designed to improve database quality and enhance service to users simultaneously. RECOMMENDATIONS FOR A HIGH-QuALITY DATABASE The panel offers two primary recommendations aimed at the goal of developing and maintaining a high-quality database of occupational information. Recommendation: The Department of Labor should focus O*NET re- sources on the core functions of collecting, maintaining, and publishing high-quality data, leaving development of most new applications and 

OCR for page 187
 A DATABASE FOR A CHANGING ECONOMY tools to the private sector, state and local governments, and educational institutions. Recommendation: The Department of Labor should establish and sup- port an external technical advisory board, comprised of senior scientists, to develop a research agenda for O*NET that will prioritize research suggestions from its members, the department, the O*NET Center, the user advisory board recommended below, and other sources. At a minimum, it should meet twice yearly, once to establish research priori- ties for the coming year and develop requests for proposals reflecting these priorities and once to review and rank proposals submitted by academic researchers or contractors. The panel views these two recommendations as offering the greatest potential for enhancing the quality of the database. In particular, establish- ing an external technical advisory board will assist DOL in managing the research agenda as changes in the labor market, O*NET user needs, the scientific research, and agency goals lead to changes in research needs and priorities. Research and Development Agenda The following list of research recommendations represents the panel’s best judgment of current research needs, based on its review of the evidence. Although the list is presented in order of perceived importance, as viewed by the panel at this time, it is not immutable. Other factors, such as costs and contingencies associated with the research, in addition to its perceived importance, should be considered in defining the order in which the re- search is undertaken. The panel expects that, in the future, the proposed technical advisory board will assist DOL in making decisions about which of these proposed research activities may be most important to undertake in any given year. The panel views three specific research activities as most important: 1. Conduct research on the content model, beginning with the Skills and knowledge domains (Chapter 2). 2. Assess benefits and costs of changing the occupational classification system (Chapter 3). 3. Study the behaviorally anchored rating scales (Chapter 4). The panel also recommends investigation of eight other issues, pre- sented below in order of importance:

OCR for page 187
 RECOMMENDATIONS FOR THE FUTURE OF O*NET 1. Explore development of Detailed Work Activities (Chapter 6). 2. Review the sampling design (Chapter 4). 3. Explore ways to increase response rates (Chapter 4). 4. Research frequency of refreshing the survey data (Chapter 4). 5. Review content model for descriptor completeness and other con- cerns of the human resource management community (Chapter 7). 6. Investigate within-occupation variation in physical and cognitive requirements (Chapters 3 and 8). 7. Develop profiles at each level of each domain (Chapter 2). 8. Investigate methods to describe changing jobs, including new sam- pling frames (Chapter 7). RECOMMENDATIONS TO ENHANCE SERvICE TO uSERS The panel offers two primary recommendations, which it views as hav- ing the greatest potential to enhance service to O*NET users: Recommendation: The Department of Labor should establish and staff an ongoing, external user advisory board, including at least one rep- resentative of each major user group, as well as representatives of potential users in the u.S. military and in k-12 and higher education. The board should meet regularly to provide advice and recommenda- tions to the Department of Labor regarding processes for identifying users’ evolving needs and communicating information about O*NET and its uses. New marketing and educational strategies must be aligned with the reality that, for many users, O*NET provides building blocks (rather than ready-made solutions or final answers) toward more com- plete solutions. In addition, DOL should ask the user advisory board to review pro- posals for modifications, enhancements, and applications of O*NET from a user’s perspective and provide advice to DOL regarding the potential benefits and adverse effects of these modifications and enhancements to the user communities. Recommendation: The technical advisory board, in consultation with the user advisory board, should establish and execute a framework for evaluating uses of O*NET that includes 1. Development of evaluation metrics aligned with various uses of O*NET. 2. Review of the usefulness and accuracy of existing information on O*NET uses.

OCR for page 187
0 A DATABASE FOR A CHANGING ECONOMY 3. Development of methods to evaluate the adequacy of existing pro- cesses for obtaining feedback from O*NET users systematically. 4. Development of new methods to systematically and continuously obtain information about the users of O*NET, the ways in which it is used, the frequency of use, reasons it is not used or might not be appropriate for certain suggested uses, user community awareness of O*NET, the specific applications it is used for, user satisfaction, and objective measures of effectiveness or success in meeting user needs. The panel views three activities as valuable to enhance service to O*NET users, presented below in order of importance, as ranked by the panel: 1. update the crosswalk to the Classification of Instructional Pro- grams (Chapter 6). 2. Create an interagency task force on disability determination (Chapter 8). 3. Make the database available in SQL (Chapter 5). Additional user recommendations, while valuable, are not viewed as equally important to those above. These recommendations are presented below in order of importance, as ranked by the panel: Develop new tools for dissemination of O*NET information in the • human resource management community (Chapter 7). Evaluate crosswalks with military occupations (Chapter 6). • Promote use in workforce development community (Chapter 6). • Conduct usability study of web interface (Chapter 5). • Make individual-level data available for research with privacy • protections (Chapter 9). Make additional statistics for survey responses available (Chapter 9). • Provide detailed information on samples within each occupation • (Chapter 9). Make the availability of successive waves of survey responses more • widely known to researchers (Chapter 9). Explore using Wiki to build a user community and gather data that • should not be used as a replacement for systematically collected data (Chapter 5). Explore potential of the Semantic Web to disseminate database • (Chapter 5).

OCR for page 187
 RECOMMENDATIONS FOR THE FUTURE OF O*NET DOL should not wait to initiate the research and development recom- mended by the panel until the technical advisory board and user advisory boards have been constituted and are fully functioning, but should proceed with continuous improvement initiatives using its traditional advisers un- til these boards can be established. The department should also establish mechanisms for ongoing communication between the user advisory board and the technical advisory board we recommend.

OCR for page 187