References

Adult Performance Level Project. (1975). Adult functional competency: A summary. (ED No. 114 609.) Austin: University of Texas, Division of Extension.

American Educational Research Association, American Psychological Association, and National Council on Measurement in Education. (1999). Standards for educational and psychological testing. Washington, DC: American Educational Research Association.

American Medical Association. (1999). Health literacy: Report of the Ad Hoc Committee on Health Literacy for the Council of Scientific Affairs. Journal of the American Medical Association, 281(6), 552-557.


Baldwin, J., Kirsch, I.S., Rock, D., and Yamamoto, K. (1995). The literacy proficiencies of GED examinees: Results from the GED-NALS Comparison Study. Washington, DC: American Council on Education and Educational Testing Service.

Baron, D. (2002). Will anyone accept the good news on literacy? The Chronicle of Higher Education, February 1.

Barton, P.E. (1999). What jobs require: Literacy, education, and training, 1940-2006. Princeton, NJ: Educational Testing Service.

Berk, R.A. (1986). A consumer’s guide to setting performance standards on criterion-referenced tests. Review of Educational Research, 56, 137-172.

Berkman, N.D., De Walt, D.A., Pignone, M.P., Sheridan, S.L., Lohr, K.N., Lux, L., Sutton, S.F., Swinson, T., and Bonito, A.J. (2004). Literacy and health outcomes. (Evidence Report/Technology Assessment No. 87 prepared by RTI International-University of North Carolina Evidence-Based Practice Center under Contract No. 290-02-0016. AHRQ Publication No. 04-E007-1.) Rockville, MD: Agency for Healthcare Research and Quality.

Berliner, D.C. (1996). Nowadays, even the illiterates read and write. Research in the Teaching of English, 30(3), 334-351.

Beuck, C.H. (1984). A method for researching a compromise between absolute and relative standards in examinations. Journal of Educational Measurement, 21, 147-152.

Brady, H.E. (1996). Political participation. In M.X. Delli Carpini and S. Keeter (Eds.), What Americans know about politics and why it matters. New Haven, CT: Yale University Press.



The National Academies | 500 Fifth St. N.W. | Washington, D.C. 20001
Copyright © National Academy of Sciences. All rights reserved.
Terms of Use and Privacy Statement



Below are the first 10 and last 10 pages of uncorrected machine-read text (when available) of this chapter, followed by the top 30 algorithmically extracted key phrases from the chapter as a whole.
Intended to provide our own search engines and external engines with highly rich, chapter-representative searchable text on the opening pages of each chapter. Because it is UNCORRECTED material, please consider the following text as a useful but insufficient proxy for the authoritative book pages.

Do not use for reproduction, copying, pasting, or reading; exclusively for search engines.

OCR for page 196
Measuring Literacy: Performance Levels for Adults References Adult Performance Level Project. (1975). Adult functional competency: A summary. (ED No. 114 609.) Austin: University of Texas, Division of Extension. American Educational Research Association, American Psychological Association, and National Council on Measurement in Education. (1999). Standards for educational and psychological testing. Washington, DC: American Educational Research Association. American Medical Association. (1999). Health literacy: Report of the Ad Hoc Committee on Health Literacy for the Council of Scientific Affairs. Journal of the American Medical Association, 281(6), 552-557. Baldwin, J., Kirsch, I.S., Rock, D., and Yamamoto, K. (1995). The literacy proficiencies of GED examinees: Results from the GED-NALS Comparison Study. Washington, DC: American Council on Education and Educational Testing Service. Baron, D. (2002). Will anyone accept the good news on literacy? The Chronicle of Higher Education, February 1. Barton, P.E. (1999). What jobs require: Literacy, education, and training, 1940-2006. Princeton, NJ: Educational Testing Service. Berk, R.A. (1986). A consumer’s guide to setting performance standards on criterion-referenced tests. Review of Educational Research, 56, 137-172. Berkman, N.D., De Walt, D.A., Pignone, M.P., Sheridan, S.L., Lohr, K.N., Lux, L., Sutton, S.F., Swinson, T., and Bonito, A.J. (2004). Literacy and health outcomes. (Evidence Report/Technology Assessment No. 87 prepared by RTI International-University of North Carolina Evidence-Based Practice Center under Contract No. 290-02-0016. AHRQ Publication No. 04-E007-1.) Rockville, MD: Agency for Healthcare Research and Quality. Berliner, D.C. (1996). Nowadays, even the illiterates read and write. Research in the Teaching of English, 30(3), 334-351. Beuck, C.H. (1984). A method for researching a compromise between absolute and relative standards in examinations. Journal of Educational Measurement, 21, 147-152. Brady, H.E. (1996). Political participation. In M.X. Delli Carpini and S. Keeter (Eds.), What Americans know about politics and why it matters. New Haven, CT: Yale University Press.

OCR for page 196
Measuring Literacy: Performance Levels for Adults Brennan, R.L. (1998). Misconceptions at the intersection of measurement theory and practice. Educational Measurement: Issues and Practice, 17(1), 5-9. Campbell, A., Kirsch, I.S., and Kolstad, A. (1992). Assessing literacy. Washington, DC: U.S. Department of Education, National Center for Education Statistics. Cizek, G.J. (1993). Reactions to the National Academy of Education report setting performance standards for student achievement. Washington, DC: National Assessment Governing Board. Cizek, G.J. (2001a). Conjectures on the rise and call of standard setting: An introduction to context and practice. In G.J. Cizek (Ed.), Setting performance standards: Concepts, methods, and perspectives. Mahwah, NJ: Lawrence Erlbaum. Cizek, G.J. (Ed.), (2001b). Setting performance standards: Concepts, methods, and perspectives. Mahwah, NJ: Lawrence Erlbaum. Cizek, G.J., Bunch, M.B., and Koons, H. (2004). An NCME instructional module on setting performance standards: Contemporary methods. Educational Measurement: Issues and Practice, 2(4), 31-50. Delli Carpini, M.X. and Keeter, S. (1996). What Americans know about politics and why it matters. New Haven, CT: Yale University Press. Egan, K.L. (2001). Validity and defensibility of cut scores established by the bookmark standard setting methods. Paper presented at the Council of Chief State School Officers Conferences on Large-Scale Assessment, June, Houston, TX. Equipped for the Future Assessment Consortium, Center for Literacy Studies at University of Tennessee, and SRI International. (2002). EFF/NRS data collection project, 2000-2001: An interim report on the development of the EFF assessment framework. Washington, DC: National Institute for Literacy. Fry, E. (1977). Fry’s readability graph: Clarifications, validity and extension to Level 17. Journal of Reading, 21, 242-252. GED Testing Service. (2004). Who passed the GED tests? 2002 statistical report. Washington, DC: American Council on Education. Geisinger, K.F. (1991). Using standard-setting data to establish cutoff scores. Educational Measurement: Issues and Practice, 10(2), 17-22. Gray, P. (1993). Adding up the under-skilled: A survey finds nearly half of U.S. adults lack the literacy to cope with modern life. Time, September 20, 142, 175. Green, D.R., Trimble, C.S., and Lewis, D.M. (2003). Interpreting the results of three different standard-setting procedures. Educational Measurement: Issues and Practice, 22(1), 22-32. Greenberg, E., Macia, R., Rhodes, D., and Chan T. (2001). English literacy and language minorities in the United States. (No. 2001-464). Washington, DC: U.S. Department of Education, National Center for Education Statistics. Haigler, K.O., Harlow, C., O’Connor, P., and Campbell, A. (1994). Literacy behind prison walls: Profiles of the prison population from the National Adult Literacy Survey. Washington, DC: U.S. Department of Education, National Center for Education Statistics. Hambleton, R.K. (1980). Test score validity and standard setting methods. In D.C. Berliner, (Ed.), Criterion-referenced measurement: The state of the art (pp. 80-123). Baltimore, MD: Johns Hopkins University Press. Hambleton, R.K. (2001). Setting performance standards on educational assessments and criteria for evaluating the process. In C.J. Cizek (Ed.), Setting performance standards: Concepts, methods, and perspectives. Mahwah, NJ: Lawrence Erlbaum. Hambleton, R.K., and Bourque, M.L. (1991). The levels of mathematics achievement (technical report, vol. III). Washington, DC: National Assessment Governing Board.

OCR for page 196
Measuring Literacy: Performance Levels for Adults Hambleton, R.K., Brennan, R.L., Brown, W., Dodd., B., Forsyth, R.A., Mehrens, W.A., Nellhaus, J., Rackase, M., Rindone, D., van der Linden, W.J., and Zqick, R. (2000). A response to “setting reasonable and useful performance standards” in the National Academy of Sciences “Grading the nation’s report card.” Educational Measurement: Issues and Practice, 19(2), 5-14. Hauck, W.W. (1983). A note on confidence bands for the logistic regression curve. American Statistician, 37, 158-160. Hauser, R.M. and Goldberger, A.S. (1971). The treatment of unobservable variables in path analysis. In H.L. Costner (Ed.), Sociological methodology (pp. 81-117). San Francisco: Jossey-Bass. Hofstee, W.K.B. (1983). The case for compromise in educational selection and grading. In S.B. Anderson and J.S. Helmick (Eds.), On educational testing (pp. 109-127). San Francisco: Jossey-Bass. Huff, K. L. (2001). Overcoming unique challenges to a complex performance assessment: A novel approach to standard setting. Paper presented at the annual meeting of the National Council on Measurement in Education, April, Seattle, WA. Hunyh, H. (2000). On item mappings and statistical rules for selecting binary items for criterion-referenced interpretation and bookmark standard settings. Paper presented at the annual meeting of the National Council for Measurement in Education, April, New Orleans. Institute of Medicine. (2004). Health literacy: A prescription to end confusion. Committee on Health Literacy, Board on Neuroscience and Behavioral Health. Washington, DC: The National Academies Press. Jaeger, R.M. (1989). Certification of student competence. In R.L. Linn (Ed.), Educational measurement (3rd ed., pp. 485-514). Washington DC: American Council on Education. Jaeger, R.M. (1991). Selection of judges for standard-setting. Educational Measurement: Issues and Practice, 10(2), 3-6. Jaeger, R.M., and Mills, C.N. (2001). An integrated judgement procedure for setting standards on complex, large-scale assessments. In G.J. Cizek (Ed.), Setting performance standards: Concepts, methods, and perspectives. Mahwah, NJ: Lawrence Erlbaum. Jordan, H. (1993). Literacy of 90 million is deficient. Washington Post, September 8, A1, A15. Joreskog, K.G., and Goldberger, A.S. (1975). Estimation of a model with multiple indicators and multiple causes of a single latent variable. Journal of the American Statistical Association, 70, 631-639. Kane, M. (1993). Comments on the NAE evaluation of NAGB achievement levels. Washington, DC: National Assessment Governing Board. Kane, M.T. (1995). Examinee-centered vs. task-centered standard setting. In Proceedings of joint conference on standard setting in large-scale assessments (pp. 119-139). Washington, DC: National Assessment Governing Board and U.S. Department of Education, National Center for Education Statistics. Kane, M.T. (2001). So much remains the same: Conception and status of validation in setting standards. In G.J. Cizek (Ed.), Setting performance standards: Concepts, methods, and perspectives. Mahwah, NJ: Lawrence Erlbaum. Kaplan, D.A. (1993). Dumber than we thought: Literacy: A new study shows why we can’t cope with everyday life. Newsweek, 122, 44-45. Kingston, N.M., Kahl, S.R., Sweeney, K.P., and Bay, L. (2001). Setting performance standards using the body of work method. In G.J. Cizek (Ed.), Setting performance standards: Concepts, methods and perspectives (Chapter 8). Mahwah, NJ: Lawrence Erlbaum.

OCR for page 196
Measuring Literacy: Performance Levels for Adults Kirsch, I.S. (2002). Literacy standards must not be lowered. Available: http://www.ets.org/search97cgi/s97_cgi [accessed 2003.] Kirsch, I.S., Jungeblut, A., Jenkins, L., and Kolstad, A. (1993). Adult literacy in America: A first look at the results of the national adult literacy survey. Princeton, NJ: Educational Testing Service. Kirsch, I.S., Jungeblut, A., and Mosenthal, P.B. (2001). Interpreting the adult literacy scales and literacy levels. Chapter 13 in Technical report and data file user’s manual for the 1992 national adult literacy survey. (NCES No. 2001-457). Washington, DC: U.S. Department of Education, National Center for Education Statistics. Kirsch, I., Yamamoto, K., Norris, N., Rock, D., Jungeblut, A., O’Reilly, P., Berlin, M., Mohandjer, L., Waksberg, J., Goksel, H., Burke, J., Rieger, S., Green, J., Klein, M., Campbell, A., Jenkins, L., Kolstad, A., Mosenthal, P., and Baldi, S. (2001). Technical report and data file user’s manual for the 1992 national adult literacy survey. (NCES No. 2001-457.) Washington, DC: U.S. Department of Education, National Center for Education Statistics. Langley, P.S. (1999). Corrections education: A learning profiles special report. Salt Lake City: Utah State Office of Education. Available: http://64.233.161.104/search?q=cache:K8oNSl03sgEJ:literacynet.org/ll/issue8/columnist2.html+Corrections+education,+Langley&hl=en&start=1 [accessed June 2005]. Lawrence, S., Mears, D., Dubin, G., and Travis, J. (2002). The practice and promise of prison programming. Washington, DC: Urban Institute, Justice Policy Center. Lewis, D.M., Green, D.R., Mitzel, H.C., Baum, K., and Patz, R.J. (1998). The bookmark standard setting procedure: Methodology and recent implementations. Paper presented at the National Council for Measurement in Education annual meeting, San Diego, CA. Mathews, J. (2001). Adult illiteracy, rewritten: Director revises widely quoted 1993 study that said 1 in 5 couldn’t read; analysis called overly pessimistic. Washington Post, July 17. Mehrens, W.A. (1995). Methodological issues in standard setting for educational exams. In Proceedings of the joint conference on standard setting for large-scale assessments (p. 221-263). Washington, DC: National Assessment Governing Board and National Center for Education Statistics. Mitzel, H.C., Lewis, D.M., Patz, R.J., and Green, D.R. (2001). The bookmark procedure: Psychological perspectives. Chapter 9 in G.J. Cizek (Ed.), Setting performance standards: Concepts, methods and perspectives. Mahwah, NJ: Lawrence Erlbaum. Mullins, M., and Green, D. (1994). In search of truth and the perfect standard-setting method: Is the Angoff procedure the best available for credentialing. Clear Exam Review, winter, 21-24. Murnane, R.J., Willett, J.B., and Levy, F. 91995). The growing importance of cognitive skills in wage determination. The Review of Economics and Statistics, 77(2), 251-266. Murray, T.S. (2003). The assessment of literacy, numeracy, and language at the international level: A review. Paper prepared for the Committee on Performance Levels for Adult Literacy, National Research Council. National Assessment Governing Board, U.S. Department of Education. (1998). Civics framework for the 1998 national assessment of educational progress. Washington, DC: Author. Available: http://www.nagb.org/pubs/civics.pdf [accessed December 2004]. National Center for Education Statistics. (2003). Digest of education statistics, 2003. Available: http://nces.ed.gov/programs/digest/d03/index.asp [accessed February 25, 2005]. National Institute for Literacy. (2002). Correctional education facts. Washington, DC: Author. National Reporting System. (2002). 6 levels of ABE or ESL. Available: http://www.oeitech.com/nrs/. [accessed September 2005].

OCR for page 196
Measuring Literacy: Performance Levels for Adults National Research Council. (1999). Grading the nation’s report card: Evaluating NAEP and transforming the assessment of educational progress. J.W. Pellegrino, L.R. Jones, and K.J. Mitchell (Eds.), Committee on the Evaluation of National Assessments of Educational Progress. Commission on Behavioral and Social Sciences and Education. Washington, DC: National Academy Press. Plake, B.S., Melican, G.S., and Mills, C.N. (1991). Factors influencing intrajudge consistency during standard-setting. Educational Measurement: Issues and Practice, 10(2), 15-16. Ratzan, S.C., and Parker, R.M. (2000). Introduction. In C.R. Selden, M. Zorn, S.C. Ratzan, and R.M. Parker (Eds.), National library of medicine, current bibliographies in medicine: Health literacy. (NLM No. CBM 2000-1.) Bethesda, MD: National Institutes of Health, U.S. Department of Health and Human Services. Raymond, M.R., and Reid, J.B. (2001). Who made thee a judge? Selecting and training participants for standard setting. In G.J. Cizek (Ed.), Setting performance standards: Concepts, methods, and perspectives. Mahwah, NJ: Lawrence Erlbaum. Reder, S. (1998a). Dimensionality and construct validity of the NALS assessment. In M.C. Smith, (Ed.), Literacy for the twenty-first century: Research, policy, practices and the national adult literacy survey (pp. 37-57). Westport, CT: Praeger. Reder, S. (1998b). Literacy selection and literacy development: Structural equation models of the reciprocal effects of education and literacy. In M.C. Smith (Ed.), Literacy for the twenty-first century: Research, policy, practices and the national adult literacy survey (pp. 37-57). Westport, CT: Praeger. Reid, J.B. (1991). Training judges to generate standard-setting data. Educational Measurement: Issues and Practice, 10(2), 11-14. Rock, D.A., Latham, A., and Jeanneret, P.R. (1996). Estimating prose, document, and quantitative literacy scores from position analysis questionnaire dimensions: An empirical linkage between adult literary skills and job analysis information. Princeton, NJ: Educational Testing Service. Rock, D.A., and Yamamoto, K. (1994). Construct validity of the adult literacy subscales. Princeton, NJ: Educational Testing Service. Rudd, R.E., Kirsch, I., and Yamamoto, K. (2004). Literacy and health in America. (Global Assessment Policy Report.) Princeton, NJ: Educational Testing Service. Rudd, R.E., Moeykens, B.A., and Colton, T.C. (2000). Health and literacy: A review of medical and public health literature. In J. Comings, B. Garner, and C. Smith (Eds.), Annual review of adult learning and literacy (vol. 1, pp. 158-199). San Francisco: Jossey-Bass. Shepard, L.A. (1980). Standard setting issues and methods. Applied Psychological Measurement, 4, 447-467. Shepard, L.A. (1983). Setting performance standards. In R.A. Berk (Ed.), Criterion-referenced measurement: The state of the art (pp. 169-198). Berkeley, CA: McCutchan. Shepard, L.A. (1984). Setting performance standards. In R.A. Berk (Ed.), A guide to criterion-referenced test construction (pp. 169-198). Baltimore: Johns Hopkins University Press. Shepard, L.A., Glaser, R., Linn, R.L., and Bohrnstedt, G. (1993). Setting performances standards for student achievement. A report of the National Academy of Education panel on the evaluation of the NAEP trial state assessment: An evaluation of the 1992 achievement levels. Stanford, CA: Stanford University, National Academy of Education. Smith, M.C. (2003). The national adult literacy survey: A review of primary and secondary analyses of the NALS. Paper prepared for the Committee on Performance Levels for Adult Literacy, December, National Research Council, Washington, DC. Sticht, T., (Ed.) (1975). Reading for working: A functional literacy anthology. Alexandria, VA: Human Resources Research Organization.

OCR for page 196
Measuring Literacy: Performance Levels for Adults Sticht, T. (2004). Is illiteracy rampant in Los Angeles county? Los Angeles Times, September 11. Available: http://www.latimes.com/search/dispatcher.front?Query=adult=literacyandtarget=article. [accessed September 12, 2004]. Stites, R. (2000). How much literacy is enough? Issues in defining and reporting performance standards for the national assessment of adult literacy. (No. 2000-07.) Washington, DC: U.S. Department of Education, National Center for Education Statistics. Sum, A. (1999) Literacy in the labor force: Results from the national adult literacy survey. Washington, DC: U.S. Department of Education, National Center for Education Statistics. Thissen, D., and Wainer, H. (1982). Some standard errors in item response theory. Psychometrika, 47, 397-412. Thissen, D., and Wainer, H. (1990). Confidence envelopes for item response theory. Journal of Educational Statistics, 15, 113-128. Tversky, A., and Kahneman, D. (1983). Extensional versus intuitive reasoning: The conjunction fallacy in probability judgment. Psychological Review, 90(4), 293-315. U.S. Department of Education, National Center for Education Statistics. (1998). Developing the national assessment of adult literacy: Recommendations from stakeholders. (Working Paper No. 98-17.) Washington, DC: Author. U.S. Department of Health and Human Services, Office of Disease Prevention and Health Promotion. (2003). Communicating health: Priorities and strategies for progress, Action plan to achieve the health communication objectives in healthy people 2010. Washington, DC: Author. U.S. Department of Justice, Office of Justice Programs. (2003). Education and correctional populations. (Special Report, NCJ No. 195670.) Washington, DC: Bureau of Justice Statistics. Venezky, R., and Kaplan, D. (1998). Literacy habits and political participation. In M.C. Smith (Ed.), Literacy for the twenty-first century: Research, policy, practices and the national adult literacy survey (pp. 109-124). Westport, CT: Praeger. Venezky, R., Kaplan, D., and Yu, F. (1998). Literacy practices and voting behavior: An analysis of the 1992 national adult literacy survey. Washington, DC: U.S. Department of Education, National Center for Education Statistics. Verba, S., Lehman Schlozman, K., and Brady, H.E. (1995). Voice and equality: Civic voluntarism in American politics. Cambridge, MA: Harvard University Press. Wagner, D.A. (2004). Literacy(ies), culture(s), and development(s): The ethnographic challenge. (A five-volume review.) Reading Research Quarterly, 39(2), 234-241. Wedgeworth, R. (2003). The number of functionally illiterate adults in the United States is growing: 2003 national assessment of adult literacy likely to show more adults lacking basic reading and writing skills. Available: http://www.proliteracy.org/downloads/ProLiteracyStateOfLiteracy%2010-25-04.pdf. [accessed February 25, 2005]. Western, B., and Pettit, B. (2000). Incarceration and racial inequality in men’s employment. Industrial and Labor Relations Review, 54, 3-16. Williams, N.J., and Schulz, E.M. (2005). An investigation of response probability (rp) values used in standard setting. Paper presented at the annual meeting of the National Council on Measurement in Education, April, Montreal. Zieky, M.J. (2001). So much has changed: How the setting of cutscores has evolved since the 1980s. In G.J. Cizek (Ed.), Setting performance standards: Concepts, methods, and perspectives. Mahwah, NJ: Lawrence Erlbaum.

OCR for page 196
Measuring Literacy: Performance Levels for Adults This page intentionally left blank.