National Academies Press: OpenBook

Reporting District-Level NAEP Data: Summary of a Workshop (2000)

Chapter: Appendix B: Background Information on NAEP

« Previous: Appendix A: Workshop on District-Level Reporting for NAEP Agenda and Participants
Suggested Citation:"Appendix B: Background Information on NAEP." National Research Council. 2000. Reporting District-Level NAEP Data: Summary of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/9768.
×

APPENDIX B

Background Information on NAEP

The National Assessment of Educational Progress (NAEP) has been assessing students across the country since 1969, providing valuable information about students’ performance in various content domains. Results of the national assessment, frequently called “the nation’s report card,” were presented annually from 1969 to 1979. Since 1980, national NAEP has been administered every two years, with the implementation of a state-level NAEP system in 1990.

PURPOSES

Since its beginning, NAEP has served as a barometer of student academic performance across the country. It provides data on trends in the academic performance of elementary, middle, and secondary students in key subject areas and has proven to be a unique source of background information that has both informed and guided educational policy. NAEP results have the credence and power to inform and guide educational policy largely due to the integrity with which NAEP is viewed. The results are used to (National Research Council 1999a: 27):

  • describe the status of the education system,

  • describe the performance of students in different demographic groups,

Suggested Citation:"Appendix B: Background Information on NAEP." National Research Council. 2000. Reporting District-Level NAEP Data: Summary of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/9768.
×
  • identify the knowledge and skills over which students have (or do not have) mastery,

  • support judgments about the adequacy of observed performance,

  • argue the success or failure of instructional content and strategies,

  • discuss relationships among achievement and school and family variables,

  • reinforce the call for high academic standards and education reform, and

  • argue for system and school accountability.

NAEP is considered by education stakeholders at various local, state, and national levels to be the national benchmark1 of both content and performance standards and to provide valuable information for national and state comparisons. For each of the content areas, NAGB has developed an organizing framework. The NAEP frameworks —derived from a national consensus process that includes educators, policy makers, practitioners, and scholars in the respective fields —denote the broadly accepted content standards that students in fourth, eighth, and twelfth grades should seek to attain. The released items give examples of the kind of questions and level of content knowledge assessed at each grade.

INDICATORS OF ACHIEVEMENT

NAEP assesses a vast array of content areas. Due to the many content areas and the need to limit the length of the testing time, a matrix sampling design is used to obtain a representative sample of students taking each subject-area assessment. Under this design, blocks of items within each content domain are administered to groups of students, making it possible to administer a large number and range of items during a relatively brief testing period. Consequently, each student takes only a few items in a content domain. As a result, the performance of any particular student cannot be accurately measured, preventing achievement scores for individual students from being available. NAEP, thus, reports only group-level results.

NAEP subject-matter achievement is reported through scale scores.

1  

“Benchmarking” means measuring one’s own practices against those of others, and, in this context, refers to the practice of comparing local or state-level test results against those derived from national indicators.

Suggested Citation:"Appendix B: Background Information on NAEP." National Research Council. 2000. Reporting District-Level NAEP Data: Summary of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/9768.
×

Scale scores summarize student performance (on a scale of 0-500) in a given subject area for the nation as a whole and for subsets of the population based on demographic and background characteristics. Results are tabulated over time to provide trend information.

Academic achievement is also summarized using performance standards, or achievement levels. NAGB has established policy definitions for three levels of student achievement—basic, proficient, and advanced (U.S. Department of Education, 1997). The achievement levels denote the range of performance established for each grade and describe the levels of knowledge demonstrated by students:

Basic: partial mastery of prerequisite knowledge and skills that are fundamental for proficient work at each grade.

Proficient: solid academic performance for each grade assessed. Students reaching this level have demonstrated competency over challenging subject matter, including subject-matter knowledge, application of such knowledge to real-world situations, and analytical skills appropriate to the subject matter.

Advanced: superior performance.

There is also a fourth level of student achievement, “below-basic,” for which no description is provided.

BACKGROUND, CONTEXTUAL, AND ENVIRONMENTAL INFORMATION

NAEP collects a variety of demographic, background, and contextual information on students, teachers, and administrators. Student demographic information, such as race/ethnicity, gender, and highest level of parental education, are available. As stated above, NAEP summarizes results by certain demographic and educational characteristics.

Contextual and environmental data collected during NAEP administrations provides information in such areas as students’ course selection, homework habits, use of textbooks and computers, and communication with parents about schoolwork. Information obtained about teachers pertains to such areas as the kind of training, number of years teaching, and instructional practices. Administrators also respond to questions about their schools, including the location and type of school, school enrollment numbers, and levels of parental involvement.

Suggested Citation:"Appendix B: Background Information on NAEP." National Research Council. 2000. Reporting District-Level NAEP Data: Summary of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/9768.
×
Page 51
Suggested Citation:"Appendix B: Background Information on NAEP." National Research Council. 2000. Reporting District-Level NAEP Data: Summary of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/9768.
×
Page 52
Suggested Citation:"Appendix B: Background Information on NAEP." National Research Council. 2000. Reporting District-Level NAEP Data: Summary of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/9768.
×
Page 53
Reporting District-Level NAEP Data: Summary of a Workshop Get This Book
×
Buy Paperback | $29.00 Buy Ebook | $23.99
MyNAP members save 10% online.
Login or Register to save!
Download Free PDF

The National Assessment of Education Progress (NAEP) has earned a reputation as one of the nation's best measures of student achievement in key subject areas. Since its inception in 1969, NAEP has summarized academic performance for the nation as a whole and, beginning in 1990, for the individual states. Increasingly, NAEP results get the attention of the press, the public, and policy makers. With this increasing prominence have come calls for reporting NAEP results below the national and state levels. Some education leaders argue that NAEP can provide important and useful information to local educators and policy makers. They want NAEP to serve as a district-level indicator of educational progress and call for NAEP results to be summarized at the school district level.

Reporting District-Level NAEP Data explores with various stakeholders their interest in and perceptions regarding the likely impacts of district level reporting.

  1. ×

    Welcome to OpenBook!

    You're looking at OpenBook, NAP.edu's online reading room since 1999. Based on feedback from you, our users, we've made some improvements that make it easier than ever to read thousands of publications on our website.

    Do you want to take a quick tour of the OpenBook's features?

    No Thanks Take a Tour »
  2. ×

    Show this book's table of contents, where you can jump to any chapter by name.

    « Back Next »
  3. ×

    ...or use these buttons to go back to the previous chapter or skip to the next one.

    « Back Next »
  4. ×

    Jump up to the previous page or down to the next one. Also, you can type in a page number and press Enter to go directly to that page in the book.

    « Back Next »
  5. ×

    Switch between the Original Pages, where you can read the report as it appeared in print, and Text Pages for the web version, where you can highlight and search the text.

    « Back Next »
  6. ×

    To search the entire text of this book, type in your search term here and press Enter.

    « Back Next »
  7. ×

    Share a link to this book page on your preferred social network or via email.

    « Back Next »
  8. ×

    View our suggested citation for this chapter.

    « Back Next »
  9. ×

    Ready to take your reading offline? Click here to buy this book in print or download it as a free PDF, if available.

    « Back Next »
Stay Connected!