APPENDIX A

Workshop on District-Level Reporting for NAEP Agenda and Participants

Thursday – September 16 Georgetown Suites Hotel

 

10:00 - 10:15

Welcome and Introductions

Pat DeVito, Chair

10:15 - 12:15

Panel 1: What purposes would be served by district-level reporting of NAEP?

Facilitators: LeAnn Gamache and Doug Herrmann

 

Topics:

  1. What information needs might be served?

  2. Who would use the results?

  3. How would they be used?

  4. What are the issues that should be considered?

  5. What are the advantages and disadvantages?



The National Academies | 500 Fifth St. N.W. | Washington, D.C. 20001
Copyright © National Academy of Sciences. All rights reserved.
Terms of Use and Privacy Statement



Below are the first 10 and last 10 pages of uncorrected machine-read text (when available) of this chapter, followed by the top 30 algorithmically extracted key phrases from the chapter as a whole.
Intended to provide our own search engines and external engines with highly rich, chapter-representative searchable text on the opening pages of each chapter. Because it is UNCORRECTED material, please consider the following text as a useful but insufficient proxy for the authoritative book pages.

Do not use for reproduction, copying, pasting, or reading; exclusively for search engines.

OCR for page 45
REPORTING DISTRICT-LEVEL NAEP DATA: SUMMARY OF A WORKSHOP APPENDIX A Workshop on District-Level Reporting for NAEP Agenda and Participants Thursday – September 16 Georgetown Suites Hotel   10:00 - 10:15 Welcome and Introductions Pat DeVito, Chair 10:15 - 12:15 Panel 1: What purposes would be served by district-level reporting of NAEP? Facilitators: LeAnn Gamache and Doug Herrmann   Topics: What information needs might be served? Who would use the results? How would they be used? What are the issues that should be considered? What are the advantages and disadvantages?

OCR for page 45
REPORTING DISTRICT-LEVEL NAEP DATA: SUMMARY OF A WORKSHOP   SPEAKERS Wayne Martin, Council of Chief State School Officers Sharon Lewis, Council of Greater City Schools Ed Roeber, Advanced Systems in Measurement and Evaluationa Albert Beaton, Boston Collegea REACTORS Susan Agruso, South Carolinab Judy Costa, Clark County, Nevada 12:15- 1:15 Lunch 1:15 - 3:15 Panel 2: What are the implications of district-level reporting for state/local policy, instruction, and assessment? Facilitators: Melody Carswell and Lou Fabriziob   Topics: What lessons did states learn from the introduction of state NAEP that help us think about the likely impact of district-level NAEP? What have been the impacts on: - state testing/education policies, - state testing programs, - school curricula, - schools, teachers, children What types of comparisons are being made? How do the comparisons affect interpretations of state/ local testing results? What happens when NAEP results and state/local assessment results differ? SPEAKERS Don Watson, Colorado Bob Silverman, Washingtona Peter Behuniak, Connecticut Susan Agruso, South Carolinab REACTOR Steve Dunbar, University of Iowa

OCR for page 45
REPORTING DISTRICT-LEVEL NAEP DATA: SUMMARY OF A WORKSHOP 3:15 – 3:30 Break 3:30 Closed meeting for committee members Friday – September 17, NAS, Foundry, Room 2004   8:30 - 9:00 Continental breakfast 9:00 – 2:00 Welcome and Introductions Pat DeVito, Chair Panel 3: To what extent are states and districts interested in district-level reporting? What factors influence their interest?   Topics: What information might district-level reporting provide to you? What information might it provide that is not available from other sources? How might district-level reports be used? What, if any, decisions might be based on reported results? What are the implications of district-level reporting for your state and/or local assessment programs? What lessons from past forays/experiences, if any, with district level reporting of NAEP apply to current context? What factors would influence your interest in future participation in district-level NAEP? (costs, testing burden, reporting schedule, type of reports, possible score uses) Should states and/or districts make decisions about participation in district NAEP? Who should receive the scores? Who should make decisions about score release?

OCR for page 45
REPORTING DISTRICT-LEVEL NAEP DATA: SUMMARY OF A WORKSHOP 9:00 – 10:45 Naturally Occurring Districts Facilitators: Pat DeVito, Maryellen Donahue PANEL 3A: SPEAKERS Carol Perlman, Chicago Carmen Chapman, Illinoisa PANEL 3B: SPEAKERS Judy Costa, Clark County, Nevada Tom McIntosh, Nevada PANEL 3C: SPEAKERS Robert Tobias, New York Cityb Gerald DeMauro, New Yorka 10:45 - 11:00 Break 11:00 – 12:00 Other Interested Districts Facilitators: Linda Bryant and Lou Fabriziob PANEL 3D: SPEAKERS Paul Cieslak, Milwaukeec Nancy Amuleru-Marshall, Atlantaa Harry Selig, Houston Independent School District Paula Mosley, Los Angeles Unified School District Mitchell Chester, Philadelphia 12:00 - 1:00 Lunch 1:00 – 2:00 PANEL 3D, CONTINUED 2:00 - 3:30 Panel 4: Technical and Policy Issues Facilitators: Audrey Qualls and Duane Steffey   Topics: Issues related to sampling and administration Issues related to reporting of scores and conditioning Issues related to policy

OCR for page 45
REPORTING DISTRICT-LEVEL NAEP DATA: SUMMARY OF A WORKSHOP - What constitutes a district? - Who makes participation decisions? - Who “owns” the data? - Who gets to see and use the data? PANELISTS Rick Vallient, Westat Nancy Allen, ETSa Peggy Carr, NCES Roy Truby, NAGB REACTOR Lauress Wise, HumRRO 3:30 Adjourn PARTICIPANTS Nancy Allen,a Director, NAEP Analysis and Research, Educational Testing Service Nancy Amuleru-Marshall,a Executive Director, Research and Assessment, Atlanta Public Schools Al Beaton,a Professor, Educational Evaluation, School of Education, Boston College Peter Behuniak, Director of Student Assessment and Testing, Connecticut State Department of Education Peggy Carr, Associate Commissioner, Assessment Division, National Center for Education Statistics, U.S. Department of Education Carmen Chapman,a Administrator, Division of Assessment, Illinois State Department of Education Mitchell Chester, Executive Director, Office of Accountability and Assessment, School District of Philadelphia Paul Cieslak,c Research Specialist, Milwaukee Public Schools Judy Costa, Testing Director, Clark County School District, Las Vegas, NV

OCR for page 45
REPORTING DISTRICT-LEVEL NAEP DATA: SUMMARY OF A WORKSHOP Gerald DeMauro,a Coordinator of Assessment, Office of State Assessment, Albany, NY Steve Dunbar, Professor of Educational Measurement and Statistics, College of Education, The University of Iowa Sharon Lewis, Director of Research, Council of the Great City Schools Wayne Martin, Director, State Education Assessment Center, Council of Chief State School Officers Thomas McIntosh, Team Leader, Nevada Department of Education Paula Mosley, Coordinator, Student Testing and Evaluation, Office of Instruction, Los Angeles, CA Carole L. Perlman, Director of Student Assessment, Chicago Public Schools Edward Roeber,a Vice President of External Relations, Advanced Systems in Measurement and Evaluation, Dover, NH Harry Selig, Research Manager, Research and Accountability Department, Houston Independent School District, Houston, TX Robert Silverman,a Senior Analyst for Assessment, Olympia, WA Roy Truby, Executive Director, National Assessment Governing Board Richard Valliant, Associate Director, Statistical Group, WESTAT Don Watson, Acting Director, Student Assessment, Colorado Department of Education Lauress L. Wise, President, Human Resources Research Organization Hurricane Floyd interfered with participants’ travel plans: aParticipated via speaker phone for a portion of the meeting bUnable to attend cProvided written comments but did not participate