| ||||||||||||||||||||||||||||||||||||||||
|
||||||||||||||||||||||||||||||||||||||||
Below are the first 10 and last 10 pages of uncorrected machine-read text (when available) of this chapter, followed by the top 30 algorithmically extracted key phrases from the chapter as a whole.
Intended to provide our own search engines and external engines with highly rich, chapter-representative searchable text on the opening pages of each chapter.
Because it is UNCORRECTED material, please consider the following text as a useful but insufficient proxy for the authoritative book pages.
Do not use for reproduction, copying, pasting, or reading; exclusively for search engines.
OCR for page 45
REPORTING DISTRICT-LEVEL NAEP DATA: SUMMARY OF A WORKSHOP
APPENDIX A
Workshop on District-Level Reporting for NAEP Agenda and Participants
Thursday – September 16 Georgetown Suites Hotel
10:00 - 10:15
Welcome and Introductions
Pat DeVito, Chair
10:15 - 12:15
Panel 1: What purposes would be served by district-level reporting of NAEP?
Facilitators: LeAnn Gamache and Doug Herrmann
Topics:
What information needs might be served?
Who would use the results?
How would they be used?
What are the issues that should be considered?
What are the advantages and disadvantages?
OCR for page 46
REPORTING DISTRICT-LEVEL NAEP DATA: SUMMARY OF A WORKSHOP
SPEAKERS
Wayne Martin, Council of Chief State School Officers
Sharon Lewis, Council of Greater City Schools
Ed Roeber, Advanced Systems in Measurement and Evaluationa
Albert Beaton, Boston Collegea
REACTORS
Susan Agruso, South Carolinab
Judy Costa, Clark County, Nevada
12:15- 1:15
Lunch
1:15 - 3:15
Panel 2: What are the implications of district-level reporting for state/local policy, instruction, and assessment?
Facilitators: Melody Carswell and Lou Fabriziob
Topics:
What lessons did states learn from the introduction of state NAEP that help us think about the likely impact of district-level NAEP?
What have been the impacts on:
- state testing/education policies,
- state testing programs,
- school curricula,
- schools, teachers, children
What types of comparisons are being made?
How do the comparisons affect interpretations of state/ local testing results?
What happens when NAEP results and state/local assessment results differ?
SPEAKERS
Don Watson, Colorado
Bob Silverman, Washingtona
Peter Behuniak, Connecticut
Susan Agruso, South Carolinab
REACTOR
Steve Dunbar, University of Iowa
OCR for page 47
REPORTING DISTRICT-LEVEL NAEP DATA: SUMMARY OF A WORKSHOP
3:15 – 3:30
Break
3:30
Closed meeting for committee members
Friday – September 17, NAS, Foundry, Room 2004
8:30 - 9:00
Continental breakfast
9:00 – 2:00
Welcome and Introductions
Pat DeVito, Chair
Panel 3: To what extent are states and districts interested in district-level reporting? What factors influence their interest?
Topics:
What information might district-level reporting provide to you? What information might it provide that is not available from other sources?
How might district-level reports be used? What, if any, decisions might be based on reported results?
What are the implications of district-level reporting for your state and/or local assessment programs?
What lessons from past forays/experiences, if any, with district level reporting of NAEP apply to current context?
What factors would influence your interest in future participation in district-level NAEP? (costs, testing burden, reporting schedule, type of reports, possible score uses)
Should states and/or districts make decisions about participation in district NAEP?
Who should receive the scores? Who should make decisions about score release?
OCR for page 48
REPORTING DISTRICT-LEVEL NAEP DATA: SUMMARY OF A WORKSHOP
9:00 – 10:45
Naturally Occurring Districts
Facilitators: Pat DeVito, Maryellen Donahue
PANEL 3A: SPEAKERS
Carol Perlman, Chicago
Carmen Chapman, Illinoisa
PANEL 3B: SPEAKERS
Judy Costa, Clark County, Nevada
Tom McIntosh, Nevada
PANEL 3C: SPEAKERS
Robert Tobias, New York Cityb
Gerald DeMauro, New Yorka
10:45 - 11:00
Break
11:00 – 12:00
Other Interested Districts
Facilitators: Linda Bryant and Lou Fabriziob
PANEL 3D: SPEAKERS
Paul Cieslak, Milwaukeec
Nancy Amuleru-Marshall, Atlantaa
Harry Selig, Houston Independent School District
Paula Mosley, Los Angeles Unified School District
Mitchell Chester, Philadelphia
12:00 - 1:00
Lunch
1:00 – 2:00
PANEL 3D, CONTINUED
2:00 - 3:30
Panel 4: Technical and Policy Issues
Facilitators: Audrey Qualls and Duane Steffey
Topics:
Issues related to sampling and administration
Issues related to reporting of scores and conditioning
Issues related to policy
OCR for page 49
REPORTING DISTRICT-LEVEL NAEP DATA: SUMMARY OF A WORKSHOP
- What constitutes a district?
- Who makes participation decisions?
- Who “owns” the data?
- Who gets to see and use the data?
PANELISTS
Rick Vallient, Westat
Nancy Allen, ETSa
Peggy Carr, NCES
Roy Truby, NAGB
REACTOR
Lauress Wise, HumRRO
3:30
Adjourn
PARTICIPANTS
Nancy Allen,a Director, NAEP Analysis and Research, Educational Testing Service
Nancy Amuleru-Marshall,a Executive Director, Research and Assessment, Atlanta Public Schools
Al Beaton,a Professor, Educational Evaluation, School of Education, Boston College
Peter Behuniak, Director of Student Assessment and Testing, Connecticut State Department of Education
Peggy Carr, Associate Commissioner, Assessment Division, National Center for Education Statistics, U.S. Department of Education
Carmen Chapman,a Administrator, Division of Assessment, Illinois State Department of Education
Mitchell Chester, Executive Director, Office of Accountability and Assessment, School District of Philadelphia
Paul Cieslak,c Research Specialist, Milwaukee Public Schools
Judy Costa, Testing Director, Clark County School District, Las Vegas, NV
OCR for page 50
REPORTING DISTRICT-LEVEL NAEP DATA: SUMMARY OF A WORKSHOP
Gerald DeMauro,a Coordinator of Assessment, Office of State Assessment, Albany, NY
Steve Dunbar, Professor of Educational Measurement and Statistics, College of Education, The University of Iowa
Sharon Lewis, Director of Research, Council of the Great City Schools
Wayne Martin, Director, State Education Assessment Center, Council of Chief State School Officers
Thomas McIntosh, Team Leader, Nevada Department of Education
Paula Mosley, Coordinator, Student Testing and Evaluation, Office of Instruction, Los Angeles, CA
Carole L. Perlman, Director of Student Assessment, Chicago Public Schools
Edward Roeber,a Vice President of External Relations, Advanced Systems in Measurement and Evaluation, Dover, NH
Harry Selig, Research Manager, Research and Accountability Department, Houston Independent School District, Houston, TX
Robert Silverman,a Senior Analyst for Assessment, Olympia, WA
Roy Truby, Executive Director, National Assessment Governing Board
Richard Valliant, Associate Director, Statistical Group, WESTAT
Don Watson, Acting Director, Student Assessment, Colorado Department of Education
Lauress L. Wise, President, Human Resources Research Organization
Hurricane Floyd interfered with participants’ travel plans:
aParticipated via speaker phone for a portion of the meeting
bUnable to attend
cProvided written comments but did not participate
Representative terms from entire chapter:
student assessment
