Resources for Teaching Elementary School Science--Appendix B

APPENDIX B: NSRC Evaluation Criteria for Curriculum Materials

Consistent with the National Science Resources Center's (NSRC's) philosophy of science teaching and with the recently published National Science Education Standards of the National Research Council, the materials included in Resources for Teaching Elementary School Science are hands-on and inquiry-centered. Briefly described, such materials provide opportunities for children to learn through direct observation and experimentation; they engage students in experiences not simply to confirm the "right" answer but to investigate the nature of things and to arrive at explanations that are scientifically correct and satisfying to children; and they offer students opportunities to experiment productively, to ask questions and find their own answers, and to develop patience, persistence, and confidence in their ability to tackie and solve real problems.

To produce evaluation criteria for identifying the most effective print instructional materials available, the NSRC drew upon three primary sources:

the experience of teachers, superintendents, principals, and science curriculum coordinators across the United States;

the quality standards identified by the NSRC for evaluating units of science instruction in its ongoing review of science curriculum materials under the auspices of the National Academy of Sciences and the Smithsonian Institution; and

the National Science Education Standards, which were under development at the same time as this resource guide.

The evaluation criteria that NSRC developed were applied in the structured review process of curriculum materials for this guide. These criteria consist of two sets of questions. The first focuses on pedagogical issues, the second on science issues.

The pedagogical criteria elaborate on the following key questions: (1) Do the materials address the important goals of elementary science teaching and learning? (2) Are inquiry and activity the basis of the learning experiences? (3) Are the topic of the unit and the modes of instruction developmentally appropriate? Additional issues related to presentation and format and to hands-on science materials are then considered.

The set of criteria on science issues expands upon the key questions of whether the science content is accurate, up to date, and effectively presented. It then focuses on aspects of the way science is presented in the materials—for example, whether the writing style is interesting and engaging while respecting scientific language.

Two major considerations should be kept in mind when one is using this document:

The NSRC evaluation criteria provide two gauges for assessing curriculum materials: first, they enunciate specific goals and, second, taken as a whole, they represent the overall level of quality necessary for materials to be effective. Therefore, while materials may not meet each individual criterion completely, they can still reach the overall level of effectiveness defined in the evaluation instrument. That is, if they offer hands-on, inquiry-centered, pedagogically and scientifically sound learning experiences, they may be considered effective even though they do not meet each specific criterion within these categories. The NSRC evaluation criteria were designed as a standard to be met, as the ideal level of quality to be sought, and as a working tool that can help inform science curriculum as it is developed.
The expectations for core materials are more comprehensive than for supplementary materials. For example, core materials would be expected to provide assessment strategies, whereas science activity books would not. Likewise, core materials would allow students to study a concept in depth, while supplementary materials might provide only a general introduction or isolated activities.

The NSRC evaluation criteria are reprinted in full in this appendix. Teachers, curriculum specialists, curriculum developers, principals, superintendents, and those involved in various aspects of science education reform may find the criteria not only instructive, but useful as an actual review instrument when the need arises to consider the strengths and weaknesses of particular curriculum materials.

NATIONAL SCIENCE RESOURCES CENTER
SMITHSONIAN INSTITUTION • NATIONAL ACADEMY OF SCIENCES
Resources for Teaching Elementary School Science

SCIENCE INSTRUCTIONAL MATERIALS REVIEW FORM

TITLE: or name of resource

SERIES TITLE: if applicable

AUTHOR(S): if applicable

CITY/STATE: where published

PUBLISHER/SOURCE:

COPYRIGHT DATE: ISBN NO: ADVERTISED GRADE LEVEL(S): grade(s)

SUPPLIES: availability of materials and kits for core curriculum materials

COST: suggested list price

RESOURCE TYPE: student activity book, teacher's guide, books on teaching science, etc.

SUBJECT: selected from major content categories

Please Supply the following information:

REVIEWER:_____________________________________
(reviewer's name)

DATE:_____________________________________
(date of review)

RECOMMENDED USER:

(check each that applies) _____stu _____tchr _____adm _____other (__________)

GRADE LEVEL(S) RECOMMENDED BY REVIEWER IF DIFFERENT FROM THE ADVERTISED LEVEL(S) STATED ABOVE:

(Please circle the specific grade level(s) for which you believe these materials are most appropriate.)

Reviewer:____________________________________

PEDAGOGY

Instructions: The following questions are designed to help you identify the important elements of each criterion. Please respond by selecting "yes" if the material meets this goal and "no" if it does not. If "no" is selected, please explain the reason in the space provided below the question. In some instances, the question may not be applicable; then mark "NA."


CRITERIA	RATING
I. ADDRESSING THE GOALS OF ELEMENTARY SCIENCE TEACHING AND LEARNING
Does the material focus on concrete experiences by the children with science phenomena? Reason:	Yes	No	NA
Does the material enable children to investigate important science concept(s) in depth over an extended period of time (core materials only)? Reason:	Yes	No	NA
Does the material contribute to the development of scientific reasoning and problem-solving skills? Reason:	Yes	No	NA
Does the material stimulate student interest and relate to their daily lives? Reason:	Yes	No	NA
Does the material allow for or encourage the development of scientific attitudes and habits of mind, such as curiosity, respect for evidence, flexibility, and sensitivity to living things? Reason:	Yes	No	NA
Are assessment strategies aligned with the goals for instruction? Reason:	Yes	No	NA
Will the suggested assessment strategies provide an effective means of assessing Yes No NA student learning? Reason:	Yes	No	NA

Reviewer: _______________________________________


CRITERIA	RATING
II. FOCUSING ON INQUIRY AND ACTIVITY AS THE BASIS OF LEARNING EXPERIENCES
Does the material engage students in the processes of science? Reason:	Yes	No	NA
Does the material provide opportunities for students to make and record their own observations? Reason:	Yes	No	NA
Does the material provide opportunities for students to gather and defend their own evidence? Reason:	Yes	No	NA
Does the material provide opportunities for students to express their results in a variety of ways? Reason:	Yes	No	NA
Does the material provide opportunities for students to work collaboratively with others? Reason:	Yes	No	NA
Does the material include a balance of student-directed and teacher-facilitated activities? Reason:	Yes	No	NA

Reviewer: _______________________________________


CRITERIA	RATING
III. INSTRUCTIONAL APPROACH
Does the material present a logical sequence of related activities that will help students build conceptual understanding over several lessons? Reason:	Yes	No	NA
Does the suggested instructional sequence take into account children's prior knowledge and experiences? Reason:	Yes	No	NA
Are opportunities included to assess children's prior knowledge and experiences? Reason:	Yes	No	NA
Do the suggested student activities develop critical thinking and problem-solving skills? Reason:	Yes	No	NA
Does the material incorporate effective strategies for the teacher and/or the students to use in assessing student learning? Reason:	Yes	No	NA
Does the material incorporate technological applications of science and the interactions among science, technology and society? Reason:	Yes	No	NA
Do the subject matter and methods of instruction provide suggestions for integrating science with other important learning experiences in the elementary curriculum, such as mathematics, language arts, and social studies? Reason:	Yes	No	NA

Reviewer: _______________________________________

ASSESSMENT OF PEDAGOGICAL APPROPRIATENESS OF MATERIALS

Please provide a brief overview of the concepts taught and the activities suggested in this material. It is not necessary to use complete sentences; words and brief phrases are sufficient.

With the above criteria in mind, please comment on any particular strengths in this material.

With the above criteria in mind, please comment on any particular weaknesses in this material.

After reviewing this material with only the above criteria for pedagogical appropriateness in mind, I would:

_______ recommend this material for inclusion

_______ not recommend this material for inclusion

Reviewer: _______________________________________

PRESENTATION AND FORMAT, MATERIALS, AND EQUITY

Instructions: The following questions are designed to help you identify the important elements of criteria involving presentation and format, materials, and equity issues. Please respond by selecting "yes" if the material meets this goal and "no" if it does not. If "no" is selected, please explain the reason in the space provided below the question. In some instances, the question may not be applicable; then mark "NA."


CRITERIA	RATINGS
PRESENTATION AND FORMAT
Teacher materials: Does the background material for the teacher provide sufficient information on the scientific content? Reason:	Yes	No	NA
Does the background material for the teacher provide sufficient information on common student misconceptions? Reason:	Yes	No	NA
Is the format easy for a teacher to follow? Reason:	Yes	No	NA
Are the directions on implementing activities clear? Reason:	Yes	No	NA
Are the suggestions for instructional delivery adequate? Reason:	Yes	No	NA
Are the suggested times for instruction reasonable? Reason:	Yes	No	NA
Student materials: Are the written materials for the students well-written, age -appropriate, and compelling in content? Reason:	Yes	No	NA

Reviewer: _______________________________________


CRITERIA	RATING
HANDS-ON SCIENCE MATERIALS
Teacher materials: Is a master source list of materials provided? Reason:	Yes	No	NA
Is a list of materials included for each activity? Reason:	Yes	No	NA
Is a complete set of materials readily available at a reasonable cost? Reason:	Yes	No	NA
Are refurbishment materials easily obtained and affordable? Reason:	Yes	No	NA
Student materials: Are the materials recommended for use appropriate for the designated age levels? Reason:	Yes	No	NA
Are appropriate safety precautions included, where needed? Reason:	Yes	No	NA
Are instructions on manipulating laboratory equipment and materials clear and adequate? Reason:	Yes	No	NA
SCIENCE FOR ALL
Is the material free of cultural, racial, ethnic, gender, and age bias? Reason:	Yes	No	NA
Are appropriate strategies included/used to meet the needs of special/diverse populations? Reason:	Yes	No	NA

Reviewer: _______________________________________

ASSESSMENT OF PRESENTATION AND FORMAT,
HANDS-ON SCIENCE MATERIALS, AND EQUITY

With the above criteria in mind, please comment on any particular weaknesses in this material.

After reviewing this material with only the above criteria for presentation and format, hands-on science materials, and equity issues in mind, I would:

_______ recommend this material for inclusion

_______ not recommend this material for inclusion

Reviewer: _______________________________________

RECOMMENDATION

Based upon all aspects of my review of this material,
______	I highly recommend this material for inclusion in Resources for Teaching Elementary School Science.
______	I recommend this material for inclusion in Resources for Teaching Elementary School Science.
______	I recommend this material for inclusion in Resources for Teaching Elementary School Science with reservations.
	Primary reason for reservations: ____________________________________________________________ _____________________________________________________________________________________ _____________________________________________________________________________________

______	I do not recommend this material for inclusion in Resources for Teaching Elementary School Science.
	Primary reason for reservations: ____________________________________________________________ _____________________________________________________________________________________ _____________________________________________________________________________________

Reviewer: _______________________________________

NATIONAL SCIENCE RESOURCES CENTER
SMITHSONIAN INSTITUTION • NATIONAL ACADEMY OF SCIENCES
Resources for Teaching Elementary School Science

The material you are reviewing has already been identified by teacher and science curriculum specialists, in a comprehensive review process, to be pedagogically effective instructional material that would support a "hands-on, constructivist, inquiry based" elementary-school science program. Your task is to review the material (including the background information for teachers) to evaluate the science content for its accuracy and currency, and the effectiveness of its presentation.

Please Supply the following information:

REVIEWER:_____________________________________
(reviewer's name)

DATE:_____________________________________
(date of review)

Reviewer:____________________________________

SCIENCE CONTENT, PRESENTATION, AND EQUITY

Instructions: The following questions are designed to help you identify the important elements of each criterion. Please respond by selecting "yes" if the material meets this goal and "no" if it does not. If "no" is selected, please explain the reason in the space provided below the question. In some instances, the question may not be applicable; then mark "NA."


CRITERIA	RATING
SCIENCE CONTENT
Is the science content incorporated in the materials accurately represented? Reason:	Yes	No	NA
Is the science content consistent with current scientific knowledge? Reason:	Yes	No	NA
Are important ideas included? Reason:	Yes	No	NA
Are generalizations adequately supported by facts? Reason:	Yes	No	NA
Are facts clearly distinguished from theories? Reason:	Yes	No	NA
Do the suggested investigations lead to an understanding of basic principles? Reason:	Yes	No	NA
Do experiments and activities promote student understanding of how scientists come to know what they know and how scientists test and revise their thinking? Reason:	Yes	No	NA

Reviewer: _______________________________________


CRITERIA	RATING
SCIENCE PRESENTATION
Is science shown to be open to inquiry and controversy and free of dogmatism? Reason:	Yes	No	NA
Are different scientific viewpoints presented when appropriate? Reason:	Yes	No	NA
Are personal biases avoided? Reason:	Yes	No	NA
Is the writing style interesting and engaging, while respecting scientific language? Reason:	Yes	No	NA
Is vocabulary used to facilitate understanding rather than as an end in itself? Reason:	Yes	No	NA
Is science represented as an enterprise connected to society? Reason:	Yes	No	NA


CRITERIA	RATING
SCIENCE FOR ALL
Is material free of cultural, racial, ethnic, gender, and age bias? Reason:	Yes	No	NA

Reviewer: _______________________________________

ASSESSMENT OF SCIENCE CONTENT, PRESENTATION, AND EQUITY

With the above criteria in mind, please comment on any particular strengths in this material.

With the above criteria in mind, please comment on any particular weaknesses in this material.

RECOMMENDATION

After reviewing this material with the above criteria for science content and presentation in mind, I would:
______	highly recommend this material for inclusion in Resources for Teaching Elementary School Science.
______	recommend this material for inclusion in Resources for Teaching Elementary School Science.
______	recommend this material for inclusion in Resources for Teaching Elementary School Science with reservations.
	Primary reason for reservations: ____________________________________________________________ _____________________________________________________________________________________ _____________________________________________________________________________________

______	not recommend this material for inclusion in Resources for Teaching Elementary School Science.
	Primary reason for reservations: ____________________________________________________________ _____________________________________________________________________________________ _____________________________________________________________________________________

Reviewer: _______________________________________