THREE TYPES OF CRITERIA TO IDENTIFY SUCCESSFUL STEM SCHOOLS

To approach our charge, the committee explored three types of criteria for identifying successful STEM schools: criteria related to STEM outcomes, criteria related to STEM-focused schools, and criteria related to STEM instruction and school-level practices. We addressed criteria related to STEM outcomes because success typically is measured in terms of outcomes. We examined criteria related to STEM-focused schools because those schools are often viewed as the most effective route to improving STEM education. We explored STEM-related practices because practices are foundational elements of schools, and research is available to connect what happens in schools and classrooms to the desired outcomes. In this section we discuss each set of criteria, spending the most time on the third—STEM instruction and school-level practices—because the evidence base is the strongest for this set of criteria.

Student STEM Outcomes as Criteria for Success

One way to outline criteria for success relates to outcomes: which outcomes should be used to identify effective STEM schools? In fact, several outcomes might be used, assuming that research can disentangle the effects of the school from the characteristics of the students attending the school.

Student- and school-level achievement test data are the most widely available measures and the measures used for accountability purposes, therefore, they are the measures most commonly used to gauge success, regardless of the goals of a particular school or program. Test scores, however, do not tell the whole story of success. Consider the example of the Thomas Jefferson High School of Science and Technology in Alexandria, Virginia. The mission of this highly selective magnet school is to provide students a challenging learning environment focused on math, science, and technology, to inspire joy at the prospect of discovery, and to foster a culture of innovation based on ethical behavior and the shared interests of humanity (see http://www.tjhsst.edu). Test scores certainly are critical to compare the school’s performance with others, and for Thomas Jefferson’s students to matriculate into STEM majors at top-tier postsecondary institutions. However, gauging the school’s success relative to its full set of goals necessitates using other criteria. Although it is difficult to measure interest and motivation (“joy at the prospect of discovery”), creativity (“a culture of innovation”), or commitment to “ethical behavior and the shared interests of humanity,” it is essential to do so given the importance of preparing students to be leaders in STEM innovation—and not just good test takers.

image

Entry into STEM-related majors and careers and making good choices as citizens and consumers also require applying and using STEM content knowledge in other settings besides tests. For example, measures of success could include students’ understanding of how to navigate college application and financial aid



The National Academies | 500 Fifth St. N.W. | Washington, D.C. 20001
Copyright © National Academy of Sciences. All rights reserved.
Terms of Use and Privacy Statement



Below are the first 10 and last 10 pages of uncorrected machine-read text (when available) of this chapter, followed by the top 30 algorithmically extracted key phrases from the chapter as a whole.
Intended to provide our own search engines and external engines with highly rich, chapter-representative searchable text on the opening pages of each chapter. Because it is UNCORRECTED material, please consider the following text as a useful but insufficient proxy for the authoritative book pages.

Do not use for reproduction, copying, pasting, or reading; exclusively for search engines.

OCR for page 6
SucceSSful K–12 STeM educaTion THREE TYPES OF CRITERIA TO IDENTIFY SUCCESSFUL STEM SCHOOLS T o approach our charge, the committee explored three types of criteria for identifying successful STEM schools: criteria related to STEM outcomes, criteria related to STEM- focused schools, and criteria related to STEM instruction and school-level practices. We addressed criteria related to STEM outcomes because success typically is mea- sured in terms of outcomes. We examined criteria related to STEM-focused schools because those schools are often viewed as the most effective route to improving STEM education. We explored STEM-related practices because practices are foundational elements of schools, and research is available to connect what happens in schools and classrooms to the desired outcomes. In this section we discuss each set of criteria, spending the most time on the third—STEM instruction and school-level practices—because the evidence base is the strongest for this set of criteria. Student STEM Outcomes as Criteria for Success One way to outline criteria for success relates to outcomes: which outcomes should be used to identify effective STEM schools? In fact, several outcomes might be used, assuming that research can disentangle the effects of the school from the characteristics of the students attending the school. Student- and school-level achievement test data are the most widely available measures and the measures used for accountability purposes, therefore, they are the measures most commonly used to gauge success, regardless of the goals of a particular school or program. Test scores, however, do not tell the whole story of success. Consider the example of the Thomas Jefferson High School of Science and Technology in Alexandria, Virginia. The mission of this highly selective magnet school is to provide students a challenging learn- ing environment focused on math, science, and technology, to inspire joy at the prospect of discovery, and to foster a culture of innovation based on ethical behavior and the shared interests of humanity (see http://www.tjhsst.edu). Test scores certainly are critical to compare the school’s performance with others, and for Thomas Jefferson’s students to matriculate into STEM majors at top-tier postsecondary institutions. However, gauging the school’s success relative to its full set of goals necessitates using other criteria. Although it is difficult to measure interest and motivation (“joy at the prospect of dis- covery”), creativity (“a culture of innovation”), or commitment to “ethical behavior and the shared interests of humanity,” it is essential to do so given the importance of preparing students to be leaders in STEM innovation— and not just good test takers. Entry into STEM-related majors and careers and making good choices as citi- zens and consumers also require applying and using STEM content knowledge in other settings besides tests. For example, measures of success could include students’ understanding of how to navigate college application and financial aid 6

OCR for page 6
SucceSSful K–12 STeM educaTion AREAS FOR FUTURE RESEARCH ON CRITERIA RELATED TO OUTCOMES: Additional research and data are needed on processes and such skills as the ability to solve problems organizational and instructional practices to and work effectively in teams, as well as the kinds of complement the growing body of longitudinal knowledge and skills measured on state assessments and college admission tests. Participation in formal STEM data on student outcomes, as well as addi- courses in middle and high school and other kinds of tional research that measures outcomes other STEM education—such as through museums, after-school clubs or programs, internship and research experiences— than test scores. could be used as indicators of students’ engagement. Some states have data that allow the identification of schools in which students in the aggregate appear to per- form particularly well or particularly poorly on achieve- ment tests.24 Such analyses, however, provide little information about the instructional practices and conditions in individual schools, so identifying criteria in this way does not help schools determine how to achieve desired outcomes or to decide which aspects of an apparently successful school to replicate. Researchers at the National Center for Scaling Up Effective Schools are work- ing to link data on high- and low-performing schools with survey data on instructional practices and organizational conditions, but their research was only just beginning at the time of this report. STEM-Focused School Types as Criteria for Success It is also possible to think about effective STEM schools in terms of different school types or programs that focus on STEM. Such schools are often viewed as the best route to achieve desired STEM outcomes. Indeed, it is conceivable that a specific school type or program, on average, produces stronger student outcomes than other models. Such schools and programs are important because they can serve as exemplars for districts across the nation that are attempting to elevate the quality of STEM education. The schools of interest are typically characterized by specific attention to the STEM disciplines, often for a targeted population, such as highly talented students or students from underserved groups. This specific attention to STEM frequently mani- fests itself in a rigorous curriculum that deepens STEM learning over time, more instructional time devoted to STEM, more resources available to teach STEM, and teachers who are more prepared to teach in the STEM disciplines. The committee identified three broad categories of STEM-focused schools that have the potential to meet the overarching goals for U.S. STEM education that we have described: selective STEM schools, inclusive STEM schools, and schools with STEM-focused career and technical education (CTE). Although these categories do not represent the full universe of STEM-focused schools, each category includes many different models of schools, and most of these models can be adapted for any level of the education system (elementary, middle, secondary). Each type of school has strengths and weaknesses and poses a unique set of challenges associated with implementation. 7

OCR for page 6
SucceSSful K–12 STeM educaTion It is challenging to identify the schools and programs that are most successful in the STEM disciplines because success is defined in many ways and can occur in many differ- ent types of schools and settings, with many different populations of students. It is also difficult to determine the extent to which a school’s success results from any actions the school takes or the extent to which it is related to the population of students in the school. For instance, selective STEM specialty schools have their own data about their return on investment, a variety of student outcomes, and their impact on individual students, especially those from disadvantaged backgrounds. Yet there are no systematic data that show whether the highly capable students who attend those schools would have been just as likely to pursue a STEM major or related career or make significant contributions to technology or science if they had attended another type of school. Furthermore, specialized models of STEM schooling are difficult to replicate on a larger scale because the context in which a school is located may facilitate or constrain its success. Specialized STEM schools often benefit from a high level of resources, a highly motivated student body, and freedom from state testing requirements. These conditions would be difficult, if not impossible, to implement more widely. Some studies—mostly at the high school level—have been conducted or are under way to under- stand these school types and their impacts. Although those studies are in varying states of com- pleteness and have limitations, we present some findings here, along with a description of the school type to which they apply. SELECTIvE STEM SCHOOLS Selective schools are organized around one or more of the STEM disciplines and have selective admissions criteria. Typically, these are high schools that enroll relatively small numbers of high- ly talented and motivated stu- dents with a demonstrated inter- est in and aptitude for STEM. The workshop identified four types of selective STEM schools: (1) state residential schools, (2) stand-alone schools, (3) schools- within-a-school, and (4) regional centers with half-day courses.25 All of these selective STEM schools seek 8

OCR for page 6
SucceSSful K–12 STeM educaTion to provide a high-quality education that prepares students to earn STEM degrees and succeed in professional STEM careers. They support student learning with expert teachers, advanced cur- ricula, sophisticated laboratory equipment, and apprenticeships with scientists.26 These schools often provide professional devel- opment and supplementary programs to teachers and students from public schools in their regions. On the basis of membership in the National Consortium for Specialized Secondary Schools of Math, Science and Technology, there are approxi- mately 90 selective STEM specialty high schools in the United States. Examples include Thomas Jefferson High School of Science and Technology, a stand-alone school in Virginia (see http://www.tjhsst.edu/); the North Carolina School of Science and Mathematics, a resi- dential school for grades 11-12 (see http:// www.ncssm.edu/); the Illinois Mathematics and Science Academy, a residential high school (see https://www3.imsa.edu/); and Brooklyn Technical High School, a stand-alone school (see http://www. bths.edu/). No completed studies provide a rigorous analysis of the contribu- tions that selective schools make over and above regular schools. One such study was under way at the time of this report.27 Preliminary results from that study presented at the workshop show that when compared with national samples of high school graduates with ability and interest in STEM subjects, the experiences of students who graduate from selective schools appear to be associated with their choice to pursue and complete a STEM major.28 In particular, students who had research experiences in high school, who undertook an apprenticed mentorship or internship, and whose teachers con- nected the content across different STEM courses were more likely to complete a STEM major than their peers who did not report these experiences. 9

OCR for page 6
SucceSSful K–12 STeM educaTion selectiVe stem school Example: North Carolina School of Science and Mathematics engage in service learning for a nonprofit The North Carolina School of Science agency in North Carolina. NCSSM stu- and Mathematics (NCSSM) is a public, dents participate in more than 22,000 hours residential, coeducational high school, of community service each year. located in Durham, for academically tal- ented 11th and 12th grade students from Student Population: Student enrollment is across the state. It was established by the limited to 680 residential students. In 2010- state’s General Assembly in 1978, and in 2011, the residential student population 2007 it become a part of the University had the following racial/ethnic makeup: of North Carolina system. Only North Carolina students are admitted, and they • White, 64 percent apply for admission in their sophomore • Black, 11 percent year. Students from each of the state’s 13 • Hispanic, 1 percent congressional districts are admitted on the • Asian/Pacific Islander, 22 percent basis of a formula established by state leg- • Native American, < 1 percent islation. Criteria for selection include a stu- dent’s interest in science and mathematics, Other Features: More than 99 percent standardized test scores, academic perfor- of NCSSM graduates attend college the mance, essays, special talents, accomplish- year after graduation; the few students ments, and extracurricular activities. There who do not do so usually elect to do are no fees associated with applying, being volunteer work or defer college for a fol- accepted, or attending the school. lowing year. As part of its outreach mis- Academic Characteristics: Students take sion, NCSSM provides services to students across North Carolina through its dis- four or five courses per trimester as juniors tance education courses and enrichment and five courses per trimester as seniors. activities. NCSSM serves over 900 high There are required minimal trimester cred- school students from across the state each its: six for science, five for mathematics, two semester through its advanced mathemat- for social science, three to six for foreign ics, science, and humanities online and language, and one for physical activity and videoconference courses. NCSSM serves wellness. The average class size is just over an additional 2,000 K-12 students from 20 students. A significant component of the across the state through videoconference academic experience at NCSSM includes enrichment activities. NCSSM also pro- research and mentorship. More than vides mathematics and science professional 65 percent of students participate in research development for North Carolina teachers and/or mentorship opportunities during from across the state. their 2 years at NCSSM. Students must also 10

OCR for page 6
SucceSSful K–12 STeM educaTion INCLUSIvE STEM SCHOOLS Inclusive schools emphasize or are organized around one or more of the STEM disciplines but have no selective admissions criteria. These schools seek to provide expe- riences that are similar to those at selective STEM schools while serving a broader population. Many inclusive STEM schools operate on the dual premises that “math and science competencies can be developed, and that students from tradition- ally underrepresented subpopulations need access to opportunities to develop these competencies to become full participants in areas of economic growth and prosperity.”29 Examples include High Tech High, a set of schools in southern California (see http://www.hightech- high.org); Manor New Technology High School in Texas (see http:// www.manorisd.net/portal/newtech); the Denver School for Science and Technology in Colorado for grades 6-12 (see http://www.dsstmodel.org); and Oakcliff Elementary School in Georgia (see http://www.dekalb.k12.ga.us/oakcliff/). Insights from inclusive STEM schools come from an ongoing study of high school reform in Texas.30 Early findings suggest that students in that state’s 51 inclusive STEM schools score slightly higher on the state mathematics and science achievement tests, are less likely to be absent from school, and take more advanced courses than their peers in comparison schools. The schools in the Texas study are new—having opened in 2006-2007 or later—and they have been able to achieve these gains within their first 3 years of operation. Factors that appear to have helped the schools include a STEM school blueprint that helps to guide school planning and implementation, a college preparatory curriculum and explicit focus on col- lege readiness for all students, strong academic supports, small school size, and strong support from their district or charter management organization.31 The Texas study has carefully identified a set of comparison schools that were equivalent to the inclusive STEM schools on a wide range of school characteristics, such as student demographics and prior achievement and teacher characteristics.32 However, this approach does not eliminate the possibility that the apparent benefits of inclusive schools reflect the students who choose to attend them. The students who attend inclusive STEM schools may do so because of their greater interests in STEM fields, despite being otherwise similar to students in comparison schools. 11

OCR for page 6
SucceSSful K–12 STeM educaTion inclusiVe stem hiGh school Example: Manor New Technology High School requirements in mathematics include alge- Manor New Tech opened near Austin, bra I, II, geometry, and an elective in pre- Texas, in 2007 as one of the official Texas calculus, college algebra, and/or calculus. Science, Technology, Engineering, and Science requirements include biology and Mathematics (T-STEM) Academies of the three other courses selected from integrat- Texas High School Project. The school ed physics and chemistry, environmental prepares students in grades 9-12 to excel science, chemistry, and physics. in an information-based and technologi- cally advanced society. Its instructional Student Population: For the 2009-2010 program encourages student to devel- school year, Manor New Tech High served op problem-solving skills, interpersonal a total of 315 students. The student pop- skills, and the resilience they need to ulation had the following racial/ethnic succeed in a rapidly changing and com- makeup: petitive world. The curriculum brings together modern technology, community • White, 32 percent partnerships, problem solving, interdisci- • Black, 22 percent plinary instruction, and global perspec- • Hispanic, 44 percent tives in a student-centered, collaborative, • Asian/Pacific Islander, 2 percent project-based community. Academic Characteristics: Manor New About 56 percent of students in 2009-2010 were considered to be economically dis- Tech uses the New Tech Network’s school advantaged, and 5 percent participated in model, which has three major compo- special education programs. nents: (1) use of a project-based learning instructional approach to offer engag- Other Features: The school’s Think ing, collaborative opportunities for learn- Forward Institute is designed to train edu- ing; (2) use of technology integrated cators in best practices for project-based across the curriculum; and (3) creation learning, leadership, and 21st-century skill of a school culture that is based on trust, applications. respect, and responsibility. Graduation 12

OCR for page 6
SucceSSful K–12 STeM educaTion SCHOOLS AND PROGRAMS STEM-FOCUSED CAREER wITH AND TECHNICAL EDUCATION STEM-related CTE serves mainly high school students and can take place in regional centers, CTE-focused high schools, programs in comprehensive high schools, and career academies.33 An important goal of STEM-focused CTE is to prepare students for STEM-related careers, often with the broader goal of increasing engagement to prevent students from dropping out of school. As a result, students explore STEM-related career options and learn the practical applica- tions of STEM subjects through the wide range of CTE delivery mechanisms. Examples include Loudoun Governor’s Career and Technical Academy, a Virginia high school (see http://www.doe. virginia.gov/instruction/career_technical/gov_academies/academies/loudoun); Sussex Technical High School in Delaware (see http://www.sussexvt.k12.de.us/web/); and Los Altos Academy of Engineering, a California high school (see http://www.lasv.org/). Despite many examples of highly regarded CTE schools and programs, there is little research that would support conclusions about the effectiveness of the programs, particularly in comparison with alternatives. One rigorous study of mathematics content that was integrated in occupational education found positive effects on student achievement in mathematics, with no loss in occupational knowl- edge.34 These findings suggest that CTE, assumed to moti- vate learning through real-life applications, does not have to be in conflict with academic achievement. A similar study of integrated science is under way. More broadly, the limited research base on the three school types hampered the committee’s ability to compare their effectiveness relative to each other and for different student populations or to iden- tify the value these schools add over and above non-STEM focused schools. However, the avail- able studies suggest some potentially promising—if preliminary and qualified—findings associated for each school type. Those studies also raise ques- tions that merit further exploration about variations within and across school types and about whether these schools are making progress toward the three broad goals for U.S. STEM education. Our collective understanding of these schools would be enhanced by more information about the instructional practices in these schools and the factors that influence them. 13

OCR for page 6
SucceSSful K–12 STeM educaTion STEM-FOCuSED CAREER AND technicAl educAtion Example: Dozier-Libbey Medical High School medicine, ethical and legal practices, and Dozier-Libbey Medical High School is a employability skills. pathway school for the Antioch, California, Unified School District. Opened in Student Population: For the 2009-2010 August 2008, Dozier-Libby will eventu- school year, Dozier-Libbey served a total ally serve 600 students in grades 9-12. The of 343 students. The student population school’s 4-year program prepares students had the following racial/ethnic makeup: for health-related careers and has a strong emphasis on mathematics and science. • White, 29 percent • Black, 15 percent Academic Characteristics: Students are • Hispanic, 35 percent required to take a minimum of four math- • Asian/Pacific Islander, 17 percent ematics and four science courses and a • Not reporting, 3 percent minimum of 2 years of foreign language. All students who successfully complete the Of these students, 45 percent in 2009-2010 program meet or exceed the A-G require- were eligible for free or reduced-price lunch. ments for admission into the University of California system. Other Features: Frequent hands-on instruc- tional activities are a key part of the pro- The health science theme is integrated gram and are developed with industry and throughout all curricular areas with heavy postsecondary partners. Examples of these emphasis on integrated project-based activities are job shadowing, guided study units. In addition to the A-G require- tours, service learning opportunities, pre- ments, students take a medical terminol- sentations by guest speakers, cross-curricular ogy course their freshmen year, which is research projects, digital portfolios, and articulated with Los Medanos Community internships. In addition, all students are College. Students who pass the course strongly encouraged to join and participate with a B or better receive three college in Health Occupation Students of America. credits. Students also take a health sci- In 2011, Dozier-Libbey was one of 97 public ence course each year with subject matter middle and high schools that were named that is specific to health-related industries California Distinguished Schools. such as medical career exploration, global 14

OCR for page 6
SucceSSful K–12 STeM educaTion STEM IN COMPREHENSIvE SCHOOLS Of course, successful STEM education also takes place in “reg- ular” comprehensive schools in grades K-12. Although not explicitly focused on the STEM disciplines, these schools might instead strive for excellence for all students in all disciplines. Much of the available research knowl- edge of effective practices comes from compre- hensive schools, which educate the vast majority of the nation’s students—including many tal- ented and aspiring scientists, mathematicians, and engineers who might not have access to selective or inclusive STEM-focused schools. The STEM education goals of comprehensive schools vary widely and can include helping to prepare the next generation of scientists and innovators, expanding the number of capable students for the STEM workforce, increasing science literacy for all, and generally preparing students for postsecondary success. To these ends, mathematics and science requirements in comprehensive schools have increased in the past 25 years. In 2008, for example, 31 states required three or more credits in science for high school graduation, and 37 required three or more credits in mathematics.35 In terms of STEM-focused programs in regular comprehensive high schools, Advanced Placement (AP) and International Baccalaureate (IB) are the most widely recognized programs of advanced study in sci- ence and mathematics in the United States, and the only two that are national in scope (see box for a brief descrip- tion). As of 2009, roughly 35 percent of U.S. public high schools offered AP or IB courses in the four core subject areas: English language arts, mathematics, science, and social studies.36 A 2002 study of AP and IB by the National Research Council identified several ways to improve advanced study of math and science in the United States. These suggestions included emphasizing deep understanding rather 15

OCR for page 6
SucceSSful K–12 STeM educaTion stem in A comprehensiVe school Example: Christa McAuliffe Elementary School (P.S. 28) ing arts program. Classes are designed to The Christa McAuliffe School is a public foster curiosity, inquiry, and discovery in school in Jersey City, New Jersey, with full- curriculum foundations. The school has day programs for pre-K and K students, as an integrated curriculum for all students well as for 1st through 8th grade students. A in which learning extends beyond the substantial number of students participate in classroom walls. the extended-day tutorial program and many after-school programs, which include prepa- Student Population: In the 2008-2009 ration for the New Jersey Assessment of school year, the school’s population of Skills and Knowledge, the tutorial program, nearly 900 students had the following yearbook, Community League, Scholastic racial/ethnic makeup: Bowl, science/technology classes, choir, band, show choir, seasonal sports teams, and • White, 12 percent robotics. School programs are designed to • Black, 6 percent develop sound character, creativity, ethical • Hispanic, 76 percent judgment, concerned attitudes, and the abil- • Asian/Pacific Islanders, 6 percent ity to live productively and harmoniously in • Native American, < 1 percent a global workforce. Academic Characteristics: The school Of these students 84 percent in 2008- 2009 were eligible for free or reduced- offers a challenging standards-based aca- price lunch. demic curriculum with the following spe- cialized programs: H.O.P.E. (Honors, Other Features: The Broad Foundation Opportunity, Potential, Enrichment) class- and Rutgers University have recognized es, English as second language classes, the school for its efforts in closing the Reading Recovery instruction, Project Raise achievement gap between white and services, inclusion and transitional special minority students, and in 2010 INTEL education classes, bilingual education, the selected P.S. 28 as a “School of Distinction” Response to Intervention (RTI) program, finalist. 8th grade algebra, and a fine and perform- 16

OCR for page 6
SucceSSful K–12 STeM educaTion AREAS FOR FUTURE RESEARCH ON CRITERIA RELATED TO SUCCESSFUL SCHOOLS AND PROGRAMS: Large- and smaller-scale research is needed on STEM- than comprehensive coverage, aligning these programs focused schools and programs that (1) disen- with the current understanding of how students learn in tangles school effects from the characteristics a discipline, drawing on current research directions in the of students who attend them, (2) identifies disciplines, and emphasizing the development of inquiry and describes distinctive aspects of their and reasoning skills. In response to that report and other influences, a comprehensive effort is under way to rede- educational practices, and (3) measures the sign AP science courses. The goals of the redesign are to schools’ long-term effectiveness relative to the produce a more inclusive and more engaging program of broad goals for U.S. STEM education. study for each AP discipline.37 For each discipline, the redesign has focused on a developing a well-defined set of learning objectives that support teaching for deeper understanding, aligning the AP exams with these learning objectives, and providing AP instructors with the tools and professional development opportunities that support teaching, learning, and success on the AP exams.38 Advanced Placement and International baccalaureate: Examples of Programs of Advanced Study in Science and Mathematics39 The IB program was developed in the late 1960s to provide an international stan- dard of secondary education for children of diplomats and others stationed outside their countries. One goal was to prepare students for university work in their home countries. The International Baccalaureate Organisation authorizes partici- pating high schools. Schools cannot offer only a subset of IB courses; instead, they must offer a full IB diploma program. Although some students take individual IB courses as they would an honors course, most are diploma candidates, taking a program of six or seven courses over 2 years. Developed in 1955, AP is the predominant national program for advanced courses in U.S. high schools. The College Board provides topic outlines for AP courses, generated largely by surveying colleges and universities. However, teachers are allowed considerable leeway in implementation. Elective, end-of-course exami- nations are designed to be comparable with “typical” introductory college-level courses in a subject area. 17

OCR for page 6
SucceSSful K–12 STeM educaTion STEM Instruction and School Practices as Criteria for Success Because informative research on programs and practices can be at a smaller scale than research on types of schools, a larger body of rigorous evidence is available on practices that are associated with better student outcomes, regardless of whether students are in a STEM-focused school or in a regular school. Although many of these practices have been studied separately and in individual classrooms, the committee believes that it may be possible to improve STEM education for all stu- dents by combining successful practices and implementing them school wide. Thus, the committee believed that the most useful way of identifying criteria for success relates to educational practices: what practices should be used to identify effective STEM schools? Focusing on practices instead of outcomes provides schools with concrete guidance for improving the quality of STEM instruction and, presumably, of STEM learning. Several recent NRC reports on effective programs and practices in science and mathematics and other select syntheses informed the committee’s deliberations. Drawing on this evidence, we focused on two key aspects of practice that are likely to be found in successful schools: instruction that captures students’ interest and involves them in STEM practices and school conditions that support effective STEM instruction.40 EFFECTIvE STEM INSTRUCTION Research in STEM learning and teaching over the past two decades allows the committee to char- acterize effective STEM education.41 Briefly, effective instruction capitalizes on students’ early interest and experiences, identifies and builds on what they know, and provides them with experiences to engage them in the practices of science and sustain their interest. This description is consistent with the vision that inspired the Conceptual Framework for New Science Education Standards.42 It addresses all three broad goals for K-12 STEM educa- tion in the United States that we discuss in this report. According to the research, effective instruction actively engages students in science, mathematics, and engineer- ing practices throughout their schooling. Effective teachers use what they know about 18

OCR for page 6
SucceSSful K–12 STeM educaTion students’ understanding to help students apply these practices. In this way, students successively deepen their understanding both of core ideas in the STEM fields and of concepts that are shared across areas of science, mathematics, and engineering. Students also engage with fundamental questions about the material and natural worlds and gain experience in the ways in which scientists have investigated and found answers to those questions. In grades K-12, students carry out scien- tific investigations and engineering design projects related to core ideas in the disciplines, so that by the end of their secondary schooling they have become deeply familiar with core ideas in STEM and have had a chance to develop their own identity as STEM learners through the practices of science, mathematics, and engineering. Presentations and papers at the committee’s May workshop revealed that, to varying degrees, students in all school types can engage in the practices of science and engineering. In selective schools, students regularly design and conduct scientific research, sometimes in collaboration with working scientists. Inclusive STEM schools aim to provide this same kind of experience. Students in these schools have opportunities to learn science, mathematics, and engineering by addressing problems that have real-world applications.43 The same is true in some comprehensive schools.44 For its part, career and technical education is predicated on the idea of making learning relevant and connecting the content with its applications.45 CTE schools and programs commonly use engineering as a mechanism for making content relevant, and they rely heavily on technology as a tool for engaging in scientific practices. However, this type of STEM instruction remains the exception in U.S. schools. It is typically facili- tated by extraordinary teachers who overcome a variety of challenges that stand between vision and reality. Further transformation is needed at the national, state, and local levels for this type of K-12 STEM instruction to become the norm. In the rest of this section we identify some of the key elements that might be able to guide educators and policy makers in that direction. Key element: A coherent set of standards and curriculum. As noted above, roughly 75 percent of U.S. 8th graders are not proficient in mathematics when they complete 8th grade (as measured by the National Assessment of Educational Progress).46 These students are unprepared for the increas- ing demands of high school mathematics and for science courses that require mathematics. International comparison data suggest that these results might be explained by differences in U.S. standards, curricula, and textbooks in comparison to those of higher performing countries. The research shows a clear link between what students are expected to learn and mathematics achievement: At a given grade level, greater achievement is associated with covering fewer topics in greater depth.47 Current work on the Common Core State Standards for mathematics48 and the Conceptual Framework for New Science Education Standards49 may allow states to move toward curricula that address the most important topics and are focused on developing proficiency in mathematics and science. 19

OCR for page 6
SucceSSful K–12 STeM educaTion Some evidence suggests that these kinds of efforts—namely, adopting rigorous standards and aligning curriculum and assessments to those standards—can lead to gains in student achieve- ment.50 Indeed, Minnesota provides an example of a state that adopted rigorous standards, pared down the number of topics in its curriculum, and realized gains in student achievement. According to one report: Although there is no conclusive causal evidence that Minnesota’s gains between 1995 and 2007 were primar- ily due to changes in its standards, the data do support the hypothesis that there is a relationship between standards and achievement—that content coverage led by coherent, focused, and rigorous standards properly implemented by teachers can improve student outcomes in mathematics. Most importantly, this improvement can happen in an American state.51 The adoption of common standards can also provide an opportunity to focus teacher preparation and professional development opportunities on material that will be relevant to their work. This development is promising because research has shown that the extent to which prospective teach- ers are prepared to use the mathematics curriculum that they will be teaching has a significant effect on their students’ test scores when they begin teaching.52 Key element: Teachers with high capacity to teach in their discipline. Teaching in ways that inspire all students and deepen their understanding of STEM content and practices is a demanding enter- prise. To be effective, teachers need content knowledge and expertise in teaching that content, but the research suggests that science and mathematics teachers are particularly underprepared for these demands. For example, in both middle and high schools, unacceptably high percentages of teachers who teach science and mathematics courses are not certified in the subjects they teach and did not major in a related field in college.53 Estimates of the number of out-of-field science and mathematics teachers in secondary school are between 10 and 20 percent.54 A recent survey of university teacher preparation programs found that future elementary teachers were required to take, on average, only two mathematics courses.55 The lack of preparation is reflected in a lack of comfort by teachers in teaching the required content: using the criterion of whether at least 75 percent of teachers reported feeling comfortable teaching the major topics in the middle school curriculum, one survey found that no topic met that criterion.56 Weak initial teacher preparation heightens the importance of continuing professional develop- ment, but the available research suggests that professional development in STEM, when available, 20

OCR for page 6
SucceSSful K–12 STeM educaTion is often short, fragmented, ineffective, and not designed to address the specific need of individ- ual teachers.57 Although some careful studies of particular professional development programs in mathematics and science have shown positive effects on student achievement, others have shown no effect or even negative effects.58 Despite these mixed research findings, there is emerging agree- ment on the characteristics of effective professional development. In any discipline, effective professional development should • focus on developing teachers’ capabilities and knowledge to teach content and subject matter, • address teachers’ classroom work and the problems they encounter in their school set- tings, and • provide multiple and sustained opportunities for teacher learning over a substantial time interval.59 The evidence suggests that these characteristics are levers for changing teachers’ practices.60 However, the evidence of their effects on student achievement is more tenuous because very little research traces the causal pathway from professional development to student achievement. Moreover, professional development alone is not a solution to current limitations on teachers’ capacities.61 Instead, it is more productive to consider teacher development as a continuum that ranges from initial preparation to induction into the practice of teaching and then to systematic, needs-based professional development, including on-site professional support that allows for inter- action and collaboration with colleagues. Key element: A supportive system of assessment and accountability. Current assessments limit teachers’ ability to teach in ways that are known to promote learning of scientific and mathematical content and practices. In mathematics, for example, since implementation of the No Child Left Behind (NCLB) Act, there has been a shift away from complex performance assessments toward multiple-choice items. According to one report, “States reported that the use of multiple-choice items in assessments has limited the content and complexity of what they test.”62 The report further states: “The focus on student results, combined with the focus on multiple choice items, has led to teachers teaching a narrow curriculum that is focused on basic skills.”63 A previous NRC committee recommended that each state develop a “system of science assess- ment . . . comprised of a variety of assessment strategies” to meet the requirements of NCLB.64 More generally, the report notes:65 A successful system of standards-based science assessment is coherent in a variety of ways. It is horizontally coherent: curriculum, instruction, and assessment are aligned with the standards; target the same goals for learning; and work together to support students’ developing science literacy. It is vertically coherent: all levels of the education 21

OCR for page 6
SucceSSful K–12 STeM educaTion system—classroom, school, school district, and state—are based on a shared vision of the goals for science education, of the purposes and uses of assessment, and of what constitutes competent performance. The system is also developmentally coherent: it takes into account how students’ science understanding develops over time and the scien- tific content knowledge, abilities, and understanding that are needed for learning to progress at each stage of the process. A supportive accountability system focuses not just on student outcomes but also on teacher practices. Consider the example of the Illinois Mathematics and Science Academy (IMSA), which counts “inquiry-based, problem-centered” teaching and learning as core competencies. IMSA uses three different methods to determine the extent to which this objective is achieved: • very semester, for every teacher, IMSA students complete course surveys, which include E questions on this objective. • aculty and staff trained in classroom observations conduct frequent visits to gauge the F actual use of inquiry-based methods. • xternal reviewers evaluate two or three departments each year to identify the extent to E which IMSA’s teaching and learning is “inquiry-based and problem-centered.” Key element: Adequate instructional time. The NCLB Act has also changed the time for science, tech- nology, engineering, and mathematics instruction in the K-12 curriculum. Particularly in elemen- tary school, the predominant instructional emphasis is on mathematics and English language arts because those subjects are tested annually under the current accountability system. In the 2006- 2007 school year, for example, elementary schools (on a nationally representative survey) reported spending an average of 178 minutes per week on science instruction, 323 minutes on mathematics, and 503 minutes on English language arts.66 A closer look at those data revealed that 28 percent of districts reported decreasing their instructional time in science in elementary schools, with an aver- age decrease in those districts of 75 minutes per week. In contrast, 45 percent of districts reported increasing instructional time for mathematics in elementary schools, with an average increase of 89 minutes per week.67 A 2007 study of science education in California paints a starker picture. That survey of nine coun- ties in the San Francisco Bay Area found: “80 percent of K-5th grade multiple-subject teachers who are responsible for teaching science in their classrooms reported spending 60 minutes or less per week on science, with 16 percent of teachers spending no time at all on science.”68 Those research- ers estimate that their results actually overstate the amount of science instruction in the Bay Area because “teachers who took the time to respond to the survey are more likely to be engaged in sci- ence education than those who did not.”69 Overall, the decrease in time for science education is a concern because some research suggests that interest in science careers may develop in the elementary school years.70 22

OCR for page 6
SucceSSful K–12 STeM educaTion Key element: Equal access to high-quality STEM learning opportunities. The achievement gaps among students from different socioeco- nomic, racial, and ethnic groups are well documented.71 Many factors contribute to these gaps, including poverty, but we focused on some of the structural inequalities that states, schools, and districts have the potential to address. For example, dispari- ties in teacher expectations and other school and classroom- level factors, such as access to adequate laboratory facili- ties, resources, and supplies, contribute to gaps in science achievement for underrepresented groups.72 Similar structural inequities hinder the mathematics learning of underrepresented minorities and low-income students, such as disparities in access to well-trained or credentialed teachers, less rigorous educational courses, and ability tracking in the early grades.73 In mathematics, these inequali- ties can have cumulative effects as students progress through grades K-12 because mathematics is a gatekeeper to academic opportunity.74 Policies to ensure that well-prepared teachers are placed in all classrooms can redress the imbal- ance in access to qualified teachers that currently exists between students from advantaged and disadvantaged backgrounds. In addition, although “detracking”—creating classrooms with students of mixed abilities—is often proposed as a solution to unequal learning opportunities in schools, the research evidence suggests that this approach is not always beneficial. For instance, when detrack- ing fails to provide challenging learning opportunities for all students, low-income and minority students may have the most to lose because they often lack academic support outside school that could compensate for weak instruction in school.75 However, cases of successful detracking do exist, and they suggest that supplemental instruction for low-achieving students (such as through tutoring or extra class sessions) makes it possible to offer challenging instruction to all students in mixed-ability settings.76 SCHOOL CONDITIONS AND CULTURES THAT SUPPORT LEARNING Strong teachers and focused, rigorous, and coherent curricula are certainly important factors to improve student learning in STEM. However, school and community conditions also affect what is taught, how it is taught, and with which results. Research suggests that although teacher qualifications matter, the school context—its culture and conditions—matters just as much, if not more. As an example, research conducted in several school districts over 10 years highlights teacher learning communities as among the most powerful sources of improvement in teacher and student learning and identify multiple factors that strengthen and sustain those learning communi- ties (e.g., school and district leaders, parents, and community).77 23

OCR for page 6
SucceSSful K–12 STeM educaTion AREAS FOR FUTURE RESEARCH ON CRITERIA RELATED TO INSTRUCTIONAL AND SCHOOL-LEvEL PRACTICES: Longitudinal data from public elementary schools in Chicago Additional research is needed on the bolster these and other findings from the considerable body of effects of STEM teacher professional research on structuring schools to promote high-quality teach- development on student achievement ing and learning.78 In a study of 200 low-performing elementary and on which elements of school schools in Chicago, no schools with a poor learning climate and culture contribute to STEM learning, weak professional community substantially improved math or reading scores. Roughly half of schools with a well-aligned cur- particularly in schools serving low- riculum and a strong professional community among teachers income and minority students who are substantially improved math and reading achievement.79 These underrepresented in the STEM majors gains are notable because they were made in high-poverty schools and careers. located in severely disadvantaged communities. The elementary schools that improved student learning in math- ematics and reading shared five common elements:80 1. School leadership as the driver for change. Principals must be strategic, focused on instruction, and inclusive of others in the leadership work. 2. Professional capacity or the quality of the faculty and staff recruited to the school, their base beliefs and values about change, the quality of ongoing professional development, and the capacity of a staff to work together. 3. Parent-community ties that involve active outreach to make school a welcoming place for parents, engage them in supporting their children’s academic success, and strengthen connections to other local institutions. 4. Student-centered learning climate. Such a climate is safe, welcoming, stimulating and nurturing environment focused on learning for all students. 5. Instructional guidance that is focused on the organization of the curriculum, the nature of academic demand or challenges it poses, and the tools teachers have to advance learning (such as instructional materials). The strength of these supports varied within and across elementary schools in Chicago: some schools were strong along all dimensions, and some were stronger in some dimensions than in others. Although not all of these supports need to be strong for schools to succeed, schools that were weak on all of these dimensions showed no gains in achievement.81 24