National Academies Press: OpenBook
« Previous: What is the Third International Mathematics and Science Study (TIMSS)?
Suggested Citation:"What is the Survey of Mathematics and Science Opportunities (SMSO)?." National Research Council. 1996. Mathematics and Science Education Around the World: What Can We Learn From The Survey of Mathematics and Science Opportunities (SMSO) and the Third International Mathematics and Science Study (TIMSS)?. Washington, DC: The National Academies Press. doi: 10.17226/5508.
×

This information will be an important resource in efforts to improve mathematics and science education because it will enable better understanding of our own educational system.

International studies are sometimes viewed with suspicion.14,15 Skeptics argue that cultural and social factors vary so much across countries as to make comparisons impossible. They point also to the difficulties of creating instruments and conceptual categories that are usable across cultural contexts. In SMSO, substantial time and intellectual resources were invested in instrument development and research design to deal with these serious challenges. TIMSS researchers wanted to avoid the assumption that the critical educational elements were identical across contexts or that they meant the same thing. But they also sought to avoid tailoring the methods of research to each country on an individual basis because such tailoring would make comparative analyses virtually impossible.

What is the Survey of Mathematics and Science Opportunities (SMSO)?

Gathering cross-national data of this complexity and scale called for the development and piloting of innovative survey instruments. The Survey of Mathematics and Science Opportunities (SMSO) was originally designed to develop instruments and methods of analysis that would be suitable for the complexity of the TIMSS research. In SMSO, an international collaborative research team undertook the task of conducting close observations of classrooms in six of the TIMSS countries: France, Japan, Norway, Spain, Switzerland, and the United States.16 The central questions of SMSO were, "What does a typical mathematics lesson look like?" and "What does a typical science lesson look like?" The goal was to understand enough about teaching and curriculum within each country that the design of survey instruments for TIMSS would allow for comparisons and also be sufficiently sensitive to cultural differences. This pilot work was done to increase the potential of providing valid information for interpreting variations in student achievement. SMSO researchers observed classroom lessons in their own countries, read one another's written classroom observations, and discussed meanings of practices, terms, assumptions, and norms. They also developed, piloted, and revised survey instruments based on teachers' interpretations and responses. In studying the implemented curriculum—teaching practice—researchers observed 127 classrooms across six countries and three levels. These classrooms were never intended to constitute a probability sample of classrooms in the countries but, rather, to provide sufficient variation overall to ensure good instrument development for TIMSS. This report draws primarily on the results of SMSO as a means to introduce and set the stage for discussion of TIMSS.

A fundamental premise for the SMSO effort was that the variation in learning conditions across countries would be critical to development of TIMSS survey items and to sensible interpretation of the TIMSS student achievement data. The meaning of this premise became more complicated as the

14  

Berliner, D. & Biddle, B. (1995). The manufactured crisis: Myths, fraud, and the attack on America's public schools. Reading, MA: Addison Wesley.

15  

Bracey, G.W. (1996, January-February). International comparisons and the condition of American education. Educational Researcher, 25(1), 5-11.

16  

These countries were selected to provide variation of the kinds expected across the TIMSS participating nations, so that the instruments would be designed to work across varied settings.

Suggested Citation:"What is the Survey of Mathematics and Science Opportunities (SMSO)?." National Research Council. 1996. Mathematics and Science Education Around the World: What Can We Learn From The Survey of Mathematics and Science Opportunities (SMSO) and the Third International Mathematics and Science Study (TIMSS)?. Washington, DC: The National Academies Press. doi: 10.17226/5508.
×

international team of SMSO researchers discovered differences in taken-for-granted operational definitions for common educational expressions. For example, "seatwork" is a common part of U.S. classes, especially in mathematics, and in the U.S., the researchers found, the term was used to refer to independent practice or review work. In some other countries, although students did independent work at their seats, such work was intermittent and was woven into an ongoing whole group lesson. Researchers learned that periods of independent student class work and how this work fit into the larger class agenda varied enough to make the term "seatwork" as understood in the U.S. almost meaningless in the international context. Other examples of fundamental differences included the concept of a "lesson"—in terms of length, structure, and frequency—as well as the length of time that teachers work with the same group of students. In some countries, teachers stay with the same students for as many as six years. This may well affect what teachers know about their students. In yet another example, in Switzerland, primary schools do not have principals a fact that the researchers learned during a data collection planning meeting. The team realized that this fact might represent an important element of Swiss educational practice and that, indeed, the very concept of a ''school'' might be different across countries, with the relevant organizational unit different in different contexts.

These and other discoveries were important to the ultimate design of survey instruments for the larger TIMSS study. SMSO work proceeded through a series of iterations. Qualitative observations and interviews were discussed at length, and the insights reached by the team in turn shaped revisions of quantitative survey instruments. The SMSO research team found the process challenging and worthwhile, well beyond its contributions to instrument development for the larger study. Titling an entire section of their report, "Value of International Discourse," the researchers explained that the "discourse process . . . led to insights not possible with a more traditional model." 17 "Confusion and surprise" emerged often, and through discussions, research team participants clarified their ideas. They found that they had learned a great deal about educational practice and comparison in their efforts to reach shared understandings about instrument items and ideas. The group noted the subtleties of difference in practice underlying surface similarities of language. The SMSO researchers decided that the SMSO methodology and the results would be of interest and importance in their own right. The SMSO report will be released with the TIMSS curriculum studies.18

17  

Schmidt, W.H., et al. (in press). Characterizing pedagogical flow: An investigation of mathematics and science teaching in six countries. Dordrecht, The Netherlands: Kluwer Academic Publishers.

18  

Schmidt, W.H., McKnight, C.C., Valverde, G.A., Hohang, R.T., & Wiley, D.E. (in press). Many visions, many aims: A cross-national investigation of curricular intentions in school mathematics. Dordrecht, The Netherlands: Kluwer Academic Publishers, and Schmidt, W.H., Raizen, S.A., Britton, E.D., Bianchi, L.J., & Wolfe, R.G. (in press, 1996). Many visions, many aims: A cross-national investigation of curricular intentions in school science. Dordrecht, The Netherlands: Kluwer Academy Publishers.

Suggested Citation:"What is the Survey of Mathematics and Science Opportunities (SMSO)?." National Research Council. 1996. Mathematics and Science Education Around the World: What Can We Learn From The Survey of Mathematics and Science Opportunities (SMSO) and the Third International Mathematics and Science Study (TIMSS)?. Washington, DC: The National Academies Press. doi: 10.17226/5508.
×
Page 7
Suggested Citation:"What is the Survey of Mathematics and Science Opportunities (SMSO)?." National Research Council. 1996. Mathematics and Science Education Around the World: What Can We Learn From The Survey of Mathematics and Science Opportunities (SMSO) and the Third International Mathematics and Science Study (TIMSS)?. Washington, DC: The National Academies Press. doi: 10.17226/5508.
×
Page 8
Next: What Can Be Learned from the Survey of Mathematics and Science Opportunities (SMSO)? »
Mathematics and Science Education Around the World: What Can We Learn From The Survey of Mathematics and Science Opportunities (SMSO) and the Third International Mathematics and Science Study (TIMSS)? Get This Book
×
Buy Paperback | $21.00 Buy Ebook | $16.99
MyNAP members save 10% online.
Login or Register to save!
Download Free PDF

Amid current efforts to improve mathematics and science education in the United States, people often ask how these subjects are organized and taught in other countries. They hear repeatedly that other countries produce higher student achievement. Teachers and parents wonder about the answers to questions like these: Why do the children in Asian cultures seem to be so good at science and mathematics? How are biology and physics taught in the French curriculum? What are textbooks like elsewhere, and how much latitude do teachers have in the way they follow the texts? Do all students receive the same education, or are they grouped by ability or perceived educational promise? If students are grouped, how early is this done? What are tests like, and what are the consequences for students? Are other countries engaged in Standards-like reforms? Does anything like "standards" play a role in other countries? Questions such as these reflect more than a casual interest in other countries' educational practices. They grow out of an interest in identifying ways to improve mathematics and science education in the United States.

The focus of this short report is on what the Third International Mathematics and Science Study (TIMSS), a major international investigation of curriculum, instruction, and learning in mathematics and science, will be able to contribute to understandings of mathematics and science education around the world as well as to current efforts to improve student learning, particularly in the United States.

  1. ×

    Welcome to OpenBook!

    You're looking at OpenBook, NAP.edu's online reading room since 1999. Based on feedback from you, our users, we've made some improvements that make it easier than ever to read thousands of publications on our website.

    Do you want to take a quick tour of the OpenBook's features?

    No Thanks Take a Tour »
  2. ×

    Show this book's table of contents, where you can jump to any chapter by name.

    « Back Next »
  3. ×

    ...or use these buttons to go back to the previous chapter or skip to the next one.

    « Back Next »
  4. ×

    Jump up to the previous page or down to the next one. Also, you can type in a page number and press Enter to go directly to that page in the book.

    « Back Next »
  5. ×

    Switch between the Original Pages, where you can read the report as it appeared in print, and Text Pages for the web version, where you can highlight and search the text.

    « Back Next »
  6. ×

    To search the entire text of this book, type in your search term here and press Enter.

    « Back Next »
  7. ×

    Share a link to this book page on your preferred social network or via email.

    « Back Next »
  8. ×

    View our suggested citation for this chapter.

    « Back Next »
  9. ×

    Ready to take your reading offline? Click here to buy this book in print or download it as a free PDF, if available.

    « Back Next »
Stay Connected!