Tech Tally Approaches to Assessing Technological Literacy (2006) / Chapter Skim
Currently Skimming:
7 Computer-Based Assessment Methods
7 Computer-Based Assessment Methods
Pages 161-174
The Chapter Skim interface presents what we've algorithmically identified as the most significant single chunk of text within every page in the chapter.
Select key terms on the right to highlight them within pages of the chapter.
From page 161... ...
An alternative approach would be to present test takers with hands-on laboratory exercises, but the costs and complexities of developing, administering, and "grading" a truly hands-on design or problemsolving activity for a large sample of individuals would be prohibitive. Social scientists, public opinion polling organizations, and others interested in assessing what out-of-school experiences contribute to technological literacy have few tools at their disposal.
|
From page 162... ...
Computer-Based Adaptive Assessments Computer-based, flexi-level, branching, and stratified adaptive testing have been investigated for more than 30 years (Baker, 1989; Bunderson et al., 1989; Lord, 1971a,b,c; van der Linden, 1995; Weiss, 1983)
|
From page 163... ...
ASVAB now uses computers for item writing, item banking, test construction, test administration, test Tests using scoring, item and test analyses, and score reporting (Baker, 1989)
|
From page 164... ...
Simulations Rather than presenting a series of test items, even items adapted to an individual's responses, assessments might be improved by immersing the test taker in simulations of real-life situations. This idea is particularly appealing for assessments of technological literacy, which necessarily em phasize capability and critical thinking and decision making, in addition to basic knowledge.
|
From page 165... ...
Because simulation-based assessments have highly reactive and interactive capabilities, they can be more sophisticated and elaborate than paper-based tests and provide more comprehensive and more substantive measures of technological literacy. Simulations can not only provide opportunities for individuals or teams to demonstrate technological literacy through designing, building, and application capabilities, they can also review the results, assess the ability to correct errors (if any)
|
From page 166... ...
. One study describes the use of DIAG, a set of authoring tools developed by the Behavioral Technology Laboratories at the University of Southern California, to create a simulation-based instructional module for diagnosing faults in an aircraft power-distribution system (Towne, 1997)
|
From page 167... ...
Nevertheless, researchers are making progress in using simulations for assessing complex problem solving comparable to the skills required for technological literacy. For instance, one promising approach is based on evidence-centered design (ECD)
|
From page 168... ...
However, as noted, development costs may be higher than for more traditional test methods. Computer-Based and Web-Based Games Games, especially games available over the World Wide Web, may also be useful for assessing technological literacy.
|
From page 169... ...
A computer game that assesses technological literacy could be a national assessment instrument for identifiable segments of the population. If players allow their responses to be anonymously collected and pooled, a well designed game that taps into technological knowledge and capability could become an unobtrusive, continuous, self-motivating, and inexpensive source of diagnostic information on the levels of technological literacy of different segments of the national population.
|
From page 170... ...
. Electronic To the committee's knowledge, electronic portfolios have not portfolios been used in the United States to assess technological literacy as defined in appear to be this report.
|
From page 171... ...
, and have them assessed digitally. In addition to computers and CAD software, other technologies that might enrich electronic portfolios are being considered, such as digital pens that can store what has been written and drawn with them; personal digital assistants that can store task-related data; and speech-to-text software that can enable sharing and analysis of design discussions.
|
From page 172... ...
1999. Using networked simulation to assess problem solving by tactical teams.
|
From page 173... ...
1996. Computerized adaptive skill assessment in a statewide testing program.
|
From page 174... ...
Minneapolis, Minn.: Computerized Adaptive Testing Laboratory, Uni versity of Minnesota. Weiss, D.J.
|
Key Terms
This material may be derived from roughly machine-read images, and so is provided only to facilitate research.
More
information on Chapter Skim is available.