An Agenda for Improved Evaluation of Supercomputer Performance (1986) / Chapter Skim
Currently Skimming:
Summary
Summary
Pages 1-8
The Chapter Skim interface presents what we've algorithmically identified as the most significant single chunk of text within every page in the chapter.
Select key terms on the right to highlight them within pages of the chapter.
From page 1... ...
at this time, no commonly accepted methodology for the evaluation of the performance of supercomputer systems and no standard set of metrics for the representation of performance. More powerful evaluation methods are essential for comparing competing systems, allocating available machine resources, matching specific computing tasks to specific hardware, and 1
|
From page 2... ...
In a real sense, research in new computer architectural concepts drives the need for performance evaluation soundly based in theory. In recognition of this problem, this committee was to review the state of the art in supercomputer performance evaluation, to identify reasonable expectations for improvement, and to sketch an agenda for research that would lead to the desired improvements.
|
From page 3... ...
~ The questions central to the evaluation of supercomputer performance are different in nature from those addressed by the established methods of computer performance analysis; for this reason established methods have not been successfully applied. For example, many current performance models for supercomputers emphasize processor speed in terms of hardware features (instructions, floating point operations, logical inferences, and so forth)
|
From page 4... ...
A central issue in understanding performance measurements on supercomputers involves the pairing of architectures and applications. Recent work on the study of architectural and algorithmic taxonomies has identified differences that are critical to performance; further work could lead to the successful development of useful and scientific performance models and more systematic, comprehensive benchmarks.
|
From page 5... ...
Department of Defense, including the Office of Naval Research and the Defense Advanced Research Projects Agency. These activities reflect the increased importance, and need for progress, in supercomputer performance evaluation.
|
From page 6... ...
assess and disseminate research results with a view to bringing about commonly accepted methodologies of supercomputer performance evaluation. A number of centers supported by the Defense Advanced Research Projects Agency and the Office of Naval Research are actively evaluating
|
From page 7... ...
Although the development of standards is certainly not appropriate now, the development and distribution of a coherent set of measurement criteria Is . The committee believes it would be desirable for one or two of the federal funding agencies, perhaps in cooperation with others, to establish a group of experts who would, over a period of time, collect and evaluate research results and experience in the area of supercomputer performance evaluation and attempt to translate it into a broadly usable collection of methods and measures.
|
Key Terms
This material may be derived from roughly machine-read images, and so is provided only to facilitate research.
More
information on Chapter Skim is available.