experience and report. The time and level of effort necessary will be somewhat higher than the expected norm, because the pilot will be the vehicle for the preparation of templates, interview guides, metrics, virtual case study procedures, and experience interpreting data from national and international sources. It will also include the final workshop for evaluation.

Establish Template and Metrics

One of the earliest tasks in the pilot project will be to prepare the template for the National Knowledge System. The National Knowledge System itself will be specific for the country and reflect the reality of the economy, institutions, government organization, industry structure, and educational system. The template, however, will be general. It will include the functions that relate to the motivation, creation, access, assimilation, diffusion, and use of knowledge in the society, an expansion and refinement of table 1 . The draft template will be prepared by the knowledge assessment team and refined in collaboration with World Bank staff, and during the pilot project it will presented in draft for discussion by the national symposium. (Normally the national symposium will see only the finished template and proceed directly to the mapping of the National Knowledge System.)

The metrics that will be used as a standard for these functions will arise from the virtual case studies. These metrics will be used for both constructing base-line data and establishing benchmarks based on best practice.

Proving the Process

The main goal of the pilot project is to demonstrate that the knowledge assessment process will produce practical, effective recommendations in a reasonable time. The optimal number of participants in the national symposium, the time necessary, the ideal time interval between the national symposium and the visit of the team for the virtual case studies, the skill mix of the team, the number of sentinel enterprises, the time to be allotted for each, the time and effort necessary for preparation of the report to the government and the World Bank, and, not least, the cost, can best be estimated after completion of the pilot.

Feedback and Evaluation

The response of host nationals and government will guide the institutionalization of the knowledge assessment process, and the final workshop held after the submission of the report will secure feedback from the participants and recipients.

Evaluation will be an important element of the pilot, in two senses. During the pilot the process itself will be evaluated, and a part of the national symposium and each virtual case study will be dedicated to discussion and improvement of the process. Questionnaires and other evaluation instruments will be attached to the interview guides, templates, and other documentation, and distributed to participants at the national symposium and virtual case studies. Second, a system for evaluation of the results of the knowledge assessment will be built into the process, so that the changes that are adopted by governments and the private sector, and the number of real knowledge-based enterprises that are created, will be recorded.

Manual of Operations

The experience gained in the pilot project and the subsequent evaluations will be codified into a manual of operations for knowledge assessment that can be used generally by uninitiated implementers, including teams hired by the host countries themselves. This could be incorporated into a data base on the Internet, where it could include continually updated users' comments and suggestions as part of the manual.


The time necessary to complete the pilot project, prepare the manual and produce a workable system that can be used in other settings will be slightly over one year. Specific activities are shown below in relation to the commencement of the pilot project.


















Recruit & train team




National symposium


Team visit


virtual case studies




data compilation







Team retreat and report writing


Followup workshop and evaluation


Report and manual publication


The National Academies | 500 Fifth St. N.W. | Washington, D.C. 20001
Copyright © National Academy of Sciences. All rights reserved.
Terms of Use and Privacy Statement