at Leiden is very active in this area, as is the Science Policy Research Unit at Sussex University in the United Kingdom. Similar work is done in Manchester, England. A number of other groups in Europe also carry out large scale bibliometrics research. In part this is because many European countries have a centralized responsibility for science (centralized in one agency or group) and within the European Economic Community there are central groups responsible for the function of the scientific establishment. Europeans thus have an administrative motivation to look at science as a whole and to try to develop tools for measuring performance.

We also do a lot of work in technology-oriented areas and in "patents citing patents." Most of this work is done for private clients and is not publicly available. We do a lot of competitive intelligence work and cross-licensing work as well as technology tracing. We have written papers about this work, but generally we do not say much about it.

In this article I discuss the third type of bibliometrics(the linkage of patents to scientific papers. To carry out such studies, we have standardized more than 1 million references to science from the front pages of U.S. and European patents (see Figure 6.1). We put them into a standard "journal, volume,

Front Matter (R1-R12)

Summary (1-5)

1 Measuring the Return on Investment in R&D: Voices from the Past, Visions of the Future (6-17)

2 The Sources of Commercial Technological Innovation (18-27)

Panel Discussion: Introductory Session (28-32)

3 Assessing the Value of Research at IBM (33-42)

4 Evaluating Materials Chemistry Research (43-49)

5 The Technology Value Pyramid (50-55)

Panel Discussion: Industrial Session (56-58)

6 Patents and Publicly Funded Research (59-72)

7 Research as a Critical Component of the Undergraduate Educational Experience (73-81)

8 Scholarly Research: Oxymoron, Redundancy, or Necessity? (82-88)

9 Assessing the University-Industrial Interactions (89-93)

Panel Discussion: Academic Session (94-96)

10 Assessing the Value of Research at the Department of Energy: A Perspective from the Office of Basic Energy Sciences (97-106)

11 Assessing the Value of Research at the National Science Foundation (107-111)

12 National Institutes of Health Response to the Government Performance and Results Act (112-115)

Panel Discussion: Government Session (116-118)

A Workshop Participants (119-123)

B Origin of and Information on the Chemical Sciences Roundtable (124-125)