Evaluation of the Markey Scholars Program (2006) / Chapter Skim
Currently Skimming:
3 Evaluation Methodology
3 Evaluation Methodology
Pages 21-29
The Chapter Skim interface presents what we've algorithmically identified as the most significant single chunk of text within every page in the chapter.
Select key terms on the right to highlight them within pages of the chapter.
From page 21... ...
The committee recognized that there were two aspects of the Markey award that could account for differences between the Markey Scholars and a comparable group of postdoctoral fellows. One was the process used to select Markey Scholars, a process designed to ensure that only outstanding researchers were selected.
|
From page 22... ...
Success in achieving extramural funding, especially a traditional NIH research program award (R01) In addition, the committee determined that the use of a comparison group would strengthen its ability to assess the relative impact of the Markey award on the Scholars' outcomes.
|
From page 23... ...
For the publication analysis, counts were made of journal articles listed on an individual's CV for a 14-year period beginning with the year in which the individual received or would have received the Markey Scholar Award. The 14-year range was chosen because it was assumed that all individuals in the study would have achieved their first professional position (i.e., became faculty members if they stayed in academia)
|
From page 24... ...
Using current CVs for Scholars and for both candidate groups, NRC staff linked journal articles from the CV for the 14-year period used in counting publications (see above and Figure 3-1) to the ISI citation database which provided citations for these articles for the period through 2004.
|
From page 25... ...
At a minimum, these data consisted of the application package described earlier. For Scholars, additional data elements consisted of annual progress reports, equipment and supply expense statements, correspondence with the Trust's Miami office, and comments and assessments from the Scholar Selection Committee.
|
From page 26... ...
which was assumed to have occurred within four years of the point in time in which an individual received or would have received the Markey Scholar Award. These intervals were based on the committee's analysis of the postdoctoral experience of Scholars and were designed to ensure that all Scholars had completed their postdoctoral experience and assumed a professorial or professional position.
|
From page 27... ...
The services of Equifax, a credit reporting agency, were used to obtain current contact information for reviewed nominees. Equifax was able to supply some
|
From page 28... ...
As a consequence, the number of locatable persons from the first cycle of nominations for both top-ranked candidates and competitive candidates was much lower than anticipated and lower than for any other cycle. NRC staff attempted to obtain current location information on the candidates who could not be located by Equifax by using web searches and checking for affiliations of authors in relevant journals.
|
From page 29... ...
The committee recognizes that the lower than desired response rate for top-ranked and competitive candidates might affect the validity of the evaluation.Also, the committee is especially concerned about the very low number of candidates in the initial cycles of Markey funding. These very low numbers preclude potential analyses by funding cycle.
|
Key Terms
This material may be derived from roughly machine-read images, and so is provided only to facilitate research.
More
information on Chapter Skim is available.