Skip to main content

A Guide to the Methodology of the National Research Council Assessment of Doctorate Programs (2009) / Chapter Skim
Currently Skimming:

5 An Example
Pages 19-32

The Chapter Skim interface presents what we've algorithmically identified as the most significant single chunk of text within every page in the chapter.
Select key terms on the right to highlight them within pages of the chapter.


From page 19...
... ; and (3) the standardized program values and the actual combined coefficients that were used to calculate the rating corresponding to each endpoint of the inter-quartile range of rankings for that program, as well as the program ranking corresponding to those ratings (see Tables 5-2a and 52b)
Read the entire page →
From page 20...
... students w/ full support V9 100.00% 0.980 0.036 to 0.056 Percent 1st yr students with portable fellowships V10 0.00% -0.544 0.021 to 0.033 Percent Non-Asian Minority Students V11 10.00% 0.069 n.s.# n.s.# Percent Female Students V12 44.40% 0.678 -0.038 to -0.030 # Percent International Students V13 53.30% -0.509 n.s. n.s.# Average PhDs 2002 to 2006 V14 5.4 -0.355 0.120 to 0.144 Percent Completing within 6 years V15 27.60% -0.638 n.s.# n.s.# Time to Degree Full and Part Time V16 5.67 0.232 -0.028 to -0.017 Percent students in Academic Positions V17 11.10% -1.405 0.049 to 0.065 Student Work Space V18 1 1 n.s.# n.s.# # Health Insurance V19 1 1 n.s.
Read the entire page →
From page 21...
... Half of the 500 randomly generated rankings for the program fall within this range31. The ratings that produced these first and third quartile rankings are -0.054 and 0.085, as shown in Tables 5-2a and 5-2b.32 30 The first quartile ranking is the highest value of the lowest quarter of rankings.
Read the entire page →
From page 22...
... n.c. # Average PhDs 2002 to 2006 V14 5.4 -0.379 0.152 -0.058 # Percent Completing within 6 years V15 27.6% -0.574 n.s.
Read the entire page →
From page 23...
... n.c. # Average PhDs 2002 to 2006 V14 5.4 -0.196 0.121 -0.024 # Percent Completing within 6 years V15 27.6% -0.725 n.s.
Read the entire page →
From page 24...
... In the case of economics, the important variables are citations per publication, publications per allocated faculty, average Ph.D.'s in 2002-2006, and average GRE-Q, each of which has a combined coefficient value of 0.089 or greater. The rest of the variables are less heavily weighted, and a number of the variables don't enter into the determination of the overall rating at all because their coefficients were not statistically different from 033.
Read the entire page →
From page 25...
... TABLE 5-3 Descriptive Statistics for the Variables used in the Ratings: All Economics Programs 1st 3rd Standard Minimum Quartile Quartile Maximum Deviation Publications per Allocated Faculty 0.049 0.369 0.655 1.357 0.246 Cites per Publication 0.153 0.684 1.771 5.485 1.002 Percent of Faculty with Grants 0.0% 24.0% 50.0% 100.0% 19.9% Percent Faculty Interdisciplinary 0.0% 2.1% 26.9% 68.4% 16.3% Percent Non-Asian Minority Faculty 0.0% 0.0% 7.7% 25.0% 5.3% Percent Female Faculty 0.0% 10.5% 21.1% 66.7% 9.9% Awards per allocated faculty 0.000 0.000 0.462 5.131 0.890 Average GRE-Q 353 740 790 800 55 Percent 1st yr. students w/ full support 0.0% 50.0% 100.0% 100.0% 29.2% Percent 1st yr students with portable fellowships 0.0% 0.0% 9.1% 66.7% 14.2% Percent Non-Asian Minority Students 0.0% 0.0% 14.3% 50.0% 9.8% Percent Female Students 0.0% 28.6% 42.9% 76.9% 12.0% Percent International Students 0.0% 52.4% 76.3% 98.2% 19.6% Average Ph.D.s 2002 to 2006 1.00 3.20 9.80 26.40 5.73 Percent Completing within 6 years 0.0% 28.3% 51.0% 91.7% 19.1% Time to Degree Full and Part Time 3.00 5.00 6.00 8.00 0.80 Percent students in Academic Positions 4.2% 17.6% 39.6% 56.5% 12.5% Student Work Space -1 -1 1 1 0.985 Health Insurance -1 1 1 1 0.672 Number of student activities offered 4 15 18 18 2.161 25 PREPUBLICATION COPY -- UNEDITED PROOFS
Read the entire page →
From page 26...
... Highest Lowest Highest Lowest Quartile Quartile Highest Lowest Highest Lowest Quartile Quartile Student Student Quartile Quartile Quartile Quartile Table 5-4 Correlations Matrix- Research Research Support Support Diversity Diversity Overall Overall Economics Rating Rating Rating Rating Rating Rating Rating Rating 3rd Quartile Research Rating 1.00 1st Quartile Research Rating 1.00 1.00 3rd Quartile Student Support Rating 0.39 0.39 1.00 1st Quartile Student Support Rating 0.38 0.38 1.00 1.00 3rd Quartile Diversity Rating -0.24 -0.25 -0.24 -0.23 1.00 1st Quartile Diversity Rating -0.25 -0.25 -0.24 -0.24 1.00 1.00 3rd Quartile Overall Rating 0.95 0.94 0.45 0.44 -0.23 -0.24 1.00 1st Quartile Overall Rating 0.95 0.95 0.44 0.43 -0.23 -0.23 1.00 1.00 Publications per Allocated Faculty 0.78 0.79 0.32 0.31 -0.23 -0.24 0.64 0.64 Cites per Publication 0.86 0.84 0.33 0.32 -0.16 -0.17 0.90 0.90 Percent of Faculty with Grants 0.55 0.56 0.09 0.08 -0.12 -0.12 0.51 0.52 Percent Faculty Interdisciplinary 0.05 0.05 0.14 0.14 -0.12 -0.13 0.10 0.11 Percent Non-Asian Minority Faculty 0.03 0.03 0.10 0.10 0.39 0.37 0.00 0.00 Percent Female Faculty -0.19 -0.20 -0.26 -0.26 0.45 0.45 -0.21 -0.21 Awards per allocated faculty 0.77 0.76 0.41 0.40 -0.21 -0.22 0.77 0.77 Average GRE-Q 0.52 0.51 0.23 0.22 -0.08 -0.08 0.66 0.65 Percent 1st yr. students w/ full support 0.21 0.21 0.58 0.58 0.00 -0.01 0.24 0.24 Percent 1st yr students with portable fellowships 0.34 0.34 0.21 0.22 -0.13 -0.12 0.37 0.37 Percent Non-Asian Minority Students -0.12 -0.12 0.02 0.02 0.49 0.47 -0.13 -0.13 Percent Female Students -0.29 -0.28 -0.33 -0.33 0.40 0.41 -0.35 -0.34 Percent International Students -0.10 -0.10 -0.14 -0.14 0.67 0.69 -0.03 -0.03 Average Ph.D.s 2002 to 2006 0.58 0.57 0.04 0.03 -0.11 -0.11 0.70 0.70 Percent Completing within 6 years 0.50 0.50 0.57 0.56 -0.32 -0.32 0.54 0.54 Time to Degree Full and Part Time -0.14 -0.16 -0.36 -0.34 -0.07 -0.07 -0.10 -0.10 Percent students in Academic Positions 0.20 0.20 0.71 0.73 -0.20 -0.20 0.27 0.27 26 PREPUBLICATION COPY -- UNEDITED PROOFS
Read the entire page →
From page 27...
... per Faculty Asian Percent per students with Allocated Cites per with Percent Faculty Minority Female allocated Average w/ full portable Faculty Publication Grants Interdisciplinary Faculty Faculty faculty GRE-Q support fellowships 3rd Quartile Research Rating 1st Quartile Research Rating 3rd Quartile Student Support Rating 1st Quartile Student Support Rating 3rd Quartile Diversity Rating 1st Quartile Diversity Rating 3rd Quartile Overall Rating 1st Quartile Overall Rating Publications per Allocated Faculty 1.00 Cites per Publication 0.40 1.00 Percent of Faculty with Grants 0.36 0.37 1.00 Percent Faculty Interdisciplinary -0.08 0.08 0.04 1.00 Percent Non-Asian Minority Faculty 0.06 -0.02 0.12 -0.02 1.00 Percent Female Faculty -0.29 -0.06 0.01 -0.08 0.10 1.00 Awards per allocated faculty 0.42 0.70 0.28 0.20 -0.03 -0.21 1.00 Average GRE-Q 0.37 0.52 0.16 0.10 -0.19 -0.26 0.38 1.00 Percent 1st yr. students w/ full support 0.20 0.16 0.06 0.08 0.17 -0.17 0.20 0.23 1.00 Percent 1st yr students with portable fellowships 0.13 0.36 0.14 0.05 -0.14 -0.19 0.43 0.14 0.12 1.00 Percent Non-Asian Minority Students -0.09 -0.11 -0.18 0.01 0.42 0.07 0.01 -0.21 -0.01 0.04 Percent Female Students -0.24 -0.22 -0.06 0.00 0.05 0.18 -0.30 -0.15 -0.04 -0.08 27 PREPUBLICATION COPY -- UNEDITED PROOFS
Read the entire page →
From page 28...
... Percent International Students -0.09 -0.06 -0.10 -0.14 -0.10 0.06 -0.09 0.25 0.02 -0.03 Average Ph.D.s 2002 to 2006 0.33 0.53 0.38 0.11 -0.04 -0.08 0.55 0.44 -0.07 0.20 Percent Completing within 6 years 0.31 0.52 0.09 0.10 -0.17 -0.13 0.52 0.34 0.24 0.28 Time to Degree Full and Part Time -0.19 -0.09 -0.06 0.06 -0.12 -0.03 -0.06 0.04 -0.05 -0.03 Percent students in Academic Positions 0.15 0.15 0.03 0.14 0.13 -0.27 0.28 0.10 0.11 0.11 Student Work Space 0.17 0.12 0.12 -0.02 0.04 -0.13 -0.06 0.12 0.23 0.06 Health Insurance 0.19 0.21 0.13 0.03 0.10 -0.12 0.12 0.22 0.17 -0.21 Number of student activities offered -0.07 0.12 0.12 0.12 0.15 -0.04 0.00 0.13 -0.05 -0.08 28 PREPUBLICATION COPY -- UNEDITED PROOFS
Read the entire page →
From page 29...
... students w/ full support Percent 1st yr students with portable fellowships Percent Non-Asian Minority Students 1.00 Percent Female Students 0.05 1.00 Percent International Students -0.04 0.05 1.00 Average Ph.D.s 2002 to 2006 -0.10 -0.27 0.06 1.00 Percent Completing within 6 years -0.13 -0.36 -0.13 0.28 1.00 Time to Degree Full and Part Time -0.08 0.01 -0.01 0.10 -0.33 1.00 Percent students in Academic Positions 0.11 -0.25 -0.18 0.03 0.22 -0.03 1.00 29 PREPUBLICATION COPY -- UNEDITED PROOFS
Read the entire page →
From page 30...
... Student Work Space -0.04 -0.04 -0.08 -0.15 0.26 -0.26 0.09 1.00 Health Insurance -0.17 -0.11 -0.01 0.16 0.06 0.01 0.10 -0.05 1.00 Number of student activities offered 0.02 -0.11 0.05 0.16 -0.02 0.09 0.10 -0.05 0.19 1.00 30 PREPUBLICATION COPY -- UNEDITED PROOFS
Read the entire page →
From page 31...
... The example is intended to explain to the reader how ratings are calculated, and how a range of rankings is constructed. Shortly before the study results are released, each institutional coordinator will receive tables similar to the tables above, showing the program data, the range of coefficients for each variable, the calculation of the first and third quartile rating, and the corresponding ranking for each rated program at the institution.
Read the entire page →

Key Terms

  • allocated faculty
  • percent female
  • combined coefficients
  • quartile student
  • overall rating

  • quartile overall
  • quartile research
  • quartile diversity
  • percent faculty
  • student support

  • student activities
  • student work
  • support rating
  • research rating
  • diversity rating

  • work space
  • activities offered
  • third quartile
  • quartile ranking
  • percent international

  • percent students
  • faculty interdisciplinary
  • program values
  • female students
  • international students

  • academic positions
  • portable fellowships
  • female faculty
  • standardized program
  • program value


    • This material may be derived from roughly machine-read images, and so is provided only to facilitate research.
    More information on Chapter Skim is available.