standards and should thoroughly document application of the process for each assessment. Doing so will make it easier for the board to maintain the highest possible validity for the resulting assessments and to provide evidence suitable for independent evaluation of that validity.
Recommendation 5-3: The NBPTS should conduct research to determine whether the reliability of the assessment process could be improved (for example, by the inclusion of a number of shorter exercises in the computer-based component) without compromising the authenticity or validity of the assessment or substantially increasing its cost.
Recommendation 5-4: The NBPTS should collect and use the available operational data about the individual assessment exercises to improve the validity and reliability of the assessments for each certificate, as well as to minimize adverse impact.
Recommendation 5-5: The NBPTS should revisit the methods it uses to estimate the reliabilities of its assessments to determine whether the methods should be updated.
Recommendation 5-6: The NBPTS should periodically review the assessment model to determine whether adjustments are warranted to take advantage of advances in measurement technologies and developments in the teaching environment.