This Article Full Text Full Text (PDF) Alert me when this article is cited Alert me if a correction is posted Services Similar articles in this journal Similar articles in PubMed Alert me to new issues of the journal Download to citation manager Citing Articles Citing Articles via HighWire Citing Articles via Google Scholar Google Scholar Articles by Taylor, J. M.G. Articles by Andridge, R. R. Search for Related Content PubMed PubMed Citation Articles by Taylor, J. M.G. Articles by Andridge, R. R. Related Collections Epidemiology and Prevention Epidemiology and Prevention: Genetics and Biomarkers Clinical Research Clinical Research: Imaging, Diagnosis, and Prognosis

Validation of Biomarker-Based Risk Prediction Models

Authors' Affiliations: ¹ Department of Biostatistics, University of Michigan, Ann Arbor, Michigan and ² Departments of Urology and Epidemiology and Biostatistics, University of Texas Health Science Center at San Antonio, San Antonio, Texas

Requests for reprints: Jeremy M.G. Taylor, University of Michigan, Biostatistics, 1420 Washington Heights, Ann Arbor, MI 48109. Phone: 734-936-3287; Fax: 734-763-2215; E-mail: jmgt{at}umich.edu.

Abstract

The increasing availability and use of predictive models to facilitate informed decision making highlights the need for careful assessment of the validity of these models. In particular, models involving biomarkers require careful validation for two reasons: issues with overfitting when complex models involve a large number of biomarkers, and interlaboratory variation in assays used to measure biomarkers. In this article, we distinguish between internal and external statistical validation. Internal validation, involving training-testing splits of the available data or cross-validation, is a necessary component of the model building process and can provide valid assessments of model performance. External validation consists of assessing model performance on one or more data sets collected by different investigators from different institutions. External validation is a more rigorous procedure necessary for evaluating whether the predictive model will generalize to populations other than the one on which it was developed. We stress the need for an external data set to be truly external, that is, to play no role in model development and ideally be completely unavailable to the researchers building the model. In addition to reviewing different types of validation, we describe different types and features of predictive models and strategies for model building, as well as measures appropriate for assessing their performance in the context of validation. No single measure can characterize the different components of the prediction, and the use of multiple summary measures is recommended.

This article has been cited by other articles:

				G. C. Prendergast Clinical Research: Effective Integration of Laboratory Advances Into Clinical Trials Cancer Reviews Online Content, January 1, 2008; 2008(11): 21 - 21. [Full Text] [PDF]