Variable selection under multiple imputation using the bootstrap in a prognostic study
article
Background. Missing data is a challenging problem in many prognostic studies. Multiple imputation (MI) accounts for imputation uncertainty that allows for adequate statistical testing. We developed and tested a methodology combining MI with bootstrapping techniques for studying prognostic variable selection. Method. In our prospective cohort study we merged data from three different randomized controlled trials (RCTs) to assess prognostic variables for chronicity of low back pain. Among the outcome and prognostic variables data were missing in the range of 0 and 48.1%. We used four methods to investigate the influence of respectively sampling and imputation variation: MI only, bootstrap only, and two methods that combine MI and bootstrapping. Variables were selected based on the inclusion frequency of each prognostic variable, i.e. the proportion of times that the variable appeared in the model. The discriminative and calibrative abilities of prognostic models developed by the four methods were assessed at different inclusion levels. Results. We found that the effect of imputation variation on the inclusion frequency was larger than the effect of sampling variation. When MI and bootstrapping were combined at the range of 0% (full model) to 90% of variable selection, bootstrap corrected c-index values of 0.70 to 0.71 and slope values of 0.64 to 0.86 were found. Conclusion. We recommend to account for both imputation and sampling variation in sets of missing data. The new procedure of combining MI with bootstrapping for variable selection, results in multivariable prognostic models with good performance and is therefore attractive to apply on data sets with missing values. © 2007 Heymans et al; licensee BioMed Central Ltd.
Topics
Leefomgeving en gezondheidadultamputationarticlebootstrappingchronic painclinical trialcohort analysisfemalehumanlow back painmajor clinical studymaleprognosisprospective studyrandomizationbiometrychronic diseasemethodologyNetherlandsoutcome assessmentrandomized controlled trialstatistical analysisstatistical modelstatisticsuncertaintyBiometryChronic DiseaseCohort StudiesData Interpretation, StatisticalFemaleHumansLow Back PainMaleModels, StatisticalNetherlandsOutcome Assessment (Health Care)PrognosisProspective StudiesRandomized Controlled TrialsUncertainty
TNO Identifier
240140
ISSN
14712288
Source
BMC Medical Research Methodology, 7
Article nr.
33