Skip to main content

Table 2 Quantiles of C-statistic, calibration-in-the-large MAPEpractical and net benefit of the 1000 models, for each sample size

From: Impact of sample size on the stability of risk scores from clinical prediction models: a case study in cardiovascular disease

   Female Male
  Sample size 2.5% 25% 50% 75% 97.5% 2.5% 25% 50% 75% 97.5%
C-statistic Nmin 0.802 0.852 0.857 0.861 0.864 0.805 0.827 0.831 0.835 0.839
Nepv10 0.856 0.861 0.863 0.865 0.867 0.826 0.834 0.837 0.839 0.841
10,000 0.865 0.866 0.867 0.867 0.868 0.840 0.841 0.842 0.843 0.843
50,000 0.867 0.868 0.868 0.868 0.868 0.843 0.843 0.843 0.843 0.844
100,000 0.868 0.868 0.868 0.868 0.868 0.843 0.843 0.843 0.844 0.844
Calibration-in-the-large Nmin −2.22 −1.43 −0.95 −0.47 0.39 −2.56 −1.49 −1.01 −0.45 0.56
Nepv10 −1.85 −1.27 −0.97 −0.64 −0.11 −2.23 −1.47 −1.02 −0.60 0.29
10,000 −1.45 −1.13 −0.95 −0.78 −0.44 −1.61 −1.20 −1.01 −0.80 −0.39
50,000 −1.18 −1.03 −0.95 −0.87 −0.73 −1.28 −1.11 −1.02 −0.93 −0.77
100,000 −1.11 −1.01 −0.96 −0.90 −0.79 −1.21 −1.08 −1.02 −0.95 −0.85
Mapepractical Nmin 1.13 1.53 1.75 2.00 2.46 1.34 1.79 2.04 2.34 2.91
Nepv10 0.76 1.03 1.20 1.36 1.74 1.00 1.36 1.57 1.78 2.26
10,000 0.42 0.55 0.63 0.73 0.90 0.48 0.63 0.73 0.85 1.04
50,000 0.19 0.25 0.28 0.32 0.40 0.21 0.29 0.33 0.37 0.45
100,000 0.13 0.17 0.20 0.22 0.28 0.14 0.20 0.23 0.26 0.32
Net benefit Nmin 0.017 0.019 0.020 0.021 0.021 0.024 0.026 0.027 0.028 0.029
Nepv10 0.020 0.021 0.021 0.021 0.022 0.026 0.027 0.028 0.028 0.029
10,000 0.021 0.021 0.021 0.022 0.022 0.028 0.028 0.028 0.029 0.029
50,000 0.021 0.022 0.022 0.022 0.022 0.028 0.029 0.029 0.029 0.029
100,000 0.021 0.022 0.022 0.022 0.022 0.028 0.029 0.029 0.029 0.029
  1. Performance metrics of the population derived models were as follows. C-statistic: 0.868 (female) and 0.844 (male). Calibration-in-the-large: −0.95% (female) and −1.02% (male). Net benefit: 0.022 (female) and 0.029 (male)