Skip to main content

Table 2 Quantiles of C-statistic, calibration-in-the-large MAPEpractical and net benefit of the 1000 models, for each sample size

From: Impact of sample size on the stability of risk scores from clinical prediction models: a case study in cardiovascular disease

  

Female

Male

 

Sample size

2.5%

25%

50%

75%

97.5%

2.5%

25%

50%

75%

97.5%

C-statistic

Nmin

0.802

0.852

0.857

0.861

0.864

0.805

0.827

0.831

0.835

0.839

Nepv10

0.856

0.861

0.863

0.865

0.867

0.826

0.834

0.837

0.839

0.841

10,000

0.865

0.866

0.867

0.867

0.868

0.840

0.841

0.842

0.843

0.843

50,000

0.867

0.868

0.868

0.868

0.868

0.843

0.843

0.843

0.843

0.844

100,000

0.868

0.868

0.868

0.868

0.868

0.843

0.843

0.843

0.844

0.844

Calibration-in-the-large

Nmin

−2.22

−1.43

−0.95

−0.47

0.39

−2.56

−1.49

−1.01

−0.45

0.56

Nepv10

−1.85

−1.27

−0.97

−0.64

−0.11

−2.23

−1.47

−1.02

−0.60

0.29

10,000

−1.45

−1.13

−0.95

−0.78

−0.44

−1.61

−1.20

−1.01

−0.80

−0.39

50,000

−1.18

−1.03

−0.95

−0.87

−0.73

−1.28

−1.11

−1.02

−0.93

−0.77

100,000

−1.11

−1.01

−0.96

−0.90

−0.79

−1.21

−1.08

−1.02

−0.95

−0.85

Mapepractical

Nmin

1.13

1.53

1.75

2.00

2.46

1.34

1.79

2.04

2.34

2.91

Nepv10

0.76

1.03

1.20

1.36

1.74

1.00

1.36

1.57

1.78

2.26

10,000

0.42

0.55

0.63

0.73

0.90

0.48

0.63

0.73

0.85

1.04

50,000

0.19

0.25

0.28

0.32

0.40

0.21

0.29

0.33

0.37

0.45

100,000

0.13

0.17

0.20

0.22

0.28

0.14

0.20

0.23

0.26

0.32

Net benefit

Nmin

0.017

0.019

0.020

0.021

0.021

0.024

0.026

0.027

0.028

0.029

Nepv10

0.020

0.021

0.021

0.021

0.022

0.026

0.027

0.028

0.028

0.029

10,000

0.021

0.021

0.021

0.022

0.022

0.028

0.028

0.028

0.029

0.029

50,000

0.021

0.022

0.022

0.022

0.022

0.028

0.029

0.029

0.029

0.029

100,000

0.021

0.022

0.022

0.022

0.022

0.028

0.029

0.029

0.029

0.029

  1. Performance metrics of the population derived models were as follows. C-statistic: 0.868 (female) and 0.844 (male). Calibration-in-the-large: −0.95% (female) and −1.02% (male). Net benefit: 0.022 (female) and 0.029 (male)