Skip to main content

Table 3 Calibration test results on external validation dataset. Calibration-in-the-large indicates whether predicted probabilities are, on average, too high (value below 0) or too low (value above 0). Conversely, the calibration slope quantifies whether predicted risks are, on average, too extreme (value below 1) or too invariant (value above 1)

From: Logistic regression has similar performance to optimised machine learning algorithms in a clinical setting: application to the discrimination between type 1 and type 2 diabetes in young adults

Model

Calibration slope (bL)

Calibration-in-the-large (a|bL = 1)

Gradient boosting machine

0.979

− 0.005

K-nearest neighbours

1.495

0.046

Logistic regression

0.903

− 0.039

MARS

0.799

0.081

Neural network

0.995

− 0.031

Random forest

1.412

0.065

Support vector machine

0.914

− 0.028