Skip to main content
Account

Table 1 Listing of the considered interval procedures per performance measure and selection rule

From: Post-selection confidence bounds for prediction performance

Selection rule

Prediction accuracy

AUC

Single best

BT*

BT

 

Wald

DeLong

 

Wilson

HM

 

CP

 

Top 10%

MABT

MABT

 

BT + Šidák*

BT + Šidák

 

Wald + Šidák

DeLong + Šidák

 

Wilson + Šidák

HM + Šidák

 

CP + Šidák

 

Within 1 SE

MABT

MABT

 

BT + Šidák*

BT + Šidák

 

Wald + Šidák

DeLong + Šidák

 

Wilson + Šidák

HM + Šidák

 

CP + Šidák

 
  1. The within 1 SE selection rule is only considered when CV is used to estimate the validation performance. Procedures that carry the superscript \(*\) are only included in case of the linear lasso classifer