Criteria Of Efficiency

In the case of classification, an early criterion of efficiency was the percentage of multiple prediction regions (i.e., prediction regions containing more than one label) output on a test set. Vovk et al. (2017) argue that this criterion has serious disadvantages and propose a class of criteria of efficiency that they call "probabilistic". An example of a probabilistic criterion is the average size of the prediction region.