posted on 2019-10-08, 09:50authored byLingfei Wang, Tom Michoel
Crowd wisdom outperformed supervised learning in cross-validation. Empirical distributions and medians of AUROC (left) and AUPR (right) of all crowd wisdom and supervised learning methods in 200 cross-validations with 25%, 40%, 60%, 80%, or 90% (A to E) random partitions of training data are shown for the skin cancer classification dataset. Method names include the numbers of nearest neighbors in brackets, and are italicized for supervised classifiers. Numbers next to the frames represent rankings of the methods in terms of median AUROC or AUPR. Colors reflect methods' relative rankings in performance.