Sample size calculations for the experimental comparison of multiple algorithms on multiple problem instances

This work presents a statistically principled method for estimating the required number of instances in the experimental comparison of multiple algorithms on a given problem class of interest. This approach generalises earlier results by allowing researchers to design experiments based on the desire...

Full description

Bibliographic Details

Published in:	Journal of heuristics Vol. 26; no. 6; pp. 851 - 883
Main Authors:	Campelo, Felipe, Wanner, Elizabeth F.
Format:	Journal Article
Language:	English
Published:	New York Springer US 01.12.2020 Springer Nature B.V
Subjects:	Algorithms Artificial Intelligence Calculus of Variations and Optimal Control; Optimization Management Science Mathematical analysis Mathematics Mathematics and Statistics Operations Research Operations Research/Decision Theory Simulated annealing Iterative sampling Statistical methods Multiple hypotheses testing Sample size estimation Experimental comparison of algorithms
ISSN:	1381-1231, 1572-9397
Online Access:	Get full text
Tags:	Add Tag No Tags, Be the first to tag this record!