Paradox-Free Data Analysis in Numerical Comparisons of Optimization Algorithms: A Review and Case Study

Numerical comparison is essential for evaluating an optimization algorithm. Unfortunately, recent research has shown that two paradoxes may occur, namely the cycle ranking paradox and survival of the nonfittest paradox. Further exploitation reveals that these paradoxes stem from the method of data a...

Full description

Saved in:
Bibliographic Details
Published in:International journal of swarm intelligence research Vol. 15; no. 1; pp. 1 - 22
Main Authors: Zhi, Yunchao, Liu, Qunfeng, Yan, Yuan, Jing, Yunpeng
Format: Journal Article
Language:English
Published: Hershey IGI Global 01.01.2024
Subjects:
Algorithms
Case studies
Data analysis
Design optimization
Distribution functions
Hypotheses
Hypothesis testing
Methods
Optimization algorithms
Paradoxes
Probability
ISSN:1947-9263, 1947-9271
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Numerical comparison is essential for evaluating an optimization algorithm. Unfortunately, recent research has shown that two paradoxes may occur, namely the cycle ranking paradox and survival of the nonfittest paradox. Further exploitation reveals that these paradoxes stem from the method of data analysis, especially its comparison strategy. Therefore, the design and widespread use of paradox-free data analysis methods has become urgent. This paper is dedicated to reviewing the recent progress in paradox in numerical comparisons of optimization algorithms, especially the reasons for paradoxes and the ways to eliminate them. Specifically, significant progress has been made in eliminating paradoxes from two popular data analysis methods, including hypothesis testing and methods based on the cumulative distribution function. Furthermore, in this paper the authors provide case studies, aiming to show that paradoxes are common and how to eliminate them with paradox-free data analysis methods.
Bibliography:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ISSN:1947-9263
1947-9271
DOI:10.4018/IJSIR.356514