Challenging test problems for multi- and many-objective optimization
In spite of the extensive studies that have been conducted regarding the construction of multi-objective test problems, researchers have mainly focused their interests on designing complicated search spaces, disregarding, in many cases, the design of the Pareto optimal fronts of the problems. In thi...
Saved in:
| Published in: | Swarm and evolutionary computation Vol. 81; p. 101350 |
|---|---|
| Main Authors: | , , , |
| Format: | Journal Article |
| Language: | English |
| Published: |
Elsevier B.V
01.08.2023
|
| Subjects: | |
| ISSN: | 2210-6502 |
| Online Access: | Get full text |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| Abstract | In spite of the extensive studies that have been conducted regarding the construction of multi-objective test problems, researchers have mainly focused their interests on designing complicated search spaces, disregarding, in many cases, the design of the Pareto optimal fronts of the problems. In this regard, the work related to scalable multi-objective test problems – i.e., problems that can be formulated for an arbitrary number of objectives – has been much less studied. This paper introduces a new set of continuous and box-constrained multi-objective test problems which are scalable in both the number of objectives and in the number of decision variables. Each test problem included in the proposed test suite has a peculiar Pareto front different from those observed in the existing scalable multi-objective test suites. In addition to different Pareto fronts, the proposed test suite introduces features related to the search space that place obstacles that complicate exploring Pareto optimal solutions. Such features can be easily switched on and off by the user to analyze specific mechanisms of multi-objective evolutionary algorithms (MOEAs). The components used in the proposed test suite can be used as a toolkit to construct new test instances not included in this set of problems. To illustrate the use and difficulties of the proposed test suite, some experiments are presented adopting three MOEAs using selection mechanisms based on Pareto optimality, decomposition, and a performance indicator (hypervolume). |
|---|---|
| AbstractList | In spite of the extensive studies that have been conducted regarding the construction of multi-objective test problems, researchers have mainly focused their interests on designing complicated search spaces, disregarding, in many cases, the design of the Pareto optimal fronts of the problems. In this regard, the work related to scalable multi-objective test problems – i.e., problems that can be formulated for an arbitrary number of objectives – has been much less studied. This paper introduces a new set of continuous and box-constrained multi-objective test problems which are scalable in both the number of objectives and in the number of decision variables. Each test problem included in the proposed test suite has a peculiar Pareto front different from those observed in the existing scalable multi-objective test suites. In addition to different Pareto fronts, the proposed test suite introduces features related to the search space that place obstacles that complicate exploring Pareto optimal solutions. Such features can be easily switched on and off by the user to analyze specific mechanisms of multi-objective evolutionary algorithms (MOEAs). The components used in the proposed test suite can be used as a toolkit to construct new test instances not included in this set of problems. To illustrate the use and difficulties of the proposed test suite, some experiments are presented adopting three MOEAs using selection mechanisms based on Pareto optimality, decomposition, and a performance indicator (hypervolume). |
| ArticleNumber | 101350 |
| Author | Coello Coello, Carlos A. Tanaka, Kiyoshi Zapotecas-Martínez, Saúl Aguirre, Hernán E. |
| Author_xml | – sequence: 1 givenname: Saúl orcidid: 0000-0003-1281-9040 surname: Zapotecas-Martínez fullname: Zapotecas-Martínez, Saúl email: szapotecas@inaoep.mx organization: Computer Science Department, Instituto Nacional de Astrofísica Óptica y Electrónica, Tonantzintla, Puebla 72840, Mexico – sequence: 2 givenname: Carlos A. surname: Coello Coello fullname: Coello Coello, Carlos A. email: ccoello@cs.cinvestav.mx organization: Computer Science Department, CINVESTAV-IPN, México City 07360, Mexico – sequence: 3 givenname: Hernán E. surname: Aguirre fullname: Aguirre, Hernán E. email: ahernan@shinshu-u.ac.jp organization: Faculty of Engineering, Shinshu University, 4-17-1 Wakasato, Nagano 380-8553, Japan – sequence: 4 givenname: Kiyoshi surname: Tanaka fullname: Tanaka, Kiyoshi email: ktanaka@shinshu-u.ac.jp organization: Faculty of Engineering, Shinshu University, 4-17-1 Wakasato, Nagano 380-8553, Japan |
| BookMark | eNqFkMtOwzAQRb0oEqX0C9j4BxJsp3l4wQKVp1SJDawt2xkXR4ld2SaofD1py4oFzOZKI53RPXOBZs47QOiKkpwSWl13efyE0eeMsOKwKUoyQ3PGKMmqkrBztIyxI9NUhJUln6O79bvse3Bb67Y4QUx4F7zqYYjY-ICHjz7ZDEvX4kG6feZVBzrZEbDfJTvYL5msd5fozMg-wvInF-jt4f51_ZRtXh6f17ebTBerJmWGKQWgjDG6VnXLQeqKUtlSAKLKElgBwHjNYKUV50bKRutGybqtK64JVcUCFae7OvgYAxixC3aQYS8oEQd_0Ymjvzj4i5P_RPFflLbp2DsFaft_2JsTC5PWaCGIqC04Da0N0yNE6-2f_De8836Q |
| CitedBy_id | crossref_primary_10_1016_j_eswa_2025_128913 crossref_primary_10_1016_j_swevo_2024_101682 crossref_primary_10_1109_TII_2025_3567406 crossref_primary_10_1016_j_istruc_2025_109674 crossref_primary_10_1007_s00158_025_04080_1 crossref_primary_10_1007_s42979_025_03899_1 crossref_primary_10_1109_ACCESS_2025_3525850 crossref_primary_10_1109_ACCESS_2025_3575774 crossref_primary_10_1016_j_rineng_2025_104451 crossref_primary_10_1016_j_asoc_2025_113842 crossref_primary_10_1016_j_engappai_2024_109850 crossref_primary_10_1016_j_swevo_2025_101933 crossref_primary_10_1016_j_eswa_2024_125068 |
| Cites_doi | 10.1109/TEVC.2018.2872453 10.1007/s40747-019-00126-2 10.1162/evco.1999.7.3.205 10.1109/MCI.2021.3129961 10.1109/TEVC.2018.2836912 10.1016/j.ejor.2006.08.004 10.1016/j.engappai.2023.106192 10.1016/j.compchemeng.2010.01.010 10.1016/j.asoc.2009.11.029 10.1155/2020/8796738 10.1007/s00158-007-0163-x 10.1016/j.swevo.2019.02.003 10.1109/TEVC.2003.810758 10.1016/j.cma.2006.07.010 10.1109/TEVC.2021.3084119 10.1109/TEVC.2018.2844286 10.1142/S0219686716500086 10.1007/s40747-017-0039-7 10.1016/j.swevo.2017.01.002 10.1109/CEC.2013.6557739 10.1016/j.ins.2014.12.037 10.1016/j.renene.2020.01.157 10.1016/j.ejor.2006.08.008 10.1109/CEC.2014.6900450 10.1109/CEC.2019.8790342 10.1162/106365600568202 10.1109/TEVC.2005.861417 10.1016/j.asoc.2020.106078 10.1109/TEVC.2008.925798 |
| ContentType | Journal Article |
| Copyright | 2023 Elsevier B.V. |
| Copyright_xml | – notice: 2023 Elsevier B.V. |
| DBID | AAYXX CITATION |
| DOI | 10.1016/j.swevo.2023.101350 |
| DatabaseName | CrossRef |
| DatabaseTitle | CrossRef |
| DatabaseTitleList | |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Computer Science |
| ExternalDocumentID | 10_1016_j_swevo_2023_101350 S2210650223001232 |
| GroupedDBID | --K --M .~1 0R~ 1~. 1~5 4.4 457 4G. 5VS 7-5 8P~ AAAKF AACTN AAEDT AAEDW AAIKJ AAKOC AALRI AAOAW AAQFI AARIN AATLK AAXKI AAXUO AAYFN ABAOU ABBOA ABGRD ABMAC ABUCO ABXDB ACDAQ ACGFS ACNNM ACRLP ACZNC ADBBV ADEZE ADMUD ADQTV ADTZH AEBSH AECPX AEKER AENEX AEQOU AFJKZ AFKWA AFTJW AFXIZ AGHFR AGUBO AGYEJ AHJVU AHZHX AIALX AIEXJ AIKHN AITUG AJOXV AKRWK ALMA_UNASSIGNED_HOLDINGS AMFUW AMRAJ AOUOD APLSM ARUGR AXJTR BJAXD BKOJK BLXMC EBS EFJIC EJD FDB FEDTE FIRID FNPLU FYGXN GBLVA GBOLZ HAMUX HVGLF HZ~ J1W JJJVA KOM M41 MHUIS MO0 N9A O-L O9- OAUVE P-8 P-9 PC. Q38 RIG ROL SDF SES SPC SPCBC SSA SSB SSD SST SSV SSW SSZ T5K ~G- AATTM AAYWO AAYXX ABJNI ABWVN ACLOT ACRPL ACVFH ADCNI ADNMO AEIPS AEUPX AFPUW AIGII AIIUN AKBMS AKYEP ANKPU APXCP CITATION EFKBS EFLBG ~HD |
| ID | FETCH-LOGICAL-c348t-f2bbeebfffc7b7d9eac611ad1ee0b55e23ee2972e4cb99faa8cc8ba7d769c01b3 |
| ISICitedReferencesCount | 14 |
| ISICitedReferencesURI | http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=001038883400001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| ISSN | 2210-6502 |
| IngestDate | Tue Nov 18 21:56:44 EST 2025 Wed Nov 05 20:47:07 EST 2025 Tue Dec 03 03:45:29 EST 2024 |
| IsDoiOpenAccess | false |
| IsOpenAccess | true |
| IsPeerReviewed | true |
| IsScholarly | true |
| Keywords | Multi-objective optimization Evolutionary multi-objective algorithms Scalable multi-objective test problems |
| Language | English |
| LinkModel | OpenURL |
| MergedId | FETCHMERGED-LOGICAL-c348t-f2bbeebfffc7b7d9eac611ad1ee0b55e23ee2972e4cb99faa8cc8ba7d769c01b3 |
| ORCID | 0000-0003-1281-9040 |
| OpenAccessLink | https://www.sciencedirect.com/science/article/pii/S2210650223001232 |
| ParticipantIDs | crossref_primary_10_1016_j_swevo_2023_101350 crossref_citationtrail_10_1016_j_swevo_2023_101350 elsevier_sciencedirect_doi_10_1016_j_swevo_2023_101350 |
| PublicationCentury | 2000 |
| PublicationDate | August 2023 2023-08-00 |
| PublicationDateYYYYMMDD | 2023-08-01 |
| PublicationDate_xml | – month: 08 year: 2023 text: August 2023 |
| PublicationDecade | 2020 |
| PublicationTitle | Swarm and evolutionary computation |
| PublicationYear | 2023 |
| Publisher | Elsevier B.V |
| Publisher_xml | – name: Elsevier B.V |
| References | Rudolph, Naujoks, Preuss (b39) 2006; vol. 4403 Deb, Thiele, Laumanns, Zitzler (b19) 2005 Saxena, Zhang, Duro, Tiwari (b29) 2011; vol. 6576 Emmerich, Deutz (b28) 2007; vol. 4403 Ascia, Catania, Nuovo, Palesi, Patti (b16) 2011; 11 Azzaro-Pantel, Pibouleau (b48) 2010; 34 Liu, Chen, Deb, Goodman (b25) 2017; 21 H. Ishibuchi, L. He, K. Shang, Regular Pareto Front Shape is not Realistic, in: 2019 IEEE Congress on Evolutionary Computation, CEC, 2019, pp. 2034–2041. (b12) 2015 Masuda, Nojima, Ishibuchi (b31) 2016 Xu, Yan, Li, Yang, Li (b44) 2020; 2020 Gao, Liu, Sun, Che, Li (b46) 2020; 153 Fieldsend, Chugh, Allmendinger, Miettinen (b41) 2021; 26 Wang, Ong, Ishibuchi (b34) 2018; 23 Zapotecas-Martínez, García-Nájera, Menchaca-Méndez (b5) 2023; 123 (b10) 2004 Cheng, Li, Tian, Zhang, Yang, Jin, Yao (b33) 2017; 3 Khare, Yao, Deb (b6) 2003; vol. 2632 H. Ishibuchi, M. Yamane, N. Akedo, Y. Nojima, Many-objective and many-variable test problems for visual examination of multiobjective search, in: 2013 IEEE Congress on Evolutionary Computation, (ISSN: 1089-778X) 2013, pp. 1491–1498. Cheng, Jin, Olhofer, Sendhoff (b30) 2016; PP He, Tian, Wang, Jin (b4) 2020 Coello Coello, Lamont, Van Veldhuizen (b11) 2007 Aguirre, Tanaka (b15) 2007; 181 Li, Deb, Zhang, Suganthan, Chen (b36) 2019; 46 Deb (b9) 2001 Huband, Hingston, Barone, While (b1) 2006; 10 Hughes (b7) 2005 Gen, Cheng (b8) 2000 Köppen, Yoshida (b38) 2007; vol. 4403 Li, Zhang (b20) 2009; 13 Beume, Naujoks, Emmerich (b50) 2007; 181 Ishibuchi, Pang, Shang (b13) 2022; 17 Mirjalili, Lewis (b22) 2015; 300 Zapotecas-Martínez, Coello Coello, Aguirre, Tanaka (b2) 2019; 23 Zhang, Zhou, Zhao, Suganthan, Liu, Tiwari (b21) 2008 Ishibuchi, Hitotsuyanagi, Tsukamoto, Nojima (b37) 2010; vol. 6239 Tanabe, Ishibuchi (b3) 2020; 89 Goel, Vaidyanathan, Haftka, Shyy, Queipo, Tucker (b43) 2007; 196 Li, Zhang, Deng (b23) 2014 Wang, Ong, Sun, Gupta, Zhang (b35) 2018; 23 Liu, Lin, Wong, Li, Tan (b27) 2021 Padhi, Mahapatra, Yadav, Tripathy (b47) 2016; 15 Deb (b17) 1999; 7 Zitzler, Thiele, Laumanns, Fonseca, da Fonseca (b14) 2003; 7 Liao, Li, Yang, Zhang, Li (b45) 2008; 35 Zitzler, Deb, Thiele (b18) 2000; 8 Li, Grosan, Yang, Liu, Yao (b24) 2017; PP Li, Yang, Liu (b40) 2014 Kukkonen, Lampinen (b49) 2005 Wang, Zhang, Li, Ishibuchi, Jiao (b26) 2017; 34 Goel (10.1016/j.swevo.2023.101350_b43) 2007; 196 Wang (10.1016/j.swevo.2023.101350_b35) 2018; 23 Fieldsend (10.1016/j.swevo.2023.101350_b41) 2021; 26 Ishibuchi (10.1016/j.swevo.2023.101350_b37) 2010; vol. 6239 Xu (10.1016/j.swevo.2023.101350_b44) 2020; 2020 10.1016/j.swevo.2023.101350_b32 (10.1016/j.swevo.2023.101350_b12) 2015 Ascia (10.1016/j.swevo.2023.101350_b16) 2011; 11 Li (10.1016/j.swevo.2023.101350_b20) 2009; 13 Gen (10.1016/j.swevo.2023.101350_b8) 2000 Cheng (10.1016/j.swevo.2023.101350_b33) 2017; 3 Aguirre (10.1016/j.swevo.2023.101350_b15) 2007; 181 Köppen (10.1016/j.swevo.2023.101350_b38) 2007; vol. 4403 Wang (10.1016/j.swevo.2023.101350_b26) 2017; 34 Padhi (10.1016/j.swevo.2023.101350_b47) 2016; 15 Huband (10.1016/j.swevo.2023.101350_b1) 2006; 10 Li (10.1016/j.swevo.2023.101350_b40) 2014 Gao (10.1016/j.swevo.2023.101350_b46) 2020; 153 10.1016/j.swevo.2023.101350_b42 Deb (10.1016/j.swevo.2023.101350_b9) 2001 Zitzler (10.1016/j.swevo.2023.101350_b14) 2003; 7 Liu (10.1016/j.swevo.2023.101350_b27) 2021 Deb (10.1016/j.swevo.2023.101350_b17) 1999; 7 Mirjalili (10.1016/j.swevo.2023.101350_b22) 2015; 300 Zhang (10.1016/j.swevo.2023.101350_b21) 2008 Zapotecas-Martínez (10.1016/j.swevo.2023.101350_b2) 2019; 23 Kukkonen (10.1016/j.swevo.2023.101350_b49) 2005 Rudolph (10.1016/j.swevo.2023.101350_b39) 2006; vol. 4403 Azzaro-Pantel (10.1016/j.swevo.2023.101350_b48) 2010; 34 Beume (10.1016/j.swevo.2023.101350_b50) 2007; 181 Zitzler (10.1016/j.swevo.2023.101350_b18) 2000; 8 Ishibuchi (10.1016/j.swevo.2023.101350_b13) 2022; 17 Cheng (10.1016/j.swevo.2023.101350_b30) 2016; PP Emmerich (10.1016/j.swevo.2023.101350_b28) 2007; vol. 4403 Liao (10.1016/j.swevo.2023.101350_b45) 2008; 35 He (10.1016/j.swevo.2023.101350_b4) 2020 Li (10.1016/j.swevo.2023.101350_b23) 2014 Deb (10.1016/j.swevo.2023.101350_b19) 2005 Zapotecas-Martínez (10.1016/j.swevo.2023.101350_b5) 2023; 123 (10.1016/j.swevo.2023.101350_b10) 2004 Masuda (10.1016/j.swevo.2023.101350_b31) 2016 Hughes (10.1016/j.swevo.2023.101350_b7) 2005 Li (10.1016/j.swevo.2023.101350_b24) 2017; PP Li (10.1016/j.swevo.2023.101350_b36) 2019; 46 Khare (10.1016/j.swevo.2023.101350_b6) 2003; vol. 2632 Liu (10.1016/j.swevo.2023.101350_b25) 2017; 21 Coello Coello (10.1016/j.swevo.2023.101350_b11) 2007 Saxena (10.1016/j.swevo.2023.101350_b29) 2011; vol. 6576 Wang (10.1016/j.swevo.2023.101350_b34) 2018; 23 Tanabe (10.1016/j.swevo.2023.101350_b3) 2020; 89 |
| References_xml | – year: 2001 ident: b9 article-title: Multi-Objective Optimization using Evolutionary Algorithms – start-page: 2140 year: 2014 end-page: 2147 ident: b40 article-title: A test problem for visual investigation of high-dimensional multi-objective search publication-title: Proceedings of the IEEE Congress on Evolutionary Computation, CEC 2014, Beijing, China, July 6-11, 2014 – volume: 34 start-page: 555 year: 2010 end-page: 566 ident: b48 article-title: Multiobjective scheduling for semiconductor manufacturing plants publication-title: Comput. Chem. Eng. – volume: 7 start-page: 117 year: 2003 end-page: 132 ident: b14 article-title: Performance assessment of multiobjective optimizers: An analysis and review publication-title: IEEE Trans. Evol. Comput. – volume: 13 start-page: 284 year: 2009 end-page: 302 ident: b20 article-title: Multiobjective Optimization Problems With Complicated Pareto Sets, MOEA/D and NSGA-II publication-title: IEEE Trans. Evol. Comput. – volume: 35 start-page: 561 year: 2008 end-page: 569 ident: b45 article-title: Multiobjective optimization for crash safety design of vehicles using stepwise regression model publication-title: Struct. Multidiscip. Optim. – volume: vol. 4403 start-page: 727 year: 2007 end-page: 741 ident: b38 article-title: Substitute distance assignments in NSGA-II for handling many-objective optimization problems publication-title: Evolutionary Multi-Criterion Optimization, 4th International Conference, EMO 2007 – reference: H. Ishibuchi, M. Yamane, N. Akedo, Y. Nojima, Many-objective and many-variable test problems for visual examination of multiobjective search, in: 2013 IEEE Congress on Evolutionary Computation, (ISSN: 1089-778X) 2013, pp. 1491–1498. – start-page: 189 year: 2020 end-page: 197 ident: b4 article-title: A repository of real-world datasets for data-driven evolutionary multiobjective optimization publication-title: Complex Intell. Syst. – volume: 11 start-page: 382 year: 2011 end-page: 398 ident: b16 article-title: Performance evaluation of efficient multi-objective evolutionary algorithms for design space exploration of embedded computer systems publication-title: Appl. Soft Comput. – start-page: 105 year: 2005 end-page: 145 ident: b19 article-title: Scalable test problems for evolutionary multiobjective optimization publication-title: Evolutionary Multiobjective Optimization. Theoretical Advances and Applications – volume: 17 start-page: 86 year: 2022 end-page: 101 ident: b13 article-title: Difficulties in fair performance comparison of multi-objective evolutionary algorithms [research frontier] publication-title: IEEE Comput. Intell. Mag. – volume: PP start-page: 1 year: 2016 end-page: 14 ident: b30 article-title: Test problems for large-scale multiobjective and many-objective optimization publication-title: IEEE Trans. Cybern. – volume: 23 start-page: 217 year: 2018 end-page: 231 ident: b34 article-title: On scalable multiobjective test problems with hardly dominated boundaries publication-title: IEEE Trans. Evol. Comput. – volume: 2020 year: 2020 ident: b44 article-title: Multiobjective optimization of milling parameters for ultrahigh-strength steel AF1410 based on the NSGA-II method publication-title: Adv. Mater. Sci. Eng. – volume: 196 start-page: 879 year: 2007 end-page: 893 ident: b43 article-title: Response surface approximation of Pareto optimal front in multi-objective optimization publication-title: Comput. Methods Appl. Mech. Engrg. – volume: 181 start-page: 1653 year: 2007 end-page: 1669 ident: b50 article-title: SMS-EMOA: Multiobjective selection based on dominated hypervolume publication-title: European J. Oper. Res. – volume: 26 start-page: 1 year: 2021 end-page: 11 ident: b41 article-title: A visualizable test problem generator for many-objective optimization publication-title: IEEE Trans. Evol. Comput. – year: 2004 ident: b10 article-title: Applications of multi-objective evolutionary algorithms – year: 2015 ident: b12 publication-title: Application of Evolutionary Algorithms for Multi-objective Optimization in VLSI and Embedded Systems – volume: 89 year: 2020 ident: b3 article-title: An easy-to-use real-world multi-objective optimization problem suite publication-title: Appl. Soft Comput. – volume: 34 start-page: 89 year: 2017 end-page: 102 ident: b26 article-title: On the use of two reference points in decomposition based multiobjective evolutionary algorithms publication-title: Swarm Evol. Comput. – start-page: 1 year: 2021 ident: b27 article-title: Evolutionary large-scale multiobjective optimization: Benchmarks and algorithms publication-title: IEEE Trans. Evol. Comput. – start-page: 2156 year: 2014 end-page: 2163 ident: b23 article-title: Multiobjective Test Problems with Complicated Pareto Fronts: Difficulties in Degeneracy publication-title: 2014 IEEE Congress on Evolutionary Computation (CEC’2014) – volume: 7 start-page: 205 year: 1999 end-page: 230 ident: b17 article-title: Multi-objective genetic algorithms: Problem difficulties and construction of test problems publication-title: Evol. Comput. – volume: 10 start-page: 477 year: 2006 end-page: 506 ident: b1 article-title: A review of multiobjective test problems and a scalable test problem toolkit publication-title: IEEE Trans. Evol. Comput. – volume: 21 start-page: 408 year: 2017 end-page: 425 ident: b25 article-title: Investigating the effect of imbalance between convergence and diversity in evolutionary multiobjective algorithms publication-title: IEEE Trans. Evol. Comput. – start-page: 222 year: 2005 end-page: 227 ident: b7 article-title: Evolutionary many-objective optimisation: Many once or one many? publication-title: 2005 IEEE Congress on Evolutionary Computation (CEC’2005), Vol. 1 – volume: 153 start-page: 669 year: 2020 end-page: 680 ident: b46 article-title: Multi-objective optimization of thermal performance of packed bed latent heat thermal storage system based on response surface method publication-title: Renew. Energy – volume: 23 start-page: 130 year: 2019 end-page: 142 ident: b2 article-title: A Review of Features and Limitations of Existing Scalable Multiobjective Test Suites publication-title: IEEE Trans. Evol. Comput. – volume: 3 start-page: 67 year: 2017 end-page: 81 ident: b33 article-title: A benchmark test suite for evolutionary many-objective optimization publication-title: Complex Intell. Syst. – volume: 15 start-page: 85 year: 2016 end-page: 100 ident: b47 article-title: Multi-objective optimization of wire electrical discharge machining (WEDM) process parameters using weighted sum genetic algorithm approach publication-title: J. Adv. Manuf. Syst. – volume: vol. 6576 start-page: 197 year: 2011 end-page: 211 ident: b29 article-title: Framework for Many-Objective Test Problems with Both Simple and Complicated Pareto-Set Shapes publication-title: Evolutionary Multi-Criterion Optimization, 6th International Conference, EMO 2011 – start-page: 3011 year: 2016 end-page: 3018 ident: b31 article-title: Common properties of scalable multiobjective problems and a new framework of test problems publication-title: 2016 IEEE Congress on Evolutionary Computation (CEC’2016) – volume: 181 start-page: 1670 year: 2007 end-page: 1690 ident: b15 article-title: Working principles, behavior, and performance of MOEAs on MNK-landscapes publication-title: European J. Oper. Res. – reference: H. Ishibuchi, L. He, K. Shang, Regular Pareto Front Shape is not Realistic, in: 2019 IEEE Congress on Evolutionary Computation, CEC, 2019, pp. 2034–2041. – volume: 46 start-page: 104 year: 2019 end-page: 117 ident: b36 article-title: Comparison between MOEA/D and NSGA-III on a set of novel many and multi-objective benchmark problems with challenging difficulties publication-title: Swarm Evol. Comput. – volume: 8 start-page: 173 year: 2000 end-page: 195 ident: b18 article-title: Comparison of multiobjective evolutionary algorithms: Empirical results publication-title: Evol. Comput. – volume: 123 year: 2023 ident: b5 article-title: Engineering applications of multi-objective evolutionary algorithms: A test suite of box-constrained real-world problems publication-title: Eng. Appl. Artif. Intell. – volume: vol. 4403 start-page: 36 year: 2006 end-page: 50 ident: b39 article-title: Capabilities of EMOA to detect and preserve equivalent Pareto subsets publication-title: Evolutionary Multi-Criterion Optimization, 4th International Conference, EMO 2007, Matsushima, Japan, March 5-8, 2007, Proceedings – volume: vol. 2632 start-page: 376 year: 2003 end-page: 390 ident: b6 article-title: Performance scaling of multi-objective evolutionary algorithms publication-title: Evolutionary Multi-Criterion Optimization. Second International Conference, EMO 2003 – volume: PP start-page: 1 year: 2017 ident: b24 article-title: Multi-line distance minimization: A visualized many-objective test problem suite publication-title: IEEE Trans. Evol. Comput. – year: 2008 ident: b21 article-title: Multiobjective optimization Test Instances for the CEC 2009 Special Session and Competition – start-page: 443 year: 2005 end-page: 450 ident: b49 article-title: GDE3: The third evolution step of generalized differential evolution publication-title: 2005 IEEE Congress on Evolutionary Computation (CEC’2005), Vol. 1 – year: 2007 ident: b11 article-title: Evolutionary Algorithms for Solving Multi-Objective Problems – volume: 23 start-page: 556 year: 2018 end-page: 571 ident: b35 article-title: A generator for multiobjective test problems with difficult-to-approximate Pareto front boundaries publication-title: IEEE Trans. Evol. Comput. – year: 2000 ident: b8 publication-title: Genetic Algorithms and Engineering Optimization – volume: vol. 4403 start-page: 922 year: 2007 end-page: 936 ident: b28 article-title: Test problems based on lamé superspheres publication-title: Evolutionary Multi-Criterion Optimization, 4th International Conference, EMO 2007 – volume: vol. 6239 start-page: 91 year: 2010 end-page: 100 ident: b37 article-title: Many-objective test problems to visually examine the behavior of multiobjective evolution in a decision space publication-title: Parallel Problem Solving from Nature - PPSN XI, 11th International Conference, Kraków, Poland, September 11-15, 2010. Proceedings, Part II – volume: 300 start-page: 158 year: 2015 end-page: 192 ident: b22 article-title: Novel frameworks for creating robust multi-objective benchmark problems publication-title: Inform. Sci. – volume: 23 start-page: 556 issue: 4 year: 2018 ident: 10.1016/j.swevo.2023.101350_b35 article-title: A generator for multiobjective test problems with difficult-to-approximate Pareto front boundaries publication-title: IEEE Trans. Evol. Comput. doi: 10.1109/TEVC.2018.2872453 – start-page: 189 issue: 6 year: 2020 ident: 10.1016/j.swevo.2023.101350_b4 article-title: A repository of real-world datasets for data-driven evolutionary multiobjective optimization publication-title: Complex Intell. Syst. doi: 10.1007/s40747-019-00126-2 – volume: 21 start-page: 408 issue: 3 year: 2017 ident: 10.1016/j.swevo.2023.101350_b25 article-title: Investigating the effect of imbalance between convergence and diversity in evolutionary multiobjective algorithms publication-title: IEEE Trans. Evol. Comput. – year: 2015 ident: 10.1016/j.swevo.2023.101350_b12 – volume: 7 start-page: 205 issue: 3 year: 1999 ident: 10.1016/j.swevo.2023.101350_b17 article-title: Multi-objective genetic algorithms: Problem difficulties and construction of test problems publication-title: Evol. Comput. doi: 10.1162/evco.1999.7.3.205 – volume: 17 start-page: 86 issue: 1 year: 2022 ident: 10.1016/j.swevo.2023.101350_b13 article-title: Difficulties in fair performance comparison of multi-objective evolutionary algorithms [research frontier] publication-title: IEEE Comput. Intell. Mag. doi: 10.1109/MCI.2021.3129961 – volume: 23 start-page: 130 issue: 1 year: 2019 ident: 10.1016/j.swevo.2023.101350_b2 article-title: A Review of Features and Limitations of Existing Scalable Multiobjective Test Suites publication-title: IEEE Trans. Evol. Comput. doi: 10.1109/TEVC.2018.2836912 – volume: 181 start-page: 1670 issue: 3 year: 2007 ident: 10.1016/j.swevo.2023.101350_b15 article-title: Working principles, behavior, and performance of MOEAs on MNK-landscapes publication-title: European J. Oper. Res. doi: 10.1016/j.ejor.2006.08.004 – volume: 123 year: 2023 ident: 10.1016/j.swevo.2023.101350_b5 article-title: Engineering applications of multi-objective evolutionary algorithms: A test suite of box-constrained real-world problems publication-title: Eng. Appl. Artif. Intell. doi: 10.1016/j.engappai.2023.106192 – year: 2007 ident: 10.1016/j.swevo.2023.101350_b11 – volume: 34 start-page: 555 issue: 4 year: 2010 ident: 10.1016/j.swevo.2023.101350_b48 article-title: Multiobjective scheduling for semiconductor manufacturing plants publication-title: Comput. Chem. Eng. doi: 10.1016/j.compchemeng.2010.01.010 – start-page: 2140 year: 2014 ident: 10.1016/j.swevo.2023.101350_b40 article-title: A test problem for visual investigation of high-dimensional multi-objective search – start-page: 443 year: 2005 ident: 10.1016/j.swevo.2023.101350_b49 article-title: GDE3: The third evolution step of generalized differential evolution – year: 2004 ident: 10.1016/j.swevo.2023.101350_b10 article-title: Applications of multi-objective evolutionary algorithms – volume: 11 start-page: 382 issue: 1 year: 2011 ident: 10.1016/j.swevo.2023.101350_b16 article-title: Performance evaluation of efficient multi-objective evolutionary algorithms for design space exploration of embedded computer systems publication-title: Appl. Soft Comput. doi: 10.1016/j.asoc.2009.11.029 – volume: 2020 year: 2020 ident: 10.1016/j.swevo.2023.101350_b44 article-title: Multiobjective optimization of milling parameters for ultrahigh-strength steel AF1410 based on the NSGA-II method publication-title: Adv. Mater. Sci. Eng. doi: 10.1155/2020/8796738 – year: 2008 ident: 10.1016/j.swevo.2023.101350_b21 – volume: PP start-page: 1 issue: 99 year: 2016 ident: 10.1016/j.swevo.2023.101350_b30 article-title: Test problems for large-scale multiobjective and many-objective optimization publication-title: IEEE Trans. Cybern. – start-page: 3011 year: 2016 ident: 10.1016/j.swevo.2023.101350_b31 article-title: Common properties of scalable multiobjective problems and a new framework of test problems – volume: 35 start-page: 561 issue: 6 year: 2008 ident: 10.1016/j.swevo.2023.101350_b45 article-title: Multiobjective optimization for crash safety design of vehicles using stepwise regression model publication-title: Struct. Multidiscip. Optim. doi: 10.1007/s00158-007-0163-x – volume: 46 start-page: 104 year: 2019 ident: 10.1016/j.swevo.2023.101350_b36 article-title: Comparison between MOEA/D and NSGA-III on a set of novel many and multi-objective benchmark problems with challenging difficulties publication-title: Swarm Evol. Comput. doi: 10.1016/j.swevo.2019.02.003 – start-page: 1 year: 2021 ident: 10.1016/j.swevo.2023.101350_b27 article-title: Evolutionary large-scale multiobjective optimization: Benchmarks and algorithms publication-title: IEEE Trans. Evol. Comput. – year: 2001 ident: 10.1016/j.swevo.2023.101350_b9 – volume: 7 start-page: 117 issue: 2 year: 2003 ident: 10.1016/j.swevo.2023.101350_b14 article-title: Performance assessment of multiobjective optimizers: An analysis and review publication-title: IEEE Trans. Evol. Comput. doi: 10.1109/TEVC.2003.810758 – volume: 196 start-page: 879 issue: 4 year: 2007 ident: 10.1016/j.swevo.2023.101350_b43 article-title: Response surface approximation of Pareto optimal front in multi-objective optimization publication-title: Comput. Methods Appl. Mech. Engrg. doi: 10.1016/j.cma.2006.07.010 – year: 2000 ident: 10.1016/j.swevo.2023.101350_b8 – volume: vol. 4403 start-page: 727 year: 2007 ident: 10.1016/j.swevo.2023.101350_b38 article-title: Substitute distance assignments in NSGA-II for handling many-objective optimization problems – volume: 26 start-page: 1 issue: 1 year: 2021 ident: 10.1016/j.swevo.2023.101350_b41 article-title: A visualizable test problem generator for many-objective optimization publication-title: IEEE Trans. Evol. Comput. doi: 10.1109/TEVC.2021.3084119 – volume: vol. 4403 start-page: 922 year: 2007 ident: 10.1016/j.swevo.2023.101350_b28 article-title: Test problems based on lamé superspheres – volume: vol. 6576 start-page: 197 year: 2011 ident: 10.1016/j.swevo.2023.101350_b29 article-title: Framework for Many-Objective Test Problems with Both Simple and Complicated Pareto-Set Shapes – volume: 23 start-page: 217 issue: 2 year: 2018 ident: 10.1016/j.swevo.2023.101350_b34 article-title: On scalable multiobjective test problems with hardly dominated boundaries publication-title: IEEE Trans. Evol. Comput. doi: 10.1109/TEVC.2018.2844286 – volume: 15 start-page: 85 issue: 02 year: 2016 ident: 10.1016/j.swevo.2023.101350_b47 article-title: Multi-objective optimization of wire electrical discharge machining (WEDM) process parameters using weighted sum genetic algorithm approach publication-title: J. Adv. Manuf. Syst. doi: 10.1142/S0219686716500086 – volume: vol. 6239 start-page: 91 year: 2010 ident: 10.1016/j.swevo.2023.101350_b37 article-title: Many-objective test problems to visually examine the behavior of multiobjective evolution in a decision space – volume: PP start-page: 1 issue: 99 year: 2017 ident: 10.1016/j.swevo.2023.101350_b24 article-title: Multi-line distance minimization: A visualized many-objective test problem suite publication-title: IEEE Trans. Evol. Comput. – start-page: 222 year: 2005 ident: 10.1016/j.swevo.2023.101350_b7 article-title: Evolutionary many-objective optimisation: Many once or one many? – volume: 3 start-page: 67 issue: 1 year: 2017 ident: 10.1016/j.swevo.2023.101350_b33 article-title: A benchmark test suite for evolutionary many-objective optimization publication-title: Complex Intell. Syst. doi: 10.1007/s40747-017-0039-7 – volume: vol. 4403 start-page: 36 year: 2006 ident: 10.1016/j.swevo.2023.101350_b39 article-title: Capabilities of EMOA to detect and preserve equivalent Pareto subsets – volume: 34 start-page: 89 year: 2017 ident: 10.1016/j.swevo.2023.101350_b26 article-title: On the use of two reference points in decomposition based multiobjective evolutionary algorithms publication-title: Swarm Evol. Comput. doi: 10.1016/j.swevo.2017.01.002 – start-page: 105 year: 2005 ident: 10.1016/j.swevo.2023.101350_b19 article-title: Scalable test problems for evolutionary multiobjective optimization – ident: 10.1016/j.swevo.2023.101350_b32 doi: 10.1109/CEC.2013.6557739 – volume: 300 start-page: 158 year: 2015 ident: 10.1016/j.swevo.2023.101350_b22 article-title: Novel frameworks for creating robust multi-objective benchmark problems publication-title: Inform. Sci. doi: 10.1016/j.ins.2014.12.037 – volume: 153 start-page: 669 year: 2020 ident: 10.1016/j.swevo.2023.101350_b46 article-title: Multi-objective optimization of thermal performance of packed bed latent heat thermal storage system based on response surface method publication-title: Renew. Energy doi: 10.1016/j.renene.2020.01.157 – volume: 181 start-page: 1653 issue: 3 year: 2007 ident: 10.1016/j.swevo.2023.101350_b50 article-title: SMS-EMOA: Multiobjective selection based on dominated hypervolume publication-title: European J. Oper. Res. doi: 10.1016/j.ejor.2006.08.008 – start-page: 2156 year: 2014 ident: 10.1016/j.swevo.2023.101350_b23 article-title: Multiobjective Test Problems with Complicated Pareto Fronts: Difficulties in Degeneracy doi: 10.1109/CEC.2014.6900450 – ident: 10.1016/j.swevo.2023.101350_b42 doi: 10.1109/CEC.2019.8790342 – volume: 8 start-page: 173 issue: 2 year: 2000 ident: 10.1016/j.swevo.2023.101350_b18 article-title: Comparison of multiobjective evolutionary algorithms: Empirical results publication-title: Evol. Comput. doi: 10.1162/106365600568202 – volume: vol. 2632 start-page: 376 year: 2003 ident: 10.1016/j.swevo.2023.101350_b6 article-title: Performance scaling of multi-objective evolutionary algorithms – volume: 10 start-page: 477 issue: 5 year: 2006 ident: 10.1016/j.swevo.2023.101350_b1 article-title: A review of multiobjective test problems and a scalable test problem toolkit publication-title: IEEE Trans. Evol. Comput. doi: 10.1109/TEVC.2005.861417 – volume: 89 year: 2020 ident: 10.1016/j.swevo.2023.101350_b3 article-title: An easy-to-use real-world multi-objective optimization problem suite publication-title: Appl. Soft Comput. doi: 10.1016/j.asoc.2020.106078 – volume: 13 start-page: 284 issue: 2 year: 2009 ident: 10.1016/j.swevo.2023.101350_b20 article-title: Multiobjective Optimization Problems With Complicated Pareto Sets, MOEA/D and NSGA-II publication-title: IEEE Trans. Evol. Comput. doi: 10.1109/TEVC.2008.925798 |
| SSID | ssj0000602559 |
| Score | 2.4340985 |
| Snippet | In spite of the extensive studies that have been conducted regarding the construction of multi-objective test problems, researchers have mainly focused their... |
| SourceID | crossref elsevier |
| SourceType | Enrichment Source Index Database Publisher |
| StartPage | 101350 |
| SubjectTerms | Evolutionary multi-objective algorithms Multi-objective optimization Scalable multi-objective test problems |
| Title | Challenging test problems for multi- and many-objective optimization |
| URI | https://dx.doi.org/10.1016/j.swevo.2023.101350 |
| Volume | 81 |
| WOSCitedRecordID | wos001038883400001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| journalDatabaseRights | – providerCode: PRVESC databaseName: Elsevier SD Freedom Collection Journals 2021 issn: 2210-6502 databaseCode: AIEXJ dateStart: 20110301 customDbUrl: isFulltext: true dateEnd: 99991231 titleUrlDefault: https://www.sciencedirect.com omitProxy: false ssIdentifier: ssj0000602559 providerName: Elsevier |
| link | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwtV3Nb9MwFLfKxoEL34jxJR-4BVeJk9TxsXRFg8OEtCJVXCLbcaClS6qk68Zfwr_Lc-xkKUMVO3BJ08h5sfx--eXZfh8IvY1GJm-WFoRJIUkEGCLCV5SojApjsAaK22IT7PQ0mc_558HgVxsLs12xokiurvj6v6oaroGyTejsLdTdCYULcA5KhyOoHY7_pPiJK4_SxEEB53uuZkyTeME6EJJmy-AceICUcmkpzyuBPM5dVGbfZD27FJWto6G3ruPG00415SB29vG_irVJ-iBqYpITNFvwx4VdoT4T5u_7cefPMSnNro9nf5znyaqsvfGwg-C3i0VlV8hPdFU04oLCm3YNZqIQP2xE2-JnWX9f9FcwaNj5zzmiozDtJGAp7rCyLeTiaBV4I7T5aW8wvl18WA7rSxiEoRE_vG69m1_7j-9e543YOrot00ZIaoSkVsgddEhZzIEuD8cfp_NP3fKdP2omY6Z0Ydv7NqdV4z14ozt_t3t6tszsIbrvJiF4bMHzCA108Rg9aAt8YMf3T9BxD0vYYAm3WMKAJWyxhAEaeBdLuI-lp-jLh-lsckJc2Q2iwijZkJxKqbXM81wxyTIOn2Z4Z0UWaO3LONY01JpyRnWkJOe5EIlSiRQsYyOu_ECGz9BBURb6OcIMrM0w9EXum_jrSPBAJGESZkEsYl_y5AjRdlBS5XLSm9Ioq3SPTo7Qu-6mtU3Jsr_5qB3t1FmV1lpMAUL7bnxxu-e8RPeuwf0KHWyqC_0a3VXbzaKu3jj8_AYMIppI |
| linkProvider | Elsevier |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Challenging+test+problems+for+multi-+and+many-objective+optimization&rft.jtitle=Swarm+and+evolutionary+computation&rft.au=Zapotecas-Mart%C3%ADnez%2C+Sa%C3%BAl&rft.au=Coello+Coello%2C+Carlos+A.&rft.au=Aguirre%2C+Hern%C3%A1n+E.&rft.au=Tanaka%2C+Kiyoshi&rft.date=2023-08-01&rft.issn=2210-6502&rft.volume=81&rft.spage=101350&rft_id=info:doi/10.1016%2Fj.swevo.2023.101350&rft.externalDBID=n%2Fa&rft.externalDocID=10_1016_j_swevo_2023_101350 |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=2210-6502&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=2210-6502&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=2210-6502&client=summon |