A hybrid neural combinatorial optimization framework assisted by automated algorithm design

In recent years, the application of Neural Combinatorial Optimization (NCO) techniques in Combinatorial Optimization (CO) has emerged as a popular and promising research direction. Currently, there are mainly two types of NCO, namely, the Constructive Neural Combinatorial Optimization (CNCO) and the...

Full description

Saved in:
Bibliographic Details
Published in:Complex & intelligent systems Vol. 10; no. 6; pp. 8233 - 8247
Main Authors: Ma, Liang, Hao, Xingxing, Zhou, Wei, He, Qianbao, Zhang, Ruibang, Chen, Li
Format: Journal Article
Language:English
Published: Cham Springer International Publishing 01.12.2024
Springer Nature B.V
Springer
Subjects:
Algorithms
Automated algorithm design
Automation
Combinatorial analysis
Complexity
Computational Intelligence
Data Structures and Information Theory
Deep learning
Design optimization
Encoders-Decoders
Engineering
Machine learning
Neural combinatorial optimization
Neural networks
Optimization
Original Article
Reinforcement learning
Supervised learning
Transformer
Traveling salesman problem
Vehicle routing
Neural combinatorial optimization
Transformer
Automated algorithm design
Reinforcement learning
ISSN:2199-4536, 2198-6053
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:In recent years, the application of Neural Combinatorial Optimization (NCO) techniques in Combinatorial Optimization (CO) has emerged as a popular and promising research direction. Currently, there are mainly two types of NCO, namely, the Constructive Neural Combinatorial Optimization (CNCO) and the Perturbative Neural Combinatorial Optimization (PNCO). The CNCO generally trains an encoder-decoder model via supervised learning to construct solutions from scratch. It exhibits high speed in construction process, however, it lacks the ability for sustained optimization due to the one-shot mapping, which bounds its potential for application. Instead, the PNCO generally trains neural network models via deep reinforcement learning (DRL) to intelligently select appropriate human-designed heuristics to improve existing solutions. It can achieve high-quality solutions but at the cost of high computational demand. To leverage the strengths of both approaches, we propose to hybrid the CNCO and PNCO by designing a hybrid framework comprising two stages, in which the CNCO is the first stage and the PNCO is the second. Specifically, in the first stage, we utilize the attention model to generate preliminary solutions for given CO instances. In the second stage, we employ DRL to intelligently select and combine appropriate algorithmic components from improvement pool, perturbation pool, and prediction pool to continuously optimize the obtained solutions. Experimental results on synthetic and real Capacitated Vehicle Routing Problems (CVRPs) and Traveling Salesman Problems(TSPs) demonstrate the effectiveness of the proposed hybrid framework with the assistance of automated algorithm design.
Bibliography:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ISSN:2199-4536
2198-6053
DOI:10.1007/s40747-024-01600-2