Capacity planning in logistics corridors: Deep reinforcement learning for the dynamic stochastic temporal bin packing problem

This paper addresses the challenge of managing uncertainty in the daily capacity planning of a terminal in a corridor-based logistics system. Corridor-based logistics systems facilitate the exchange of freight between two distinct regions, usually involving industrial and logistics clusters. In this...

Celý popis

Uloženo v:
Podrobná bibliografie
Vydáno v:Transportation research. Part E, Logistics and transportation review Ročník 191; s. 103742
Hlavní autoři: Farahani, Amirreza, Genga, Laura, Schrotenboer, Albert H., Dijkman, Remco
Médium: Journal Article
Jazyk:angličtina
Vydáno: Elsevier Ltd 01.11.2024
Témata:
Bin packing
Continuous-time planning
Deep reinforcement learning
Logistics
Logistics corridors
Real-time planning
Stochastic programming
Transportation
Logistics corridors
Real-time planning
Continuous-time planning
Transportation
Bin packing
Deep reinforcement learning
Logistics
Stochastic programming
ISSN:1366-5545
On-line přístup:Získat plný text
Tagy: Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
Popis
Shrnutí:This paper addresses the challenge of managing uncertainty in the daily capacity planning of a terminal in a corridor-based logistics system. Corridor-based logistics systems facilitate the exchange of freight between two distinct regions, usually involving industrial and logistics clusters. In this context, we introduce the dynamic stochastic temporal bin packing problem. It models the assignment of individual containers to carriers’ trucks over discrete time units in real-time. We formulate it as a Markov decision process (MDP). Two distinguishing characteristics of our problem are the stochastic nature of the time-dependent availability of containers, i.e., container delays, and the continuous-time, or dynamic, aspect of the planning, where a container announcement may occur at any time moment during the planning horizon. We introduce an innovative real-time planning algorithm based on Proximal Policy Optimization (PPO), a Deep Reinforcement Learning (DRL) method, to allocate individual containers to eligible carriers in real-time. In addition, we propose some practical heuristics and two novel rolling-horizon batch-planning methods based on (stochastic) mixed-integer programming (MIP), which can be interpreted as computational information relaxation bounds because they delay decision making. The results show that our proposed DRL method outperforms the practical heuristics and effectively scales to larger-sized problems as opposed to the stochastic MIP-based approach, making our DRL method a practically appealing solution. •Novel dynamic stochastic temporal bin packing for logistics corridors optimization.•A cutting-edge capacity planning method using real-time proximal policy optimization.•A novel rolling-horizon two-stage stochastic programming approach for batch planning.•Innovated logistics planning, balancing efficiency across interdependent processes.
ISSN:1366-5545
DOI:10.1016/j.tre.2024.103742