Research on Multi-Stage Decision Optimization Based on Monte Carlo Simulation and Deep Q-Network Algorithm

This paper presents a comprehensive study on multi-stage decision optimization leveraging Monte Carlo simulation and Deep Q-Network (DQN) algorithms. We integrate Monte Carlo simulation with sequential sampling, progressively drawing samples and dynamically calculating the log-likelihood ratio to de...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:2025 International Conference on Electrical Drives, Power Electronics & Engineering (EDPEE) S. 964 - 971
Hauptverfasser: Chen, Make, Geng, Haitian, Li, Jingran
Format: Tagungsbericht
Sprache:Englisch
Veröffentlicht: IEEE 26.03.2025
Schlagworte:
Bayes methods
Bayesian optimization
Costs
Decision making
Deep Q-Network algorithm
Heuristic algorithms
Inspection
Monte Carlo methods
Monte Carlo simulation
Optimization
Process control
Production
Quality control
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:This paper presents a comprehensive study on multi-stage decision optimization leveraging Monte Carlo simulation and Deep Q-Network (DQN) algorithms. We integrate Monte Carlo simulation with sequential sampling, progressively drawing samples and dynamically calculating the log-likelihood ratio to determine the inspection plan. Furthermore, the paper delves into the quality control decision-making problem in multi-stage production processes. Utilizing a DQN model coupled with Bayesian optimization for hyperparameter tuning, our approach employs reinforcement learning where an agent interacts with the environment to progressively learn the optimal decision-making strategy. Experimental results demonstrate that the DQN model effectively reduces inspection and disassembly costs. Notably, when the defective rate is low or inspection costs are high, the agent tends to minimize inspection frequencies.
DOI:10.1109/EDPEE65754.2025.00175