Research on Multi-Stage Decision Optimization Based on Monte Carlo Simulation and Deep Q-Network Algorithm

This paper presents a comprehensive study on multi-stage decision optimization leveraging Monte Carlo simulation and Deep Q-Network (DQN) algorithms. We integrate Monte Carlo simulation with sequential sampling, progressively drawing samples and dynamically calculating the log-likelihood ratio to de...

Full description

Saved in:

Bibliographic Details
Published in:	2025 International Conference on Electrical Drives, Power Electronics & Engineering (EDPEE) pp. 964 - 971
Main Authors:	Chen, Make, Geng, Haitian, Li, Jingran
Format:	Conference Proceeding
Language:	English
Published:	IEEE 26.03.2025
Subjects:	Bayes methods Bayesian optimization Costs Decision making Deep Q-Network algorithm Heuristic algorithms Inspection Monte Carlo methods Monte Carlo simulation Optimization Process control Production Quality control
Online Access:	Get full text
Tags:	Add Tag No Tags, Be the first to tag this record!

Description
Summary:	This paper presents a comprehensive study on multi-stage decision optimization leveraging Monte Carlo simulation and Deep Q-Network (DQN) algorithms. We integrate Monte Carlo simulation with sequential sampling, progressively drawing samples and dynamically calculating the log-likelihood ratio to determine the inspection plan. Furthermore, the paper delves into the quality control decision-making problem in multi-stage production processes. Utilizing a DQN model coupled with Bayesian optimization for hyperparameter tuning, our approach employs reinforcement learning where an agent interacts with the environment to progressively learn the optimal decision-making strategy. Experimental results demonstrate that the DQN model effectively reduces inspection and disassembly costs. Notably, when the defective rate is low or inspection costs are high, the agent tends to minimize inspection frequencies.
DOI:	10.1109/EDPEE65754.2025.00175