View in EDS

Research on intelligent regulation of layered water injection based on reinforcement learning SAC algorithm.

Saved in:
Bibliographic Details
Title: Research on intelligent regulation of layered water injection based on reinforcement learning SAC algorithm.
Authors: Hu, Jinzhao, Jia, Deli, Liu, Shichu, Wang, Wenchang, Ren, Fushen
Source: Scientific Reports; 9/26/2025, Vol. 15 Issue 1, p1-17, 17p
Subject Terms: REINFORCEMENT learning, OIL reservoir engineering, AUTOMATIC control systems, ARTIFICIAL intelligence, PROCESS control systems
Abstract: Water injection is a key technology to maintain oil reservoir pressure and guarantee high and stable oilfield production. In this paper, we propose an intelligent control method based on reinforcement learning for layered water injection columns, which achieves accurate control by constructing a layered water injection model and algorithm. A water injection column flow model incorporating the structure of the water injection device, column pressure loss, and flow characteristics is established, and the intelligent control system is designed by combining it with the SAC algorithm. The training environment and simulation platform are built using PyTorch, and the performance of SAC, PPO, and DDPG algorithms are compared and verified in different water injection sections. The experimental results show that the average regulation error of the SAC algorithm under the 5% error threshold is only 5%, significantly better than PPO's 37%; the qualified rate of regulation reaches 81%, which is much higher than PPO's 45% and DDPG's 60%; the average number of adjustment steps is 42% fewer than PPO's and 28% fewer than DDPG's; SAC algorithm exhibits more substantial stability and adaptability under complex working conditions, and its regulation accuracy, qualified rate and response speed are better than that of PPO and DDPG. This study provides theoretical support for intelligent layered water injection technology, which has significant reference value for improving the development efficiency of oilfields. Our code will be available online at: https://github.com/HJZ-hub/SACIntelligentLayeredWaterInjection. [ABSTRACT FROM AUTHOR]
Copyright of Scientific Reports is the property of Springer Nature and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Complementary Index
Description
Abstract:Water injection is a key technology to maintain oil reservoir pressure and guarantee high and stable oilfield production. In this paper, we propose an intelligent control method based on reinforcement learning for layered water injection columns, which achieves accurate control by constructing a layered water injection model and algorithm. A water injection column flow model incorporating the structure of the water injection device, column pressure loss, and flow characteristics is established, and the intelligent control system is designed by combining it with the SAC algorithm. The training environment and simulation platform are built using PyTorch, and the performance of SAC, PPO, and DDPG algorithms are compared and verified in different water injection sections. The experimental results show that the average regulation error of the SAC algorithm under the 5% error threshold is only 5%, significantly better than PPO's 37%; the qualified rate of regulation reaches 81%, which is much higher than PPO's 45% and DDPG's 60%; the average number of adjustment steps is 42% fewer than PPO's and 28% fewer than DDPG's; SAC algorithm exhibits more substantial stability and adaptability under complex working conditions, and its regulation accuracy, qualified rate and response speed are better than that of PPO and DDPG. This study provides theoretical support for intelligent layered water injection technology, which has significant reference value for improving the development efficiency of oilfields. Our code will be available online at: https://github.com/HJZ-hub/SACIntelligentLayeredWaterInjection. [ABSTRACT FROM AUTHOR]
ISSN:20452322
DOI:10.1038/s41598-025-11521-w