Delay Deterministic Cell-Free MIMO Transmission via Safety Reinforcement Learning

Deterministic communication within the wireless domain is essential for industrial applications. However, the stochastic nature of wireless communication introduces substantial challenges for time-sensitive networking (TSN) services, which require strict end-to-end latency bounds. This paper address...

Full description

Saved in:
Bibliographic Details
Published in:IEEE transactions on wireless communications p. 1
Main Authors: Meng, Fan, Zhang, Cheng, Huang, Yongming, You, Xiaohu
Format: Journal Article
Language:English
Published: IEEE 2025
Subjects:
Array signal processing
cell-free
Delays
deterministic communication
Downlink
Jitter
MIMO
Optimization
Precoding
Resource management
safety reinforcement learning
time-space-frequency precoding
Ultra reliable low latency communication
Wireless communication
WMMSE
ISSN:1536-1276, 1558-2248
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Abstract Deterministic communication within the wireless domain is essential for industrial applications. However, the stochastic nature of wireless communication introduces substantial challenges for time-sensitive networking (TSN) services, which require strict end-to-end latency bounds. This paper addresses the challenge of minimizing long-term delay jitter in downlink cell-free multi-user multi-input multi-output orthogonal frequency division multiple access (MU-MIMO OFDMA) systems, subject to heterogeneous delay upper bounds and satisfaction rates. The problem involves time-space-frequency precoding constrained by user-specific delay violation probabilities and transmit power limits. To overcome the limitations of model-driven methods in handling implicit system models and the inefficiency of data-driven approaches in large action spaces, we propose a hybrid solution. Specifically, we decompose the problem into two sub-problems: rate scheduling via a constrained Markov decision process (CMDP), and instantaneous precoding through weighted sum-rate (WSR) maximization. We develop a safety reinforcement learning-based algorithm to optimize rate scheduling by allocating user weights, and a weighted minimum mean squared error (WMMSE) algorithm to solve the WSR maximization. Simulation results demonstrate that our approach effectively reduces jitter while meeting stringent delay-related requirements. In diverse TSN scenarios with heavy loading ratio, our proposed co-driven scheme achieves about 45% reduction in delay jitter compared to earliest deadline first (EDF) scheduling, while realizing user-specific delay satisfactory ratios (99.9%-99.999%).
AbstractList Deterministic communication within the wireless domain is essential for industrial applications. However, the stochastic nature of wireless communication introduces substantial challenges for time-sensitive networking (TSN) services, which require strict end-to-end latency bounds. This paper addresses the challenge of minimizing long-term delay jitter in downlink cell-free multi-user multi-input multi-output orthogonal frequency division multiple access (MU-MIMO OFDMA) systems, subject to heterogeneous delay upper bounds and satisfaction rates. The problem involves time-space-frequency precoding constrained by user-specific delay violation probabilities and transmit power limits. To overcome the limitations of model-driven methods in handling implicit system models and the inefficiency of data-driven approaches in large action spaces, we propose a hybrid solution. Specifically, we decompose the problem into two sub-problems: rate scheduling via a constrained Markov decision process (CMDP), and instantaneous precoding through weighted sum-rate (WSR) maximization. We develop a safety reinforcement learning-based algorithm to optimize rate scheduling by allocating user weights, and a weighted minimum mean squared error (WMMSE) algorithm to solve the WSR maximization. Simulation results demonstrate that our approach effectively reduces jitter while meeting stringent delay-related requirements. In diverse TSN scenarios with heavy loading ratio, our proposed co-driven scheme achieves about 45% reduction in delay jitter compared to earliest deadline first (EDF) scheduling, while realizing user-specific delay satisfactory ratios (99.9%-99.999%).
Author Huang, Yongming
You, Xiaohu
Meng, Fan
Zhang, Cheng
Author_xml – sequence: 1
  givenname: Fan
  orcidid: 0000-0002-9769-0057
  surname: Meng
  fullname: Meng, Fan
  email: mengfan@pmlabs.com.cn
  organization: Purple Mountain Laboratories, Nanjing, China
– sequence: 2
  givenname: Cheng
  orcidid: 0000-0003-2663-4207
  surname: Zhang
  fullname: Zhang, Cheng
  email: zhangcheng_seu@seu.edu.cn
  organization: Purple Mountain Laboratories, Nanjing, China
– sequence: 3
  givenname: Yongming
  orcidid: 0000-0003-3616-4616
  surname: Huang
  fullname: Huang, Yongming
  email: huangym@seu.edu.cn
  organization: Purple Mountain Laboratories, Nanjing, China
– sequence: 4
  givenname: Xiaohu
  orcidid: 0000-0002-0809-8511
  surname: You
  fullname: You, Xiaohu
  email: xhyu@seu.edu.cn
  organization: Purple Mountain Laboratories, Nanjing, China
BookMark eNpFkEFLwzAYhoNMcJvePXjIH-jMlyZpcpTOzcHGUCceS9Z-kUibSlKE_Xs3NvD0vof3eQ_PhIxCH5CQe2AzAGYed5_ljDMuZ7liwDlckTFIqTPOhR6deq4y4IW6IZOUvhmDQkk5Jq9zbO2BznHA2Png0-BrWmLbZouISDerzZbuog2p8yn5PtBfb-m7dTgc6Bv64PpYY4dhoGu0MfjwdUuunW0T3l1ySj4Wz7vyJVtvl6vyaZ3VkIshM8wW2jlwrikKa_dsr6SVRgvc61o0AhttkCtthdE1Q2skaEQBsm4k1yjzKWHn3zr2KUV01U_0nY2HClh1UlIdlVQnJdVFyRF5OCMeEf_nACI3qsj_AG23X7o
CODEN ITWCAX
ContentType Journal Article
DBID 97E
RIA
RIE
AAYXX
CITATION
DOI 10.1109/TWC.2025.3601221
DatabaseName IEEE All-Society Periodicals Package (ASPP) 2005–Present
IEEE All-Society Periodicals Package (ASPP) 1998–Present
IEEE Electronic Library (IEL)
CrossRef
DatabaseTitle CrossRef
DatabaseTitleList
Database_xml – sequence: 1
  dbid: RIE
  name: IEEE Electronic Library (IEL)
  url: https://ieeexplore.ieee.org/
  sourceTypes: Publisher
DeliveryMethod fulltext_linktorsrc
Discipline Engineering
EISSN 1558-2248
EndPage 1
ExternalDocumentID 10_1109_TWC_2025_3601221
11143967
Genre orig-research
GrantInformation_xml – fundername: Natural Science Foundation of Jiangsu Province
  grantid: BK20240174
  funderid: 10.13039/501100004608
– fundername: National Natural Science Foundation of China
  grantid: 62001103; 62201394; 62271140
  funderid: 10.13039/501100001809
GroupedDBID -~X
0R~
29I
4.4
5GY
5VS
6IK
97E
AAJGR
AARMG
AASAJ
AAWTH
ABAZT
ABQJQ
ABVLG
ACGFO
ACGFS
ACIWK
AENEX
AGQYO
AGSQL
AHBIQ
AKJIK
AKQYR
ALMA_UNASSIGNED_HOLDINGS
ATWAV
BEFXN
BFFAM
BGNUA
BKEBE
BPEOZ
CS3
DU5
EBS
HZ~
IES
IFIPE
IPLJI
JAVBF
LAI
M43
O9-
OCL
P2P
RIA
RIE
RNS
AAYXX
AETIX
AIBXA
CITATION
EJD
H~9
ID FETCH-LOGICAL-c134t-90a78ff1ffd77aab0b65a5984eb8c4d4ed89e268a498c0ea9518ee415cd528e53
IEDL.DBID RIE
ISSN 1536-1276
IngestDate Sat Nov 29 07:35:49 EST 2025
Wed Sep 10 07:40:24 EDT 2025
IsPeerReviewed true
IsScholarly true
Language English
License https://ieeexplore.ieee.org/Xplorehelp/downloads/license-information/IEEE.html
https://doi.org/10.15223/policy-029
https://doi.org/10.15223/policy-037
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-c134t-90a78ff1ffd77aab0b65a5984eb8c4d4ed89e268a498c0ea9518ee415cd528e53
ORCID 0000-0003-3616-4616
0000-0002-9769-0057
0000-0003-2663-4207
0000-0002-0809-8511
PageCount 1
ParticipantIDs ieee_primary_11143967
crossref_primary_10_1109_TWC_2025_3601221
PublicationCentury 2000
PublicationDate 2025-00-00
PublicationDateYYYYMMDD 2025-01-01
PublicationDate_xml – year: 2025
  text: 2025-00-00
PublicationDecade 2020
PublicationTitle IEEE transactions on wireless communications
PublicationTitleAbbrev TWC
PublicationYear 2025
Publisher IEEE
Publisher_xml – name: IEEE
SSID ssj0017655
Score 2.4619029
Snippet Deterministic communication within the wireless domain is essential for industrial applications. However, the stochastic nature of wireless communication...
SourceID crossref
ieee
SourceType Index Database
Publisher
StartPage 1
SubjectTerms Array signal processing
cell-free
Delays
deterministic communication
Downlink
Jitter
MIMO
Optimization
Precoding
Resource management
safety reinforcement learning
time-space-frequency precoding
Ultra reliable low latency communication
Wireless communication
WMMSE
Title Delay Deterministic Cell-Free MIMO Transmission via Safety Reinforcement Learning
URI https://ieeexplore.ieee.org/document/11143967
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
journalDatabaseRights – providerCode: PRVIEE
  databaseName: IEEE Electronic Library (IEL)
  customDbUrl:
  eissn: 1558-2248
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0017655
  issn: 1536-1276
  databaseCode: RIE
  dateStart: 20020101
  isFulltext: true
  titleUrlDefault: https://ieeexplore.ieee.org/
  providerName: IEEE
link http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1LS8NAEB5s8aAHnxXriz148ZA2bfZ5lNaiYOurYm9hk0ykUFqJaaH_3t1NrPXgQXJZwi4s3zDMa-cbgEsqAp0iR88W4TwTb6RGpZB5yI2vwX2teEGZfy8GAzkaqceyWd31wiCie3yGDbt0tfxkFs9tqqxp9NLYTy4qUBFCFM1aq5KB4G7EqdFgO1hGrGqSvmoO3zomEmyzRsBtJan1ywatDVVxNqW3-8_b7MFO6TyS60La-7CB0wPYXqMUPISnLk70knTLVy6Ohpl0cDLxehki6d_1H4izT0a-NlFGFmNNXgyQ-ZI8o6NRjV3GkJTMq-81eO3dDDu3Xjk2wYtbAc095Wsh07SVpokQWkd-xJlmSlKMZEwTiolU2OZSUyVjH7XxsSSiMeRxwtoSWXAE1elsisdAjPNAJYvsaUVpEEQJ8kRqpiVH33x1uPoGMvwo2DFCF1X4KjSghxb0sAS9DjWL4c--Er6TP_6fwpY9XqQ7zqCaZ3M8h814kY8_swsn-y-DUaw8
linkProvider IEEE
linkToHtml http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1JT8JAFJ4omqgHV4y4zsGLh0KXWY8GJBABN4zcmmn7akgIGCwk_HtnphXx4MH00jRt03zTl7d8876H0DXhgUqBgWNIOEfnG6k2KaAOMB1rMFdJlkvmd3ivJwYD-Vg0q9teGACwm8-gak4tl59M4pkpldW0XWr_yfg62qCE-F7errUkDTizQ061DZvRMnzJSrqy1n-r61zQp9WAGS7J--WFVsaqWK_S3Pvn9-yj3SJ8xLf5eh-gNRgfop0VUcEj9NSAkVrgRrHPxQox4zqMRk5zCoC77e4Dth5Kr7ApleH5UOEXDWW2wM9ghVRjWzPEhfbqexm9Nu_69ZZTDE5wYi8gmSNdxUWaemmacK5U5EaMKioFgUjEJCGQCAk-E4pIEbugdJQlALQrjxPqC6DBMSqNJ2M4QViHD0TQyDwtCQmCKAGWCEWVYODqo4JuvoEMP3J9jNDmFa4MNeihAT0sQK-gssHw574CvtM_rl-hrVa_2wk77d79Gdo2r8qLH-eolE1ncIE243k2_Jxe2v_gC6ikr4M
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Delay+Deterministic+Cell-Free+MIMO+Transmission+via+Safety+Reinforcement+Learning&rft.jtitle=IEEE+transactions+on+wireless+communications&rft.au=Meng%2C+Fan&rft.au=Zhang%2C+Cheng&rft.au=Huang%2C+Yongming&rft.au=You%2C+Xiaohu&rft.date=2025&rft.pub=IEEE&rft.issn=1536-1276&rft.spage=1&rft.epage=1&rft_id=info:doi/10.1109%2FTWC.2025.3601221&rft.externalDocID=11143967
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1536-1276&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1536-1276&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1536-1276&client=summon