Multi-Objective Adaptive Traffic Signal Control Using Fuzzy Control and Q-Learning

A multi-objective adaptive traffic signal control algorithm using fuzzy control and Q-learning was proposed to improve the efficiency, traffic safety, and operational stability of signalized intersections. In this algorithm, the signal cycle length was derived by fuzzy control, then, to minimize del...

Full description

Saved in:
Bibliographic Details
Published in:2024 12th International Conference on Traffic and Logistic Engineering (ICTLE) pp. 57 - 62
Main Authors: Ding, Naikan, Ma, Zufan, Lu, Zhaoyou, Wan, Chengpeng
Format: Conference Proceeding
Language:English
Published: IEEE 23.08.2024
Subjects:
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Abstract A multi-objective adaptive traffic signal control algorithm using fuzzy control and Q-learning was proposed to improve the efficiency, traffic safety, and operational stability of signalized intersections. In this algorithm, the signal cycle length was derived by fuzzy control, then, to minimize delay and conflicts, the green split of each phase was dynamically adjusted through Q-learning. A joint simulation of Python and VISSIM was adopted for traffic operational simulation and evaluation. The simulation results show that the proposed algorithm jointing fuzzy control and Q-learning, and compared with traffic actuated control and fixed timing, the delay, queue length and traffic conflict of the intersection are significantly and comprehensively optimized. In addition, the algorithm reduced the platoon crash risk at the intersection, improving the overall operational stability.
AbstractList A multi-objective adaptive traffic signal control algorithm using fuzzy control and Q-learning was proposed to improve the efficiency, traffic safety, and operational stability of signalized intersections. In this algorithm, the signal cycle length was derived by fuzzy control, then, to minimize delay and conflicts, the green split of each phase was dynamically adjusted through Q-learning. A joint simulation of Python and VISSIM was adopted for traffic operational simulation and evaluation. The simulation results show that the proposed algorithm jointing fuzzy control and Q-learning, and compared with traffic actuated control and fixed timing, the delay, queue length and traffic conflict of the intersection are significantly and comprehensively optimized. In addition, the algorithm reduced the platoon crash risk at the intersection, improving the overall operational stability.
Author Wan, Chengpeng
Lu, Zhaoyou
Ding, Naikan
Ma, Zufan
Author_xml – sequence: 1
  givenname: Naikan
  surname: Ding
  fullname: Ding, Naikan
  email: nkding@whut.edu.cn
  organization: Wuhan University of Technology,Intelligent Transportation Systems Research Center,Wuhan,China
– sequence: 2
  givenname: Zufan
  surname: Ma
  fullname: Ma, Zufan
  email: mazufan@163.com
  organization: Wuhan University of Technology,Intelligent Transportation Systems Research Center,Wuhan,China
– sequence: 3
  givenname: Zhaoyou
  surname: Lu
  fullname: Lu, Zhaoyou
  email: 18346741020@163.com
  organization: Harbin Institute of Technology,School of Transportation Science and Engineering,Harbin,China
– sequence: 4
  givenname: Chengpeng
  surname: Wan
  fullname: Wan, Chengpeng
  email: cpwan@whut.edu.cn
  organization: Wuhan University of Technology,Intelligent Transportation Systems Research Center,Wuhan,China
BookMark eNo9j81Kw0AUhUfQhda-gYt5gdS5M5P5WZbQaiFS1HRdbpI7ZSROSpoK7dMr_q3O4Tvwwblhl6lPxBgHMQMQ_n5VVOXCSA1uJoXUMxBWKK_kBZt6653KhTLSen3NXp6O3Rizdf1GzRg_iM9b3H-XasAQYsNf4y5hx4s-jUPf8c0hph1fHs_n0z_D1PLnrCQc0td4y64Cdgea_uaEbZaLqnjMyvXDqpiXWQRrxqwx6KUzOaIImhRJ1TTCG8jJKpREUOcGoXUkwIS21t5JIwBk44KytdNqwu5-vJGItvshvuNw2v5dVZ-jU04t
ContentType Conference Proceeding
DBID 6IE
6IL
CBEJK
RIE
RIL
DOI 10.1109/ICTLE62418.2024.10703932
DatabaseName IEEE Electronic Library (IEL) Conference Proceedings
IEEE Xplore POP ALL
IEEE Xplore All Conference Proceedings
IEEE Electronic Library (IEL)
IEEE Proceedings Order Plans (POP All) 1998-Present
DatabaseTitleList
Database_xml – sequence: 1
  dbid: RIE
  name: IEEE Electronic Library (IEL)
  url: https://ieeexplore.ieee.org/
  sourceTypes: Publisher
DeliveryMethod fulltext_linktorsrc
EISBN 9798350362794
EndPage 62
ExternalDocumentID 10703932
Genre orig-research
GroupedDBID 6IE
6IL
CBEJK
RIE
RIL
ID FETCH-LOGICAL-i176t-c6a92865aa0f4e3e23cc09615e73a2ee1b56a1d8e016fdb498260112c8f37b843
IEDL.DBID RIE
ISICitedReferencesCount 0
ISICitedReferencesURI http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=001344484300011&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
IngestDate Wed Oct 16 05:58:49 EDT 2024
IsPeerReviewed false
IsScholarly false
Language English
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-i176t-c6a92865aa0f4e3e23cc09615e73a2ee1b56a1d8e016fdb498260112c8f37b843
PageCount 6
ParticipantIDs ieee_primary_10703932
PublicationCentury 2000
PublicationDate 2024-Aug.-23
PublicationDateYYYYMMDD 2024-08-23
PublicationDate_xml – month: 08
  year: 2024
  text: 2024-Aug.-23
  day: 23
PublicationDecade 2020
PublicationTitle 2024 12th International Conference on Traffic and Logistic Engineering (ICTLE)
PublicationTitleAbbrev ICTLE
PublicationYear 2024
Publisher IEEE
Publisher_xml – name: IEEE
Score 1.8805104
Snippet A multi-objective adaptive traffic signal control algorithm using fuzzy control and Q-learning was proposed to improve the efficiency, traffic safety, and...
SourceID ieee
SourceType Publisher
StartPage 57
SubjectTerms adaptive traffic signal control
Computer crashes
Delays
Fuzzy control
Heuristic algorithms
Information entropy
Logistics
multi-objective optimization
Q-learning
Safety
Simulation
Stability analysis
traffic simulation
Title Multi-Objective Adaptive Traffic Signal Control Using Fuzzy Control and Q-Learning
URI https://ieeexplore.ieee.org/document/10703932
WOSCitedRecordID wos001344484300011&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV3PS8MwFA46PHhSceJvcvCa2aRZ0hxlrCiMOXXCbiNNXsY8dGPrBPfXm6TbxIMHb-ERKLwm72uT7_seQnfBA8pw6YgRVBDOXZsUzFFiFSTGgfQYE01ce7Lfz0YjNdiI1aMWBgAi-QxaYRjv8u3MrMJRmd_hMkhJfcXdl1LUYq0tOydR90-dYa8rPCQFyhbjre30X41TIm7kR_984jFq_ijw8GCHLSdoD8pT9BrVsuS5-KirFH6weh4HHnGCFQR-m078wsCdmn-OIx8A56v1-msX06XFL2Rjqzppove8O-w8kk1PBDKlUlQ-pVoFManWieOQAkuNCV1b2iBTzQBo0Raa2gz8p5yzBVdZ8AyjzGQulUXG0zPUKGclnCOsKVAdb9K0_02QSjkBhWA2Ub7wWJZcoGZIyHhe216Mt7m4_CN-hQ5D2sOBK0uvUaNarOAGHZjParpc3MaX9Q2N9ZXi
linkProvider IEEE
linkToHtml http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV3PS8MwFA6igp5UnPjbHLxmNmnaNEcZGxvWOXXCbiNNXsY8dGNugvvrTdJt4sGDt_AgFF7S97XJ930PoVvvAaW5sESnNCWc24QUzFJiJETagnAYE0xcc9HtZoOB7K3E6kELAwCBfAZ1Pwx3-WaiF_6ozL3hwktJXcXdSThnUSXXWvNzInnXafTzZupAyZO2GK-vJ_xqnRKQo3Xwz2ceotqPBg_3NuhyhLagPEYvQS9Lnor3qk7he6OmYeAwx5tB4NfxyG0N3KgY6DgwAnBrsVx-bWKqNPiZrIxVRzX01mr2G22y6opAxlSkc5dUJb2cVKnIcoiBxVr7vi0JiFgxAFokqaImA_cxZ03BZeZdwyjTmY1FkfH4BG2XkxJOEVYUqAp3acr9KAgpbQpFykwkXekxLDpDNZ-Q4bQyvhiuc3H-R_wG7bX7j_kw73QfLtC-XwJ__MriS7Q9ny3gCu3qz_n4Y3YdFu4biqqZKQ
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=proceeding&rft.title=2024+12th+International+Conference+on+Traffic+and+Logistic+Engineering+%28ICTLE%29&rft.atitle=Multi-Objective+Adaptive+Traffic+Signal+Control+Using+Fuzzy+Control+and+Q-Learning&rft.au=Ding%2C+Naikan&rft.au=Ma%2C+Zufan&rft.au=Lu%2C+Zhaoyou&rft.au=Wan%2C+Chengpeng&rft.date=2024-08-23&rft.pub=IEEE&rft.spage=57&rft.epage=62&rft_id=info:doi/10.1109%2FICTLE62418.2024.10703932&rft.externalDocID=10703932