Traffic Signal Control Based on Reinforcement Learning with Graph Convolutional Neural Nets

Traffic signal control can mitigate traffic congestion and reduce travel time. A model-free reinforcement learning (RL) approach is a powerful framework for learning a responsive traffic control policy for short-term traffic demand changes without prior environmental knowledge. Previous RL approache...

Full description

Saved in:
Bibliographic Details
Published in:Proceedings (IEEE Conference on Intelligent Transportation Systems) pp. 877 - 883
Main Authors: Nishi, Tomoki, Otaki, Keisuke, Hayakawa, Keiichiro, Yoshimura, Takayoshi
Format: Conference Proceeding
Language:English
Published: IEEE 01.11.2018
Subjects:
Adaptation models
Convolutional neural networks
Feature extraction
Roads
Stacking
Trajectory
ISBN:9781728103211, 1728103215
ISSN:2153-0017
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Traffic signal control can mitigate traffic congestion and reduce travel time. A model-free reinforcement learning (RL) approach is a powerful framework for learning a responsive traffic control policy for short-term traffic demand changes without prior environmental knowledge. Previous RL approaches could handle high-dimensional feature space using a standard neural network, e.g., a convolutional neural network; however, to control traffic on a road network with multiple intersections, the geometric features between roads had to be created manually. Rather than using manually crafted geometric features, we developed an RL-based traffic signal control method that employs a graph convolutional neural network (GCNN). GCNNs can automatically extract features considering the traffic features between distant roads by stacking multiple neural network layers. We numerically evaluated the proposed method in a six-intersection environment. The results demonstrate that the proposed method can find comparable policies twice as fast as the conventional RL method with a neural network and can adapt to more extensive traffic demand changes.
ISBN:9781728103211
1728103215
ISSN:2153-0017
DOI:10.1109/ITSC.2018.8569301