Oops! It's Too Late. Your Autonomous Driving System Needs a Faster Middleware

Autonomous Driving (AD) has entered a period of rapid development in recent years. With the amount of sensors and control logics installed increasing tremendously to guarantee robustness, a big challenge is posed for AD middleware. Both the academia and the industry are eager for an investigation of...

Full description

Saved in:
Bibliographic Details
Published in:IEEE robotics and automation letters Vol. 6; no. 4; pp. 7301 - 7308
Main Authors: Wu, Tianze, Wu, Baofu, Wang, Sa, Liu, Liangkai, Liu, Shaoshan, Bao, Yungang, Shi, Weisong
Format: Journal Article
Language:English
Published: Piscataway IEEE 01.10.2021
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subjects:
Communication
Data processing
distributed robot systems
Embedded systems for robotic and automation
Laser radar
Middleware
Open source software
Optimization
Real-time systems
software architecture for robotic and automation
Task analysis
ISSN:2377-3766, 2377-3766
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Abstract Autonomous Driving (AD) has entered a period of rapid development in recent years. With the amount of sensors and control logics installed increasing tremendously to guarantee robustness, a big challenge is posed for AD middleware. Both the academia and the industry are eager for an investigation of the performance of middlewares in Autonomous Driving Vehicles (AVs). To fill this gap, we summarize typical communication scenarios of AVs and evaluate different communication mechanisms of three popular open-source middlewares comprehensively. Besides, we construct a benchmark pack named ComP which consists of a perception communication scenario and a group of real AD applications for researchers to assess middleware performance. Our findings provide useful guidelines for researchers and insightful optimization advice for designing middlewares.
AbstractList Autonomous Driving (AD) has entered a period of rapid development in recent years. With the amount of sensors and control logics installed increasing tremendously to guarantee robustness, a big challenge is posed for AD middleware. Both the academia and the industry are eager for an investigation of the performance of middlewares in Autonomous Driving Vehicles (AVs). To fill this gap, we summarize typical communication scenarios of AVs and evaluate different communication mechanisms of three popular open-source middlewares comprehensively. Besides, we construct a benchmark pack named ComP which consists of a perception communication scenario and a group of real AD applications for researchers to assess middleware performance. Our findings provide useful guidelines for researchers and insightful optimization advice for designing middlewares.
Author Liu, Liangkai
Wang, Sa
Bao, Yungang
Wu, Baofu
Liu, Shaoshan
Shi, Weisong
Wu, Tianze
Author_xml – sequence: 1
  givenname: Tianze
  orcidid: 0000-0001-6902-7955
  surname: Wu
  fullname: Wu, Tianze
  email: wutianze@ict.ac.cn
  organization: State Key Laboratory of Computer Architecture, Institute of Computing Technology, Chinese Acedemy of Sciences, and University of Chinese Academy of Sciences, Beijing, China
– sequence: 2
  givenname: Baofu
  orcidid: 0000-0003-0259-9427
  surname: Wu
  fullname: Wu, Baofu
  email: baofu.wu@hdu.edu.cn
  organization: School of Computer Science and Technology, Hangzhou Dianzi University, Hangzhou 310018, China, and Wayne State University, Detroit, MI, United States
– sequence: 3
  givenname: Sa
  surname: Wang
  fullname: Wang, Sa
  email: wangsa@ict.ac.cn
  organization: State Key Laboratory of Computer Architecture, Institute of Computing Technology, University of Chinese Academy of Sciences, and Institute of Computing Technology(Nanjing), Chinese Academy of Sciences, Beijing, China
– sequence: 4
  givenname: Liangkai
  orcidid: 0000-0002-6149-9859
  surname: Liu
  fullname: Liu, Liangkai
  email: liangkai@wayne.edu
  organization: Wayne State University, Detroit, MI, United States
– sequence: 5
  givenname: Shaoshan
  orcidid: 0000-0002-5132-8351
  surname: Liu
  fullname: Liu, Shaoshan
  email: shaoshan.liu@perceptin.io
  organization: PerceptIn, Santa Clara, California, USA
– sequence: 6
  givenname: Yungang
  surname: Bao
  fullname: Bao, Yungang
  email: baoyg@ict.ac.cn
  organization: State Key Laboratory of Computer Architecture, Institute of Computing Technology, University of Chinese Academy of Sciences, and Peng Cheng Laboratory, Beijing, China
– sequence: 7
  givenname: Weisong
  orcidid: 0000-0001-5864-4675
  surname: Shi
  fullname: Shi, Weisong
  email: weisong@wayne.edu
  organization: Wayne State University, Detroit, MI, United States
BookMark eNp9kE1LAzEQhoMoWGvvgpeIB0-75mM32RxLtVpoLWg9eArZ3URS2k1Nskr_vVtaRDx4mhl4n5nhOQPHjWs0ABcYpRgjcTt9HqYEEZxSJHhGxRHoEcp5Qjljx7_6UzAIYYkQwjnhVOQ9MJu7TbiCk3gT4MI5OFVRp_DNtR4O2-gat3ZtgHfeftrmHb5sQ9Rr-KR1HaCCY9WNHs5sXa_0l_L6HJwYtQp6cKh98Dq-X4wek-n8YTIaTpOKCByTQlBaE8VwUWTalEIrw0mZZSzPEKlMqUvDEcfGCIZZTVklalpmRcV4TnNKFe2D6_3ejXcfrQ5RLruPm-6kJHnOBRcYiy7F9qnKuxC8NrKyUUXrmuiVXUmM5M6e7OzJnT15sNeB6A-48Xat_PY_5HKPWK31T1xkRYE5p99Si3oR
CODEN IRALC6
CitedBy_id crossref_primary_10_1109_TCAD_2024_3380551
crossref_primary_10_3390_s23020669
crossref_primary_10_1109_ACCESS_2025_3582868
crossref_primary_10_1109_LRA_2023_3245412
crossref_primary_10_1109_ACCESS_2024_3399812
crossref_primary_10_1007_s11227_025_07635_7
crossref_primary_10_1109_TSMC_2023_3276218
crossref_primary_10_1109_TITS_2024_3432634
crossref_primary_10_1109_ACCESS_2022_3213664
Cites_doi 10.1109/CVPR.2010.5539960
10.1109/MM.2015.133
10.1145/2968478.2968502
10.1109/ICDCSW.2003.1203555
10.1207/s15327051hci0103_1
10.1145/3173162.3173191
10.1109/SBAC-PAD49847.2020.00038
10.1177/0278364920961451
10.1109/MICRO50266.2020.00089
10.1145/324634.325197
10.1002/0471028959.sof205
10.1016/j.parco.2017.01.003
10.1109/JPROC.2019.2915983
10.1002/rob.20258
10.1109/ISPASS.2015.7095802
10.1109/JIOT.2020.3043716
10.1109/COMST.2018.2869360
10.1109/SAUPEC/RobMech/PRASA48453.2020.9041020
ContentType Journal Article
Copyright Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2021
Copyright_xml – notice: Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2021
DBID 97E
RIA
RIE
AAYXX
CITATION
7SC
7SP
8FD
JQ2
L7M
L~C
L~D
DOI 10.1109/LRA.2021.3097439
DatabaseName IEEE All-Society Periodicals Package (ASPP) 2005-present
IEEE All-Society Periodicals Package (ASPP) 1998-Present
IEEE Electronic Library (IEL)
CrossRef
Computer and Information Systems Abstracts
Electronics & Communications Abstracts
Technology Research Database
ProQuest Computer Science Collection
Advanced Technologies Database with Aerospace
Computer and Information Systems Abstracts – Academic
Computer and Information Systems Abstracts Professional
DatabaseTitle CrossRef
Technology Research Database
Computer and Information Systems Abstracts – Academic
Electronics & Communications Abstracts
ProQuest Computer Science Collection
Computer and Information Systems Abstracts
Advanced Technologies Database with Aerospace
Computer and Information Systems Abstracts Professional
DatabaseTitleList
Technology Research Database
Database_xml – sequence: 1
  dbid: RIE
  name: IEEE Electronic Library (IEL)
  url: https://ieeexplore.ieee.org/
  sourceTypes: Publisher
DeliveryMethod fulltext_linktorsrc
Discipline Engineering
EISSN 2377-3766
EndPage 7308
ExternalDocumentID 10_1109_LRA_2021_3097439
9488177
Genre orig-research
GrantInformation_xml – fundername: Key Area Research and Development Program of Guangdong Province
  grantid: 2020B010164003
– fundername: National Natural Science Foundation of China
  grantid: 62090020
  funderid: 10.13039/501100001809
– fundername: Strategic Priority Research Program of Chinese Academy of Sciences
  grantid: XDC05030200
– fundername: Youth Innovation Promotion Association of the Chinese Academy of Sciences
  grantid: 2013073; 2020105
  funderid: 10.13039/501100004739
GroupedDBID 0R~
97E
AAJGR
AARMG
AASAJ
AAWTH
ABAZT
ABQJQ
ABVLG
ACGFS
AGQYO
AGSQL
AHBIQ
AKJIK
AKQYR
ALMA_UNASSIGNED_HOLDINGS
ATWAV
BEFXN
BFFAM
BGNUA
BKEBE
BPEOZ
EBS
EJD
IFIPE
IPLJI
JAVBF
KQ8
M43
M~E
O9-
OCL
RIA
RIE
AAYXX
CITATION
7SC
7SP
8FD
JQ2
L7M
L~C
L~D
ID FETCH-LOGICAL-c291t-8933d2a61884efb9eaf72b4465402cfbebf7071ff9616d36c9d3b48c6753533a3
IEDL.DBID RIE
ISICitedReferencesCount 13
ISICitedReferencesURI http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000681126100001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
ISSN 2377-3766
IngestDate Sun Nov 30 04:24:21 EST 2025
Tue Nov 18 21:58:10 EST 2025
Sat Nov 29 06:03:12 EST 2025
Wed Aug 27 02:39:34 EDT 2025
IsPeerReviewed true
IsScholarly true
Issue 4
Language English
License https://ieeexplore.ieee.org/Xplorehelp/downloads/license-information/IEEE.html
https://doi.org/10.15223/policy-029
https://doi.org/10.15223/policy-037
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-c291t-8933d2a61884efb9eaf72b4465402cfbebf7071ff9616d36c9d3b48c6753533a3
Notes ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ORCID 0000-0003-0259-9427
0000-0002-5132-8351
0000-0001-6902-7955
0000-0001-5864-4675
0000-0002-6149-9859
PQID 2557979119
PQPubID 4437225
PageCount 8
ParticipantIDs crossref_citationtrail_10_1109_LRA_2021_3097439
crossref_primary_10_1109_LRA_2021_3097439
proquest_journals_2557979119
ieee_primary_9488177
PublicationCentury 2000
PublicationDate 2021-10-01
PublicationDateYYYYMMDD 2021-10-01
PublicationDate_xml – month: 10
  year: 2021
  text: 2021-10-01
  day: 01
PublicationDecade 2020
PublicationPlace Piscataway
PublicationPlace_xml – name: Piscataway
PublicationTitle IEEE robotics and automation letters
PublicationTitleAbbrev LRA
PublicationYear 2021
Publisher IEEE
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher_xml – name: IEEE
– name: The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
References ref35
ref12
ref37
ref14
nvidia (ref10) 0
casini (ref43) 2019
wu (ref18) 0
ref1
ref39
ref19
o’mahony (ref5) 2019
(ref34) 2017
gregg (ref17) 2029
yeong (ref36) 2020
baidu (ref9) 0
baidu (ref31) 0
(ref16) 0; 2
schmidhuber (ref2) 0
kronauer (ref13) 2021
pomerleau (ref3) 1989
wang (ref32) 2018
opencv (ref38) 0
(ref28) 0
ref24
ref23
ref25
ref20
tang (ref8) 2018
ref41
ref44
apex (ref30) 0
ref21
(ref33) 2019
(ref15) 0
ref29
hykes (ref40) 0
autosar (ref11) 0
ref7
linux (ref42) 0
bakken (ref26) 2001; 11
ref4
ref6
bochkovskiy (ref22) 2020
(ref27) 0
References_xml – year: 0
  ident: ref38
– ident: ref37
  doi: 10.1109/CVPR.2010.5539960
– ident: ref20
  doi: 10.1109/MM.2015.133
– year: 2017
  ident: ref34
  article-title: Continental ars4-a 77ghz radar
– year: 0
  ident: ref11
– ident: ref12
  doi: 10.1145/2968478.2968502
– ident: ref29
  doi: 10.1109/ICDCSW.2003.1203555
– volume: 11
  year: 2001
  ident: ref26
  publication-title: The Encyclopedia of Distributed Computing
– start-page: 305
  year: 1989
  ident: ref3
  article-title: Alvinn: An autonomous land vehicle in a neural network
  publication-title: Adv Neural Inf Process Syst
– ident: ref23
  doi: 10.1207/s15327051hci0103_1
– year: 0
  ident: ref2
  article-title: Robot car history
– year: 0
  ident: ref42
  article-title: Preempt rt
– year: 2019
  ident: ref33
  article-title: Velodyne lidar products
– year: 0
  ident: ref40
  article-title: What is Docker
– ident: ref6
  doi: 10.1145/3173162.3173191
– start-page: 128
  year: 2019
  ident: ref5
  article-title: Deep learning vs. traditional computer vision
  publication-title: Proc Sci Inf Conf
– year: 0
  ident: ref28
  article-title: What is middleware
– year: 2029
  ident: ref17
– year: 2019
  ident: ref43
  article-title: Response-time analysis of ros 2 processing chains under reservation-based scheduling
  publication-title: Proc 31st Euromicro Conf Real-Time Syst Schloss Dagstuhl-Leibniz-Zentrum fuer Informatik
– ident: ref7
  doi: 10.1109/SBAC-PAD49847.2020.00038
– year: 0
  ident: ref10
– year: 2021
  ident: ref13
  article-title: Latency overhead of ros2 for modular time-critical systems
– year: 0
  ident: ref9
– ident: ref39
  doi: 10.1177/0278364920961451
– ident: ref19
  doi: 10.1109/MICRO50266.2020.00089
– ident: ref1
  doi: 10.1145/324634.325197
– year: 0
  ident: ref27
  article-title: eProsima Fast RTPS
– ident: ref24
  doi: 10.1002/0471028959.sof205
– year: 2018
  ident: ref8
  article-title: Pi-edge: A low-power edge computing system for real-time autonomous driving services
– volume: 2
  year: 0
  ident: ref16
– ident: ref44
  doi: 10.1016/j.parco.2017.01.003
– start-page: 1
  year: 2020
  ident: ref36
  article-title: A review of multi-sensor fusion system for large heavy vehicles off road in industrial environments
  publication-title: Proc 31st Ir Signals Syst Conf
– year: 2018
  ident: ref32
  article-title: TZC: Efficient inter-process communication for robotics middleware with partial serialization
– year: 0
  ident: ref31
– ident: ref25
  doi: 10.1109/JPROC.2019.2915983
– ident: ref4
  doi: 10.1002/rob.20258
– ident: ref41
  doi: 10.1109/ISPASS.2015.7095802
– year: 0
  ident: ref30
– year: 0
  ident: ref15
– year: 2020
  ident: ref22
  article-title: YOLOv4: Optimal speed and accuracy of object detection
– ident: ref35
  doi: 10.1109/JIOT.2020.3043716
– ident: ref21
  doi: 10.1109/COMST.2018.2869360
– ident: ref14
  doi: 10.1109/SAUPEC/RobMech/PRASA48453.2020.9041020
– year: 0
  ident: ref18
SSID ssj0001527395
Score 2.3092396
Snippet Autonomous Driving (AD) has entered a period of rapid development in recent years. With the amount of sensors and control logics installed increasing...
SourceID proquest
crossref
ieee
SourceType Aggregation Database
Enrichment Source
Index Database
Publisher
StartPage 7301
SubjectTerms Communication
Data processing
distributed robot systems
Embedded systems for robotic and automation
Laser radar
Middleware
Open source software
Optimization
Real-time systems
software architecture for robotic and automation
Task analysis
Title Oops! It's Too Late. Your Autonomous Driving System Needs a Faster Middleware
URI https://ieeexplore.ieee.org/document/9488177
https://www.proquest.com/docview/2557979119
Volume 6
WOSCitedRecordID wos000681126100001&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
journalDatabaseRights – providerCode: PRVIEE
  databaseName: IEEE Electronic Library (IEL)
  customDbUrl:
  eissn: 2377-3766
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0001527395
  issn: 2377-3766
  databaseCode: RIE
  dateStart: 20160101
  isFulltext: true
  titleUrlDefault: https://ieeexplore.ieee.org/
  providerName: IEEE
– providerCode: PRVHPJ
  databaseName: ROAD: Directory of Open Access Scholarly Resources
  customDbUrl:
  eissn: 2377-3766
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0001527395
  issn: 2377-3766
  databaseCode: M~E
  dateStart: 20160101
  isFulltext: true
  titleUrlDefault: https://road.issn.org
  providerName: ISSN International Centre
link http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV3fS-QwEB52xQd9OPVUbnWVHBwcB9Ztm7ZpHhd1UXD3jkPBt5IfExBkK21X3_zbTdLueodycG99SELJJDPfTGa-AfgWSkO5oDzQTMogSTENcsx1oKmhMrTKQQvjm02w2Sy_u-O_enCyqoVBRJ98hqfu07_l61ItXKhsxO1pixjrQ58x1tZqvcVTHJMYT5cvkSEfXf8eW_8vjk5pyB3s_svy-FYq7_SvNyqTrf_7nW341IFHMm6lvQM9nH-GzT8oBXdh-rN8rL-Sq-Z7TW7Kkly7hCdi73RFxovGVTBYV5-cV_cukEBavnIysyasJoJMhKNNIFMftHgWFe7B7eTi5uwy6FomBCrmURNY9EF1LLIozxM0kqMwLJaeNC2MlZEoDbOgwhieRZmmmeKayiRX1m2gFvgJug9r83KOX4CIRGQW22HGLAJITSISFYo8wghRaZXyAYyW21mojk_ctbV4KLxfEfLCCqBwAig6AQzgx2rGY8ul8Y-xu27DV-O6vR7AcCmxortsdWG9IsaZ1dr84ONZh7Dh1m5z8Iaw1lQLPIJ19dTc19Ux9KcvF8f-NL0CfVHHXw
linkProvider IEEE
linkToHtml http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV3fa9swED66dLDuYd3ajmbrOhUGpVA3tmVb1mPoGlKaZKOk0DejHycojLjYTvvvT5KdbGOl0Dc_SMjopLvvTnffAXwLpaFcUB5oJmWQpJgGOeY60NRQGVrloIXxzSbYbJbf3vKfG3C6roVBRJ98hmfu07_l61ItXahswO1pixh7BZtpksRRW631J6LiuMR4unqLDPlgcj20HmAcndGQO-D9j-3xzVT-08DerIy2X_ZD7-FdBx_JsJX3B9jAxQ68_YtUcBemP8r7-ohcNsc1mZclmbiUJ2JvdUWGy8bVMFhnn3yv7lwogbSM5WRmjVhNBBkJR5xApj5s8Sgq3IOb0cX8fBx0TRMCFfOoCSz-oDoWWZTnCRrJURgWS0-bFsbKSJSGWVhhDM-iTNNMcU1lkivrOFAL_QT9CL1FucB9ICIRmUV3mDGLAVKTiESFIo8wQlRapbwPg9V2FqpjFHeNLX4V3rMIeWEFUDgBFJ0A-nCynnHfsmk8M3bXbfh6XLfXfThYSazorltdWL-IcWb1Nv_09Kyv8GY8n06KyeXs6jNsuXXajLwD6DXVEr_Aa_XQ3NXVoT9TvwFPX8l1
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Oops%21+It%27s+Too+Late.+Your+Autonomous+Driving+System+Needs+a+Faster+Middleware&rft.jtitle=IEEE+robotics+and+automation+letters&rft.au=Wu%2C+Tianze&rft.au=Wu%2C+Baofu&rft.au=Wang%2C+Sa&rft.au=Liu%2C+Liangkai&rft.date=2021-10-01&rft.pub=IEEE&rft.eissn=2377-3766&rft.volume=6&rft.issue=4&rft.spage=7301&rft.epage=7308&rft_id=info:doi/10.1109%2FLRA.2021.3097439&rft.externalDocID=9488177
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=2377-3766&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=2377-3766&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=2377-3766&client=summon