Dynamic Stochastic Electric Vehicle Routing with Safe Reinforcement Learning

Saved in:
Bibliographic Details
Title: Dynamic Stochastic Electric Vehicle Routing with Safe Reinforcement Learning
Authors: Basso, Rafael, 1979, Kulcsár, Balázs Adam, 1975, Sanchez-Diaz, Ivan, 1984, Qu, Xiaobo, 1983
Source: EL FORT - El Flottor Optimering i Real-Tid EL FORT - Optimering av elfordonsflotta i Real-Tid - (Fas 2) Transportation Research Part E: Logistics and Transportation Review. 157(157)
Subject Terms: Reinforcement Learning, Approximate Dynamic Programming, Energy Consumption, Electric Vehicles, Vehicle Routing, Green Logistics
Description: Dynamic routing of electric commercial vehicles can be a challenging problem since besides the uncertainty of energy consumption there are also random customer requests. This paper introduces the Dynamic Stochastic Electric Vehicle Routing Problem (DS-EVRP). A Safe Reinforcement Learning method is proposed for solving the problem. The objective is to minimize expected energy consumption in a safe way, which means also minimizing the risk of battery depletion while en route by planning charging whenever necessary. The key idea is to learn offline about the stochastic customer requests and energy consumption using Monte Carlo simulations, to be able to plan the route predictively and safely online. The method is evaluated using simulations based on energy consumption data from a realistic traffic model for the city of Luxembourg and a high-fidelity vehicle model. The results indicate that it is possible to save energy at the same time maintaining reliability by planning the routes and charging in an anticipative way. The proposed method has the potential to improve transport operations with electric commercial vehicles capitalizing on their environmental benefits
File Description: electronic
Access URL: https://research.chalmers.se/publication/527406
https://research.chalmers.se/publication/526222
https://research.chalmers.se/publication/527406/file/527406_Fulltext.pdf
Database: SwePub
FullText Text:
  Availability: 0
CustomLinks:
  – Url: https://research.chalmers.se/publication/527406#
    Name: EDS - SwePub (s4221598)
    Category: fullText
    Text: View record in SwePub
  – Url: https://resolver.ebscohost.com/openurl?sid=EBSCO:edsswe&genre=article&issn=13665545&ISBN=&volume=157&issue=157&date=20220101&spage=&pages=&title=EL FORT - El Flottor Optimering i Real-Tid EL FORT - Optimering av elfordonsflotta i Real-Tid - (Fas 2) Transportation Research Part E: Logistics and Transportation Review&atitle=Dynamic%20Stochastic%20Electric%20Vehicle%20Routing%20with%20Safe%20Reinforcement%20Learning&aulast=Basso%2C%20Rafael&id=DOI:10.1016/j.tre.2021.102496
    Name: Full Text Finder
    Category: fullText
    Text: Full Text Finder
    Icon: https://imageserver.ebscohost.com/branding/images/FTF.gif
    MouseOverText: Full Text Finder
  – Url: https://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=EBSCO&SrcAuth=EBSCO&DestApp=WOS&ServiceName=TransferToWoS&DestLinkType=GeneralSearchSummary&Func=Links&author=Basso%20R
    Name: ISI
    Category: fullText
    Text: Nájsť tento článok vo Web of Science
    Icon: https://imagesrvr.epnet.com/ls/20docs.gif
    MouseOverText: Nájsť tento článok vo Web of Science
Header DbId: edsswe
DbLabel: SwePub
An: edsswe.oai.research.chalmers.se.d7631ed7.4909.4a88.9a06.f9ef7ebbb189
RelevancyScore: 961
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 961.017700195313
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Dynamic Stochastic Electric Vehicle Routing with Safe Reinforcement Learning
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Basso%2C+Rafael%22">Basso, Rafael</searchLink>, 1979<br /><searchLink fieldCode="AR" term="%22Kulcsár%2C+Balázs+Adam%22">Kulcsár, Balázs Adam</searchLink>, 1975<br /><searchLink fieldCode="AR" term="%22Sanchez-Diaz%2C+Ivan%22">Sanchez-Diaz, Ivan</searchLink>, 1984<br /><searchLink fieldCode="AR" term="%22Qu%2C+Xiaobo%22">Qu, Xiaobo</searchLink>, 1983
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <i>EL FORT - El Flottor Optimering i Real-Tid EL FORT - Optimering av elfordonsflotta i Real-Tid - (Fas 2) Transportation Research Part E: Logistics and Transportation Review</i>. 157(157)
– Name: Subject
  Label: Subject Terms
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Reinforcement+Learning%22">Reinforcement Learning</searchLink><br /><searchLink fieldCode="DE" term="%22Approximate+Dynamic+Programming%22">Approximate Dynamic Programming</searchLink><br /><searchLink fieldCode="DE" term="%22Energy+Consumption%22">Energy Consumption</searchLink><br /><searchLink fieldCode="DE" term="%22Electric+Vehicles%22">Electric Vehicles</searchLink><br /><searchLink fieldCode="DE" term="%22Vehicle+Routing%22">Vehicle Routing</searchLink><br /><searchLink fieldCode="DE" term="%22Green+Logistics%22">Green Logistics</searchLink>
– Name: Abstract
  Label: Description
  Group: Ab
  Data: Dynamic routing of electric commercial vehicles can be a challenging problem since besides the uncertainty of energy consumption there are also random customer requests. This paper introduces the Dynamic Stochastic Electric Vehicle Routing Problem (DS-EVRP). A Safe Reinforcement Learning method is proposed for solving the problem. The objective is to minimize expected energy consumption in a safe way, which means also minimizing the risk of battery depletion while en route by planning charging whenever necessary. The key idea is to learn offline about the stochastic customer requests and energy consumption using Monte Carlo simulations, to be able to plan the route predictively and safely online. The method is evaluated using simulations based on energy consumption data from a realistic traffic model for the city of Luxembourg and a high-fidelity vehicle model. The results indicate that it is possible to save energy at the same time maintaining reliability by planning the routes and charging in an anticipative way. The proposed method has the potential to improve transport operations with electric commercial vehicles capitalizing on their environmental benefits
– Name: Format
  Label: File Description
  Group: SrcInfo
  Data: electronic
– Name: URL
  Label: Access URL
  Group: URL
  Data: <link linkTarget="URL" linkTerm="https://research.chalmers.se/publication/527406" linkWindow="_blank">https://research.chalmers.se/publication/527406</link><br /><link linkTarget="URL" linkTerm="https://research.chalmers.se/publication/526222" linkWindow="_blank">https://research.chalmers.se/publication/526222</link><br /><link linkTarget="URL" linkTerm="https://research.chalmers.se/publication/527406/file/527406_Fulltext.pdf" linkWindow="_blank">https://research.chalmers.se/publication/527406/file/527406_Fulltext.pdf</link>
PLink https://erproxy.cvtisr.sk/sfx/access?url=https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=edsswe&AN=edsswe.oai.research.chalmers.se.d7631ed7.4909.4a88.9a06.f9ef7ebbb189
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1016/j.tre.2021.102496
    Languages:
      – Text: English
    Subjects:
      – SubjectFull: Reinforcement Learning
        Type: general
      – SubjectFull: Approximate Dynamic Programming
        Type: general
      – SubjectFull: Energy Consumption
        Type: general
      – SubjectFull: Electric Vehicles
        Type: general
      – SubjectFull: Vehicle Routing
        Type: general
      – SubjectFull: Green Logistics
        Type: general
    Titles:
      – TitleFull: Dynamic Stochastic Electric Vehicle Routing with Safe Reinforcement Learning
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Basso, Rafael
      – PersonEntity:
          Name:
            NameFull: Kulcsár, Balázs Adam
      – PersonEntity:
          Name:
            NameFull: Sanchez-Diaz, Ivan
      – PersonEntity:
          Name:
            NameFull: Qu, Xiaobo
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 01
              Type: published
              Y: 2022
          Identifiers:
            – Type: issn-print
              Value: 13665545
            – Type: issn-locals
              Value: SWEPUB_FREE
            – Type: issn-locals
              Value: CTH_SWEPUB
          Numbering:
            – Type: volume
              Value: 157
            – Type: issue
              Value: 157
          Titles:
            – TitleFull: EL FORT - El Flottor Optimering i Real-Tid EL FORT - Optimering av elfordonsflotta i Real-Tid - (Fas 2) Transportation Research Part E: Logistics and Transportation Review
              Type: main
ResultId 1