Robust strategy synthesis for probabilistic systems applied to risk-limiting renewable-energy pricing
We address the problem of synthesizing control strategies for Ellipsoidal Markov Decision Processes (EMDP), i.e., MDPs whose transition probabilities are expressed using ellipsoidal uncertainty sets. The synthesized strategy aims to maximize the total expected reward of the EMDP, constrained to a sp...
Gespeichert in:
| Veröffentlicht in: | 2014 proceedings of the International Conference on Embedded Software (EMSOFT) : October 12-17, 2014, Jaypee Greens Golf and Spa Resort, New Delhi, India S. 1 - 10 |
|---|---|
| Hauptverfasser: | , , |
| Format: | Tagungsbericht |
| Sprache: | Englisch |
| Veröffentlicht: |
ACM
01.10.2014
|
| Schlagworte: | |
| Online-Zugang: | Volltext |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| Abstract | We address the problem of synthesizing control strategies for Ellipsoidal Markov Decision Processes (EMDP), i.e., MDPs whose transition probabilities are expressed using ellipsoidal uncertainty sets. The synthesized strategy aims to maximize the total expected reward of the EMDP, constrained to a specification expressed in Probabilistic Computation Tree Logic (PCTL). We prove that the EMDP strategy synthesis problem for the fragment of PCTL disabling operators with a finite time bound is NP-complete and propose a novel sound and complete algorithm to solve it. We apply these results to the problem of synthesizing optimal energy pricing and dispatch strategies in smart grids that integrate renewable sources of energy. We use rewards to maximize the profit of the network operator and a PCTL specification to constrain the risk of power unbalance and guarantee quality-of-service for the users. The EMDP model used to represent the decision-making scenario was trained with measured data and quantitatively captures the uncertainty in the prediction of energy generation. An experimental comparison shows the effectiveness of our method with respect to previous approaches presented in the literature. |
|---|---|
| AbstractList | We address the problem of synthesizing control strategies for Ellipsoidal Markov Decision Processes (EMDP), i.e., MDPs whose transition probabilities are expressed using ellipsoidal uncertainty sets. The synthesized strategy aims to maximize the total expected reward of the EMDP, constrained to a specification expressed in Probabilistic Computation Tree Logic (PCTL). We prove that the EMDP strategy synthesis problem for the fragment of PCTL disabling operators with a finite time bound is NP-complete and propose a novel sound and complete algorithm to solve it. We apply these results to the problem of synthesizing optimal energy pricing and dispatch strategies in smart grids that integrate renewable sources of energy. We use rewards to maximize the profit of the network operator and a PCTL specification to constrain the risk of power unbalance and guarantee quality-of-service for the users. The EMDP model used to represent the decision-making scenario was trained with measured data and quantitatively captures the uncertainty in the prediction of energy generation. An experimental comparison shows the effectiveness of our method with respect to previous approaches presented in the literature. |
| Author | Puggelli, Alberto Sangiovanni-Vincentelli, Alberto L. Seshia, Sanjit A. |
| Author_xml | – sequence: 1 givenname: Alberto surname: Puggelli fullname: Puggelli, Alberto email: puggelli@eecs.berkeley.edu organization: Dept. of Electr. Eng. & Comput. Sci., Univ. of California, Berkeley, Berkeley, CA, USA – sequence: 2 givenname: Alberto L. surname: Sangiovanni-Vincentelli fullname: Sangiovanni-Vincentelli, Alberto L. email: alberto@eecs.berkeley.edu organization: Dept. of Electr. Eng. & Comput. Sci., Univ. of California, Berkeley, Berkeley, CA, USA – sequence: 3 givenname: Sanjit A. surname: Seshia fullname: Seshia, Sanjit A. email: sseshia@eecs.berkeley.edu organization: Dept. of Electr. Eng. & Comput. Sci., Univ. of California, Berkeley, Berkeley, CA, USA |
| BookMark | eNotjU1LxDAURSMo6IyzduEmf6DjS_qStksZ_IIBQXQ9vLSvY7TTliQi8-8N6upc7oVzF-J0nEYW4krBWik0N9oaC2jWv7TNiVjkFsoSjDbnYhXjBwDkyjQVXgh-mdxXTDKmQIn3RxmPY3rn6KPspyDnMDlyfvAx-TZvMfEhSprnwXMn0ySDj5_F4A8--XEvA4_8TW7gIoeQbXPwbR4uxVlPQ-TVP5fi7f7udfNYbJ8fnja324I0Vqkg7LAho0DXrqmx554QobFdx61D3UJtFENpwFhy6FSfMwK1leG6RdLlUlz_eT0z7_L5gcJxZ5vaKq3KH48WV9c |
| ContentType | Conference Proceeding |
| DBID | 6IE 6IL CBEJK RIE RIL |
| DOI | 10.1145/2656045.2656069 |
| DatabaseName | IEEE Electronic Library (IEL) Conference Proceedings IEEE Xplore POP ALL IEEE Xplore All Conference Proceedings IEEE/IET Electronic Library IEEE Proceedings Order Plans (POP All) 1998-Present |
| DatabaseTitleList | |
| Database_xml | – sequence: 1 dbid: RIE name: IEEE Electronic Library (IEL) url: https://ieeexplore.ieee.org/ sourceTypes: Publisher |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Computer Science |
| EISBN | 1450330525 9781450330527 |
| EndPage | 10 |
| ExternalDocumentID | 6986121 |
| Genre | orig-research |
| GroupedDBID | 6IE 6IL ACM ALMA_UNASSIGNED_HOLDINGS APO CBEJK GUFHI LHSKQ RIE RIL |
| ID | FETCH-LOGICAL-a247t-a4d49a51028b984fefa44096ddecb42c0851e035056ab4b1f03540ac75e8c4a23 |
| IEDL.DBID | RIE |
| ISICitedReferencesCount | 2 |
| ISICitedReferencesURI | http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000569732600013&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| IngestDate | Wed Aug 27 04:52:01 EDT 2025 |
| IsDoiOpenAccess | false |
| IsOpenAccess | true |
| IsPeerReviewed | false |
| IsScholarly | false |
| Language | English |
| LinkModel | DirectLink |
| MergedId | FETCHMERGED-LOGICAL-a247t-a4d49a51028b984fefa44096ddecb42c0851e035056ab4b1f03540ac75e8c4a23 |
| PageCount | 10 |
| ParticipantIDs | ieee_primary_6986121 |
| PublicationCentury | 2000 |
| PublicationDate | 2014-Oct. |
| PublicationDateYYYYMMDD | 2014-10-01 |
| PublicationDate_xml | – month: 10 year: 2014 text: 2014-Oct. |
| PublicationDecade | 2010 |
| PublicationTitle | 2014 proceedings of the International Conference on Embedded Software (EMSOFT) : October 12-17, 2014, Jaypee Greens Golf and Spa Resort, New Delhi, India |
| PublicationTitleAbbrev | EMSOFT |
| PublicationYear | 2014 |
| Publisher | ACM |
| Publisher_xml | – name: ACM |
| SSID | ssj0001455974 |
| Score | 1.5738472 |
| Snippet | We address the problem of synthesizing control strategies for Ellipsoidal Markov Decision Processes (EMDP), i.e., MDPs whose transition probabilities are... |
| SourceID | ieee |
| SourceType | Publisher |
| StartPage | 1 |
| SubjectTerms | Markov processes Optimization Pricing Probabilistic logic Quality of service Uncertainty Wind forecasting |
| Title | Robust strategy synthesis for probabilistic systems applied to risk-limiting renewable-energy pricing |
| URI | https://ieeexplore.ieee.org/document/6986121 |
| WOSCitedRecordID | wos000569732600013&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| link | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV3NS8MwFH9sw4OnqZv4TQ4ezT66pGnP4vA0hijsNpL0VQbSytIp--_NS-t68eKpHxACKW1-fe_3AXCPJpdaSctzYxUXJrFcGxPzGaKcorRWqSyETajFIlmt0mUHHg5aGEQM5DMc0Wno5Wel3VGpbBynCRledaGrVFxrtdp6igjYuHHv8VfjiHxlhByFYyA0t_EpYfeY9_837wkMWxkeWx42mFPoYHEG_d8cBta8lgPAl9LsXMVc7TS7Z25feFznNo55SMooMyb46JIlM6utmx3TNfxkVcmIXs4_SOnkp2HkcflNgiqOQRfox1P3_X0Ib_On18dn3sQncB0JVXEtMpFqSQjCpInIMdfC_83F_oNmjYgsgS2kxqKMtRFmmk-oBqStkphYoaPZOfSKssALYKjy6URjponU5iFlEpvcqiibxUnqx4tLGNCqrT9rh4x1s2BXf9--hmMPO0RNibuBXrXd4S0c2a9q47Z34bH-AEQPp-E |
| linkProvider | IEEE |
| linkToHtml | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV3NS8MwFH_MKehp6iZ-m4NHs48uadqzOCbOMWTCbiNJX0WQVdZO2X9vXlq3ixdP_YAQSGnz63u_D4BbNKnUSlqeGqu4MJHl2piQ9xFlD6W1SiU-bEKNx9FsFk9qcLfRwiCiJ59hm059Lz_J7IpKZZ0wjsjwagd2pRBBt1RrbSsqwqPjyr_HXXUCcpYRsu2PntK8DVDx-8eg8b-ZD6G1FeKxyWaLOYIaLo6h8ZvEwKoXswn4kplVXrC89Jpds3y9cMguf8-ZA6WMUmO8ky6ZMrPSvDlnugSgrMgYEcz5B2md3DSMXC6_SVLF0SsD3Xjqv7-14HXwML0f8ipAgetAqIJrkYhYS8IQJo5EiqkW7n8udJ80a0RgCW4htRZlqI0wvbRLVSBtlcTICh30T6C-yBZ4CgxV2utqTDTR2hyojEKTWhUk_TCK3XhxBk1atfln6ZExrxbs_O_bN7A_nD6P5qPH8dMFHDgQIkqC3CXUi-UKr2DPfhXv-fLaP-IfK1erKA |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=proceeding&rft.title=2014+proceedings+of+the+International+Conference+on+Embedded+Software+%28EMSOFT%29+%3A+October+12-17%2C+2014%2C+Jaypee+Greens+Golf+and+Spa+Resort%2C+New+Delhi%2C+India&rft.atitle=Robust+strategy+synthesis+for+probabilistic+systems+applied+to+risk-limiting+renewable-energy+pricing&rft.au=Puggelli%2C+Alberto&rft.au=Sangiovanni-Vincentelli%2C+Alberto+L.&rft.au=Seshia%2C+Sanjit+A.&rft.date=2014-10-01&rft.pub=ACM&rft.spage=1&rft.epage=10&rft_id=info:doi/10.1145%2F2656045.2656069&rft.externalDocID=6986121 |