Social Model Shaping for Solving Generic DEC-POMDPs

Decentralized Partially Observable Markov Decision Problem, DEC-POMDP is a popular model to representmulti-agent decision making under uncertainty. However, the significant computational complexity involved in solving DECPOMDPshas limited their application. Recently, social model shaping (TREMOR and...

Full description

Saved in:
Bibliographic Details
Published in:2011 IEEE/WIC/ACM International Conferences on Web Intelligence and Intelligent Agent Technology Vol. 2; pp. 180 - 187
Main Author: Varakantham, P.
Format: Conference Proceeding
Language:English
Published: IEEE 01.08.2011
Subjects:
Collision avoidance
Computational modeling
DEC-POMDP
Equations
Joints
Mathematical model
Multi-agent Systems
Reasoning under uncertainty
Robot kinematics
ISBN:9781457713736, 145771373X
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Abstract Decentralized Partially Observable Markov Decision Problem, DEC-POMDP is a popular model to representmulti-agent decision making under uncertainty. However, the significant computational complexity involved in solving DECPOMDPshas limited their application. Recently, social model shaping (TREMOR and D-TREMOR algorithms) was introduced as an alternative to solve a sub-class of DEC-POMDPs. While scalability has been improved to even solve hundred agent problems, social model shaping has been restricted to solving a sub-class of DEC-POMDPs called Distributed POMDPs with Coordination Locales (DPCL). To that end, we make two significant contributions: (a) Firstly, we enhance the model shaping approach to solve general DEC-POMDPs where there is no restriction on the agent dependencies, and (b) Secondly, we provide theoretical justification for the model shaping heuristics. The key intuition is that not all interactions between agents occur at every time step. In addition to solving 100 agent problems in weakly coupled domains (due to extension from TREMOR and D-TREMOR), we are able to show that social model shaping achieves comparable performance to leading DEC-POMDP solvers (such as IMBDP, MBDP-OC, PBIP-IPGetc.) on tightly coupled benchmark problems.
AbstractList Decentralized Partially Observable Markov Decision Problem, DEC-POMDP is a popular model to representmulti-agent decision making under uncertainty. However, the significant computational complexity involved in solving DECPOMDPshas limited their application. Recently, social model shaping (TREMOR and D-TREMOR algorithms) was introduced as an alternative to solve a sub-class of DEC-POMDPs. While scalability has been improved to even solve hundred agent problems, social model shaping has been restricted to solving a sub-class of DEC-POMDPs called Distributed POMDPs with Coordination Locales (DPCL). To that end, we make two significant contributions: (a) Firstly, we enhance the model shaping approach to solve general DEC-POMDPs where there is no restriction on the agent dependencies, and (b) Secondly, we provide theoretical justification for the model shaping heuristics. The key intuition is that not all interactions between agents occur at every time step. In addition to solving 100 agent problems in weakly coupled domains (due to extension from TREMOR and D-TREMOR), we are able to show that social model shaping achieves comparable performance to leading DEC-POMDP solvers (such as IMBDP, MBDP-OC, PBIP-IPGetc.) on tightly coupled benchmark problems.
Author Varakantham, P.
Author_xml – sequence: 1
  givenname: P.
  surname: Varakantham
  fullname: Varakantham, P.
  email: pradeepv@smu.edu.sg
  organization: Sch. of Inf. Syst., Singapore Manage. Univ., Singapore, Singapore
BookMark eNotTk1Lw0AUXFFBrTl78JI_sHHffuYdS1proKWFVDyWTfJWIzEpiQj-e1N1LvOGmXnMDbvo-o4YuwORAAh8eMl5Pt8nUgAkoM0Zi9Clwlk02oDS5796MpwD5ZS9YtE4vosJ1iIiXDNV9FXj23jT19TGxZs_Nt1rHPohLvr263SvqKOhqeLFMuO77WaxG2_ZZfDtSNE_z9jz43KfPfH1dpVn8zX3YOUnl4Fq0FQHQz6VSOhFahxCmaKdDCNdKKX25OrTnOCDU2VaV2KKTzUENWP3f38bIjoch-bDD98HK7RwTqsfvwpGaQ
ContentType Conference Proceeding
DBID 6IE
6IL
CBEJK
RIE
RIL
DOI 10.1109/WI-IAT.2011.145
DatabaseName IEEE Electronic Library (IEL) Conference Proceedings
IEEE Xplore POP ALL
IEEE Xplore All Conference Proceedings
IEEE Electronic Library (IEL)
IEEE Proceedings Order Plans (POP All) 1998-Present
DatabaseTitleList
Database_xml – sequence: 1
  dbid: RIE
  name: IEEE/IET Electronic Library (IEL)
  url: https://ieeexplore.ieee.org/
  sourceTypes: Publisher
DeliveryMethod fulltext_linktorsrc
Discipline Computer Science
EISBN 9780769545134
0769545130
EndPage 187
ExternalDocumentID 6040774
Genre orig-research
GroupedDBID 6IE
6IL
ACM
ALMA_UNASSIGNED_HOLDINGS
APO
CBEJK
GUFHI
LHSKQ
RIB
RIC
RIE
RIL
ID FETCH-LOGICAL-a162t-2fed14edf5ea829e9a085791b896d14527fb24ae7d0066faf73b8dc05ea14e913
IEDL.DBID RIE
ISBN 9781457713736
145771373X
IngestDate Wed Aug 27 02:48:18 EDT 2025
IsPeerReviewed false
IsScholarly false
Language English
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-a162t-2fed14edf5ea829e9a085791b896d14527fb24ae7d0066faf73b8dc05ea14e913
PageCount 8
ParticipantIDs ieee_primary_6040774
PublicationCentury 2000
PublicationDate 2011-Aug.
PublicationDateYYYYMMDD 2011-08-01
PublicationDate_xml – month: 08
  year: 2011
  text: 2011-Aug.
PublicationDecade 2010
PublicationTitle 2011 IEEE/WIC/ACM International Conferences on Web Intelligence and Intelligent Agent Technology
PublicationTitleAbbrev wi-iat
PublicationYear 2011
Publisher IEEE
Publisher_xml – name: IEEE
SSID ssj0000669991
ssj0001120470
Score 1.4665098
Snippet Decentralized Partially Observable Markov Decision Problem, DEC-POMDP is a popular model to representmulti-agent decision making under uncertainty. However,...
SourceID ieee
SourceType Publisher
StartPage 180
SubjectTerms Collision avoidance
Computational modeling
DEC-POMDP
Equations
Joints
Mathematical model
Multi-agent Systems
Reasoning under uncertainty
Robot kinematics
Title Social Model Shaping for Solving Generic DEC-POMDPs
URI https://ieeexplore.ieee.org/document/6040774
Volume 2
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV3PT8IwFH4B4sETKhh_pwePVtat9K1HAxg5iCRg5EbW9S2SEDD88O-33QZ48OKt7bZke1vzXr_u-z6Ae22M8YmSW5VaLiNFPHELEU6EwtgAtU6y3GwCB4N4MtHDCjzsuTBElP98Ro--me_l22W69VBZS7kvzpUrVagiqoKrtcdTXOr0tc4BXxFhIDHIuVxtdEsxjCY7iaeyr0qpHxHo1kef95_GhaSn8NymX14reap5rv_vJk-geeDsseE-G51ChRZnUN-ZNrByDjcgKgi5zJugzdnoM_GEKeZKVzZazj26wHIl6lnKur0OH769dofrJrw_98adF146J_BEqHDDw4yskGSzNrnIa9KJF7LXwsRauQPtEDMTyoTQ-rhlSYaRiW0auNPdZVpE51BbLBd0AUySQJEGWYRIUsexka7CEtbviMZKGryEho_B9KsQx5iWj3_19_A1HO9A2UDcQG2z2tItHKXfm9l6dZe_0R997pmw
linkProvider IEEE
linkToHtml http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1dT8IwFL1BNNEnVDB-2wcfraxbt66Pho9ABFwCRt7Iut5FEgKGD3-_7TbAB198a7st2e7W3NvTnXMAHqVSyiZKqoNEU-4FSGOzEKGIgintCCnjNDObEINBOB7LqARPOy4MImY_n-GzbWZ7-XqRbCxUVg_MF2fKlQM49Dl3nZyttUNUTPK01c4eYWGuw4WTsbl8YRZjwhtvRZ6KflCI_TBH1j-6tPsyykU9mWU3_XJbyZJNu_K_2zyF2p61R6JdPjqDEs7PobK1bSDFLK6Cl1NyibVBm5HhZ2wpU8QUr2S4mFl8gWRa1NOENFsNGr31m9GqBu_t1qjRoYV3Ao1Z4K6pm6JmHHXqo4m9RBlbKXvJVCgDc8B3RapcHqPQNm5pnApPhTpxzOnmMsm8CyjPF3O8BMKRCZY4qScEchmGipsai2m7JxoGXIkrqNoYTL5yeYxJ8fjXfw8_wHFn1O9Net3B6w2cbCFah91Ceb3c4B0cJd_r6Wp5n73dH7b0nPc
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=proceeding&rft.title=2011+IEEE%2FWIC%2FACM+International+Conferences+on+Web+Intelligence+and+Intelligent+Agent+Technology&rft.atitle=Social+Model+Shaping+for+Solving+Generic+DEC-POMDPs&rft.au=Varakantham%2C+P.&rft.date=2011-08-01&rft.pub=IEEE&rft.isbn=9781457713736&rft.volume=2&rft.spage=180&rft.epage=187&rft_id=info:doi/10.1109%2FWI-IAT.2011.145&rft.externalDocID=6040774
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=9781457713736/lc.gif&client=summon&freeimage=true
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=9781457713736/mc.gif&client=summon&freeimage=true
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=9781457713736/sc.gif&client=summon&freeimage=true