Interactive Gibson Benchmark: A Benchmark for Interactive Navigation in Cluttered Environments
We present Interactive Gibson Benchmark, the first comprehensive benchmark for training and evaluating Interactive Navigation solutions. Interactive Navigation tasks are robot navigation problems where physical interaction with objects (e.g., pushing) is allowed and even encouraged to reach the goal...
Saved in:
| Published in: | IEEE robotics and automation letters Vol. 5; no. 2; pp. 713 - 720 |
|---|---|
| Main Authors: | , , , , , , , |
| Format: | Journal Article |
| Language: | English |
| Published: |
Piscataway
IEEE
01.04.2020
The Institute of Electrical and Electronics Engineers, Inc. (IEEE) |
| Subjects: | |
| ISSN: | 2377-3766, 2377-3766 |
| Online Access: | Get full text |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| Abstract | We present Interactive Gibson Benchmark, the first comprehensive benchmark for training and evaluating Interactive Navigation solutions. Interactive Navigation tasks are robot navigation problems where physical interaction with objects (e.g., pushing) is allowed and even encouraged to reach the goal. Our benchmark comprises two novel elements: 1) a new experimental simulated environment, the Interactive Gibson Environment, that generate photo-realistic images of indoor scenes and simulates realistic physical interactions of robots and common objects found in these scenes; 2) the Interactive Navigation Score, a novel metric to study the interplay between navigation and physical interaction of Interactive Navigation solutions. We present and evaluate multiple learning-based baselines in Interactive Gibson Benchmark, and provide insights into regimes of navigation with different trade-offs between navigation, path efficiency and disturbance of surrounding objects. We make our benchmark publicly available1 and encourage researchers from related robotics disciplines (e.g., planning, learning, control) to propose, evaluate, and compare their Interactive Navigation solutions in Interactive Gibson Benchmark. |
|---|---|
| AbstractList | We present Interactive Gibson Benchmark, the first comprehensive benchmark for training and evaluating Interactive Navigation solutions. Interactive Navigation tasks are robot navigation problems where physical interaction with objects (e.g., pushing) is allowed and even encouraged to reach the goal. Our benchmark comprises two novel elements: 1) a new experimental simulated environment, the Interactive Gibson Environment, that generate photo-realistic images of indoor scenes and simulates realistic physical interactions of robots and common objects found in these scenes; 2) the Interactive Navigation Score, a novel metric to study the interplay between navigation and physical interaction of Interactive Navigation solutions. We present and evaluate multiple learning-based baselines in Interactive Gibson Benchmark, and provide insights into regimes of navigation with different trade-offs between navigation, path efficiency and disturbance of surrounding objects. We make our benchmark publicly available1 and encourage researchers from related robotics disciplines (e.g., planning, learning, control) to propose, evaluate, and compare their Interactive Navigation solutions in Interactive Gibson Benchmark. We present Interactive Gibson Benchmark , the first comprehensive benchmark for training and evaluating Interactive Navigation solutions. Interactive Navigation tasks are robot navigation problems where physical interaction with objects (e.g., pushing) is allowed and even encouraged to reach the goal. Our benchmark comprises two novel elements: 1) a new experimental simulated environment, the Interactive Gibson Environment , that generate photo-realistic images of indoor scenes and simulates realistic physical interactions of robots and common objects found in these scenes; 2) the Interactive Navigation Score , a novel metric to study the interplay between navigation and physical interaction of Interactive Navigation solutions. We present and evaluate multiple learning-based baselines in Interactive Gibson Benchmark, and provide insights into regimes of navigation with different trade-offs between navigation, path efficiency and disturbance of surrounding objects. We make our benchmark publicly available 1 1 [Online]. Available: https://sites.google.com/view/interactivegibsonenv . and encourage researchers from related robotics disciplines (e.g., planning, learning, control) to propose, evaluate, and compare their Interactive Navigation solutions in Interactive Gibson Benchmark. |
| Author | Xia, Fei Martin-Martin, Roberto Kasimbeg, Priya Savarese, Silvio Toshev, Alexander Shen, William B. Tchapmi, Micael Edmond Li, Chengshu |
| Author_xml | – sequence: 1 givenname: Fei orcidid: 0000-0003-4343-1444 surname: Xia fullname: Xia, Fei email: feixia@stanford.edu organization: Stanford Artificial Intelligence Lab (SAIL), Stanford University, Stanford, CA, USA – sequence: 2 givenname: William B. surname: Shen fullname: Shen, William B. email: bshen88@stanford.edu organization: Stanford Artificial Intelligence Lab (SAIL), Stanford University, Stanford, CA, USA – sequence: 3 givenname: Chengshu orcidid: 0000-0002-9027-8617 surname: Li fullname: Li, Chengshu email: chengshu@stanford.edu organization: Stanford Artificial Intelligence Lab (SAIL), Stanford University, Stanford, CA, USA – sequence: 4 givenname: Priya surname: Kasimbeg fullname: Kasimbeg, Priya email: kasimbeg@stanford.edu organization: Stanford Artificial Intelligence Lab (SAIL), Stanford University, Stanford, CA, USA – sequence: 5 givenname: Micael Edmond orcidid: 0000-0001-6854-3501 surname: Tchapmi fullname: Tchapmi, Micael Edmond email: mtchapmi@stanford.edu organization: Stanford Artificial Intelligence Lab (SAIL), Stanford University, Stanford, CA, USA – sequence: 6 givenname: Alexander orcidid: 0000-0003-0925-638X surname: Toshev fullname: Toshev, Alexander email: toshev@google.com organization: Robotics at Google – sequence: 7 givenname: Roberto orcidid: 0000-0002-9586-2759 surname: Martin-Martin fullname: Martin-Martin, Roberto email: robertom@stanford.edu organization: Stanford Artificial Intelligence Lab (SAIL), Stanford University, Stanford, CA, USA – sequence: 8 givenname: Silvio surname: Savarese fullname: Savarese, Silvio email: ssilvio@stanford.edu organization: Stanford Artificial Intelligence Lab (SAIL), Stanford University, Stanford, CA, USA |
| BookMark | eNp9kN9LQjEYhkcYZOZ90M2BrrX9ONvOujMxE6Qg6raxzZ2a6Y5tU-i_b6aUdNHVNr732cf7nIKWb7wF4BzBPkJQXE0fB30MMexjwSjk1RFoY8J5j3DGWgf3E9CNcQ4hRBRzImgbvEx8skGZ5Da2GDsdG1_cWG_eliq8XxeD30dRN6E4TN-rjXtVyWXC-WK4WKc8s7Ni5DcuNH5pfYpn4LhWi2i7-7MDnm9HT8O73vRhPBkOpj1DKE89XWMLS1QZiDTWFdGsLAkxM8xqgS3WNYfMCqGxMJgpOhNCWK6wLmtEMC8V6YDL3b-r0HysbUxy3qyDzyslJiWl274wp-AuZUITY7C1XAWXu31KBOVWpMwi5Vak3IvMCPuDGJe-S6eg3OI_8GIHOmvtz55K0JJl9V_y_4G4 |
| CODEN | IRALC6 |
| CitedBy_id | crossref_primary_10_1016_j_patcog_2024_110511 crossref_primary_10_1145_3700599 crossref_primary_10_1109_LRA_2023_3286171 crossref_primary_10_1016_j_engappai_2022_105036 crossref_primary_10_1109_LRA_2021_3060649 crossref_primary_10_1177_17298806241278910 crossref_primary_10_1109_JIOT_2021_3068736 crossref_primary_10_3390_s23115194 crossref_primary_10_1111_cgf_142641 crossref_primary_10_1109_LRA_2020_3048668 crossref_primary_10_1109_LRA_2021_3092686 crossref_primary_10_1109_LRA_2020_3048662 crossref_primary_10_1109_LRA_2025_3546126 crossref_primary_10_1109_LRA_2025_3573167 crossref_primary_10_1145_3675784 crossref_primary_10_3390_s24092794 crossref_primary_10_1146_annurev_control_072220_093055 crossref_primary_10_1007_s12555_025_0127_1 crossref_primary_10_3390_drones9090656 crossref_primary_10_1016_j_imavis_2021_104148 crossref_primary_10_1109_LRA_2023_3333238 crossref_primary_10_1109_LRA_2024_3401684 crossref_primary_10_1007_s11263_022_01670_0 crossref_primary_10_1109_TETCI_2022_3141105 crossref_primary_10_1109_ACCESS_2023_3326883 crossref_primary_10_1109_TRO_2023_3235591 crossref_primary_10_1002_rob_22588 crossref_primary_10_1016_j_cviu_2024_103984 crossref_primary_10_1109_TIP_2024_3459800 crossref_primary_10_3390_mti8030018 crossref_primary_10_1109_LRA_2023_3329619 crossref_primary_10_1007_s11432_024_4303_8 crossref_primary_10_1109_LRA_2024_3521178 crossref_primary_10_1109_LRA_2021_3062342 crossref_primary_10_1109_TNNLS_2023_3335416 crossref_primary_10_1007_s10462_022_10174_9 crossref_primary_10_1109_LRA_2023_3241803 crossref_primary_10_1109_TIM_2023_3259033 crossref_primary_10_1109_LRA_2022_3193254 |
| Cites_doi | 10.1177/1745691610393980 10.1145/3321408.3322633 10.1007/978-3-642-36279-8_2 10.1109/CVPR.2019.00319 10.1109/IROS.2004.1389727 10.1145/358669.358692 10.1109/CVPR.2018.00945 10.1109/ROBOT.2008.4543222 10.1109/100.813825 10.1109/3DV.2017.00081 10.1109/CVPR.2017.769 10.1109/CVPR.2019.00272 10.1109/IROS.2012.6386109 10.1145/2980179.2982420 10.1109/LRA.2019.2925731 10.1109/IROS.2000.895316 10.1002/rob.20154 10.1109/ICRA.2019.8793735 10.1177/0278364913491297 10.1109/NaBIC.2011.6089465 10.5772/8988 10.1109/JPROC.2006.888394 10.1109/ICRA.2017.7989200 10.1016/S1077-3142(02)00030-9 10.1016/j.procir.2014.10.055 10.1007/978-3-319-23778-7_32 10.1007/978-3-540-68405-3_8 10.1007/s10846-008-9235-4 10.1142/S0219843605000545 |
| ContentType | Journal Article |
| Copyright | Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2020 |
| Copyright_xml | – notice: Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2020 |
| DBID | 97E RIA RIE AAYXX CITATION 7SC 7SP 8FD JQ2 L7M L~C L~D |
| DOI | 10.1109/LRA.2020.2965078 |
| DatabaseName | IEEE All-Society Periodicals Package (ASPP) 2005-present IEEE All-Society Periodicals Package (ASPP) 1998-Present IEEE/IET Electronic Library CrossRef Computer and Information Systems Abstracts Electronics & Communications Abstracts Technology Research Database ProQuest Computer Science Collection Advanced Technologies Database with Aerospace Computer and Information Systems Abstracts Academic Computer and Information Systems Abstracts Professional |
| DatabaseTitle | CrossRef Technology Research Database Computer and Information Systems Abstracts – Academic Electronics & Communications Abstracts ProQuest Computer Science Collection Computer and Information Systems Abstracts Advanced Technologies Database with Aerospace Computer and Information Systems Abstracts Professional |
| DatabaseTitleList | Technology Research Database |
| Database_xml | – sequence: 1 dbid: RIE name: IEEE Electronic Library (IEL) url: https://ieeexplore.ieee.org/ sourceTypes: Publisher |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Engineering |
| EISSN | 2377-3766 |
| EndPage | 720 |
| ExternalDocumentID | 10_1109_LRA_2020_2965078 8954627 |
| Genre | orig-research |
| GrantInformation_xml | – fundername: ONR, MURI grantid: W911NF-15-1-0479 |
| GroupedDBID | 0R~ 97E AAJGR AARMG AASAJ AAWTH ABAZT ABQJQ ABVLG ACGFS AGQYO AGSQL AHBIQ AKJIK AKQYR ALMA_UNASSIGNED_HOLDINGS ATWAV BEFXN BFFAM BGNUA BKEBE BPEOZ EBS EJD IFIPE IPLJI JAVBF KQ8 M43 M~E O9- OCL RIA RIE AAYXX CITATION 7SC 7SP 8FD JQ2 L7M L~C L~D |
| ID | FETCH-LOGICAL-c357t-bf2e0418c01b2b83b64433cd26f92e2bf706e99b29c26a5d999e7a2b4f13274a3 |
| IEDL.DBID | RIE |
| ISICitedReferencesCount | 116 |
| ISICitedReferencesURI | http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000526519900010&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| ISSN | 2377-3766 |
| IngestDate | Mon Jun 30 06:06:34 EDT 2025 Sat Nov 29 06:03:05 EST 2025 Tue Nov 18 19:37:57 EST 2025 Wed Aug 27 02:35:30 EDT 2025 |
| IsPeerReviewed | true |
| IsScholarly | true |
| Issue | 2 |
| Language | English |
| License | https://ieeexplore.ieee.org/Xplorehelp/downloads/license-information/IEEE.html https://doi.org/10.15223/policy-029 https://doi.org/10.15223/policy-037 |
| LinkModel | DirectLink |
| MergedId | FETCHMERGED-LOGICAL-c357t-bf2e0418c01b2b83b64433cd26f92e2bf706e99b29c26a5d999e7a2b4f13274a3 |
| Notes | ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 14 |
| ORCID | 0000-0001-6854-3501 0000-0002-9586-2759 0000-0002-9027-8617 0000-0003-4343-1444 0000-0003-0925-638X |
| PQID | 2345515270 |
| PQPubID | 4437225 |
| PageCount | 8 |
| ParticipantIDs | ieee_primary_8954627 proquest_journals_2345515270 crossref_citationtrail_10_1109_LRA_2020_2965078 crossref_primary_10_1109_LRA_2020_2965078 |
| PublicationCentury | 2000 |
| PublicationDate | 2020-04-01 |
| PublicationDateYYYYMMDD | 2020-04-01 |
| PublicationDate_xml | – month: 04 year: 2020 text: 2020-04-01 day: 01 |
| PublicationDecade | 2020 |
| PublicationPlace | Piscataway |
| PublicationPlace_xml | – name: Piscataway |
| PublicationTitle | IEEE robotics and automation letters |
| PublicationTitleAbbrev | LRA |
| PublicationYear | 2020 |
| Publisher | IEEE The Institute of Electrical and Electronics Engineers, Inc. (IEEE) |
| Publisher_xml | – name: IEEE – name: The Institute of Electrical and Electronics Engineers, Inc. (IEEE) |
| References | ref13 ref12 duan (ref44) 0; 48 ref53 ref54 kolve (ref6) 2017 nowak (ref34) 2010; 3 ref19 del pobil (ref26) 0 munoz (ref35) 0 haarnoja (ref18) 2018 schulman (ref16) 2017 petrovskaya (ref21) 0 ref51 li (ref14) 0 ref50 anderson (ref15) 2018 ref45 savva (ref8) 0 ref48 ref41 siciliano (ref1) 2007 ref43 ref49 ref7 ref9 guadarrama (ref55) 2018 ref3 ref5 jakob (ref47) 2016 ref36 ref30 ref33 ref32 ref2 ref38 lillicrap (ref17) 2016 savva (ref39) 2017 jain (ref22) 0 cignoni (ref52) 0 urakami (ref40) 2019 chang (ref46) 2015 ref24 ref23 ref25 ref20 ref28 ref27 gao (ref37) 2019 ref29 coumans (ref4) 2013; 15 juliani (ref10) 2018 shum (ref42) 2000; 4067 armeni (ref11) 2017 balch (ref31) 2002; 23 |
| References_xml | – ident: ref50 doi: 10.1177/1745691610393980 – year: 0 ident: ref22 article-title: Behavior-based door opening with equilibrium point control publication-title: Proc RSS Workshop Manipulation for Human Environments – year: 0 ident: ref26 article-title: Benchmarks in robotics research publication-title: Proc Int Conf Intell Robots Syst – year: 2017 ident: ref16 article-title: Proximal policy optimization algorithms publication-title: arXiv 1707 06347 – year: 2017 ident: ref39 article-title: MINOS: Multimodal indoor simulator for navigation in complex environments publication-title: arXiv 1712 03931 – year: 2016 ident: ref17 article-title: Continuous control with deep reinforcement learning publication-title: Proc Intl Conf on Learning Representations – start-page: 2178 year: 0 ident: ref21 article-title: Probabilistic mobile manipulation in dynamic environments, with application to opening doors publication-title: Proc Int Joint Conf Artif Intell – year: 2016 ident: ref47 article-title: pybind11: Seamless operability between C++11 and python – volume: 4067 year: 2000 ident: ref42 publication-title: Visual Communications and Image Processing – volume: 48 start-page: 1329 year: 0 ident: ref44 article-title: Benchmarking deep reinforcement learning for continuous control publication-title: Proc Int Conf Mach Learn – ident: ref38 doi: 10.1145/3321408.3322633 – ident: ref25 doi: 10.1007/978-3-642-36279-8_2 – year: 2017 ident: ref6 article-title: AI2-THOR: An interactive 3D environment for visual AI publication-title: arXiv 1712 05474 – year: 2015 ident: ref46 article-title: ShapeNet: An information-rich 3D model repository publication-title: arXiv 1512 03012 – ident: ref45 doi: 10.1109/CVPR.2019.00319 – ident: ref5 doi: 10.1109/IROS.2004.1389727 – ident: ref51 doi: 10.1145/358669.358692 – year: 2018 ident: ref15 article-title: On evaluation of embodied navigation agents publication-title: arXiv 1807 06757 – ident: ref7 doi: 10.1109/CVPR.2018.00945 – ident: ref20 doi: 10.1109/ROBOT.2008.4543222 – year: 2007 ident: ref1 publication-title: Springer Handbook of Robotics – year: 2018 ident: ref55 article-title: TF-Agents: A library for reinforcement learning in tensorflow – year: 2018 ident: ref18 article-title: Soft actor-critic algorithms and applications publication-title: arXiv 1812 05905 – volume: 3 start-page: 1 year: 2010 ident: ref34 article-title: Benchmarks for mobile manipulation and robust obstacle avoidance and navigation publication-title: BRICS Deliverable D – ident: ref32 doi: 10.1109/100.813825 – ident: ref9 doi: 10.1109/3DV.2017.00081 – ident: ref12 doi: 10.1109/CVPR.2017.769 – ident: ref48 doi: 10.1109/CVPR.2019.00272 – ident: ref3 doi: 10.1109/IROS.2012.6386109 – ident: ref43 doi: 10.1145/2980179.2982420 – year: 2019 ident: ref40 article-title: DoorGym: A scalable door opening environment and baseline agent publication-title: arXiv 1908 01887 – ident: ref13 doi: 10.1109/LRA.2019.2925731 – ident: ref19 doi: 10.1109/IROS.2000.895316 – volume: 15 start-page: 5 year: 2013 ident: ref4 article-title: Bullet physics library publication-title: Open Source Bulletphysics Org – ident: ref33 doi: 10.1002/rob.20154 – ident: ref41 doi: 10.1109/ICRA.2019.8793735 – ident: ref27 doi: 10.1177/0278364913491297 – year: 0 ident: ref14 article-title: HRL4IN: Hierarchical reinforcement learning forinteractive navigation with mobile manipulators publication-title: Proc Conf Robot Learn – ident: ref53 doi: 10.1109/NaBIC.2011.6089465 – ident: ref36 doi: 10.5772/8988 – ident: ref30 doi: 10.1109/JPROC.2006.888394 – ident: ref29 doi: 10.1109/ICRA.2017.7989200 – year: 2018 ident: ref10 article-title: Unity: A general platform for intelligent agents publication-title: arXiv 1809 02627 – ident: ref49 doi: 10.1016/S1077-3142(02)00030-9 – ident: ref54 doi: 10.1016/j.procir.2014.10.055 – year: 2019 ident: ref37 article-title: VRkitchen: An interactive 3D virtual environment for task-oriented learning publication-title: arXiv 1903 05757 – ident: ref28 doi: 10.1007/978-3-319-23778-7_32 – ident: ref24 doi: 10.1007/978-3-540-68405-3_8 – ident: ref2 doi: 10.1007/s10846-008-9235-4 – ident: ref23 doi: 10.1142/S0219843605000545 – volume: 23 start-page: 13 year: 2002 ident: ref31 article-title: Ten years of the AAAI mobile robot competition and exhibition publication-title: AI Mag – start-page: 15 year: 0 ident: ref35 article-title: Evaluation of navigation of an autonomous mobile robot publication-title: Proc of the Perf Metrics for Intell Sys Workshop – year: 2017 ident: ref11 article-title: Joint 2D-3D-semantic data for indoor scene understanding publication-title: arXiv 1702 01105 – start-page: 9339 year: 0 ident: ref8 article-title: Habitat: A platform for embodied AI research publication-title: Proc IEEE/CVF Int Conf Comput Vision – start-page: 129 year: 0 ident: ref52 article-title: MeshLab: An open-source mesh processing tool publication-title: Proc Eurographics Italian Chapter Conf |
| SSID | ssj0001527395 |
| Score | 2.5643883 |
| Snippet | We present Interactive Gibson Benchmark, the first comprehensive benchmark for training and evaluating Interactive Navigation solutions. Interactive Navigation... We present Interactive Gibson Benchmark , the first comprehensive benchmark for training and evaluating Interactive Navigation solutions. Interactive... |
| SourceID | proquest crossref ieee |
| SourceType | Aggregation Database Enrichment Source Index Database Publisher |
| StartPage | 713 |
| SubjectTerms | Benchmark testing Benchmarks deep learning in robotics and automation Engines Indoor environments Interactive control Learning Measurement mobile manipulation Navigation Robotics Robots Solid modeling Task analysis Visual-based navigation |
| Title | Interactive Gibson Benchmark: A Benchmark for Interactive Navigation in Cluttered Environments |
| URI | https://ieeexplore.ieee.org/document/8954627 https://www.proquest.com/docview/2345515270 |
| Volume | 5 |
| WOSCitedRecordID | wos000526519900010&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| journalDatabaseRights | – providerCode: PRVIEE databaseName: IEEE Electronic Library (IEL) customDbUrl: eissn: 2377-3766 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0001527395 issn: 2377-3766 databaseCode: RIE dateStart: 20160101 isFulltext: true titleUrlDefault: https://ieeexplore.ieee.org/ providerName: IEEE – providerCode: PRVHPJ databaseName: ROAD: Directory of Open Access Scholarly Resources customDbUrl: eissn: 2377-3766 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0001527395 issn: 2377-3766 databaseCode: M~E dateStart: 20160101 isFulltext: true titleUrlDefault: https://road.issn.org providerName: ISSN International Centre |
| link | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1LS8QwEB5c8aAH3-L6IgcvgnXbJG0ab6useNBFRMGTJUknuKir7MOjv90k7a4LiuCthZlSMpPkm0lmPoBDnTJttBSRElpE3EoW5TphkeTOAWxmy1zaQDYhut384UHezMHxtBYGEcPlMzzxj-Esv3wzY58qa-Uy5RkVDWgIkVW1Wt_5FN9JTKaTk8hYtq5u2y7-o_EJlQ6GeB61mZ0nUKn8WH_DpnKx8r_fWYXlGjySdmXtNZjD_joszbQU3IDHkOJTYRUjFTs4OXOe-PSqBs-npP39QhxcJbPSXfUR-m04jV6fnL8ECmssSWemFm4T7i86d-eXUc2hEBmWilGkLcWYJ7mJE011zrTDP4yZkmZWUqTaijhDKTWVhmYqLR1eRKGo5taFqYIrtgXz_bc-bgMRmWIysTxDbjhirKjMhUkx8VETmrQJrcn4FqZuMO55Ll6KEGjEsnAWKbxFitoiTTiaarxXzTX-kN3wFpjK1YPfhL2JCYt69g0LyrgDgs4h4p3ftXZh0X-7uoGzB_OjwRj3YcF8jHrDwQE0rj87B8G9vgCpMc3Y |
| linkProvider | IEEE |
| linkToHtml | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV3dT9swED-VggR7GF-b6MaHH3hBItSxnTjeW4eomFYqhEDiich2zhoatKgU_v7ZTloqDU3aWyLdKZHvbP_u7LsfwKHJuLFGyURLIxPhFE8Kk_JECe8ALndVoVwkm5DDYXF7qy5bcDyvhUHEePkMT8JjPMuvxvYlpMq6hcpEzuQSLGdCMFpXa71lVEIvMZXNziKp6g6uej4CZPSEKQ9EApPawt4TyVT-WoHjttJf_78f2oCPDXwkvdrem9DC0RZ8WGgquA13Mcmn4zpGan5w8t374q9HPfn9jfTeXogHrGRReqhfY8cNr3E_IqcPkcQaK3K2UA33CW76Z9en50nDopBYnslpYhxDKtLC0tQwU3DjERDntmK5UwyZcZLmqJRhyrJcZ5VHjCg1M8L5QFUKzT9DezQe4Q4QmWuuUidyFFYgUs1UIW2GaYib0GYd6M7Gt7RNi_HAdPFQxlCDqtJbpAwWKRuLdOBorvFUt9f4h-x2sMBcrhn8DuzOTFg28--5ZFx4KOgdgn55X-sAVs-vLwbl4Mfw51dYC9-p7-PsQns6ecE9WLGv0_vnyX50sj-mbs_u |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Interactive+Gibson+Benchmark%3A+A+Benchmark+for+Interactive+Navigation+in+Cluttered+Environments&rft.jtitle=IEEE+robotics+and+automation+letters&rft.au=Xia%2C+Fei&rft.au=Shen%2C+William+B.&rft.au=Li%2C+Chengshu&rft.au=Kasimbeg%2C+Priya&rft.date=2020-04-01&rft.pub=IEEE&rft.eissn=2377-3766&rft.volume=5&rft.issue=2&rft.spage=713&rft.epage=720&rft_id=info:doi/10.1109%2FLRA.2020.2965078&rft.externalDocID=8954627 |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=2377-3766&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=2377-3766&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=2377-3766&client=summon |