Symbolic representation of objects relative poses for robotic manipulation tasks
Collaborative robots (cobots) are democratizing industrial automation with their user-friendly programming approaches. Nevertheless, the Blockly-like interfaces typically available on cobots still require the user to define the program logic flow. Recent advancements in robotics research provide the...
Gespeichert in:
| Veröffentlicht in: | Engineering applications of artificial intelligence Jg. 163; S. 112882 |
|---|---|
| Hauptverfasser: | , , , |
| Format: | Journal Article |
| Sprache: | Englisch |
| Veröffentlicht: |
Elsevier Ltd
01.01.2026
|
| Schlagworte: | |
| ISSN: | 0952-1976 |
| Online-Zugang: | Volltext |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| Abstract | Collaborative robots (cobots) are democratizing industrial automation with their user-friendly programming approaches. Nevertheless, the Blockly-like interfaces typically available on cobots still require the user to define the program logic flow. Recent advancements in robotics research provide the robotic system with the reasoning capabilities given by symbolic artificial intelligence. This way, the cobot can acquire a new skill from a user demonstration, understand its semantics, and use symbolic planning for grounding and sequencing. Such methodologies rely on a symbolic description of the scene that should adequately represent how the cobot’s actions modify the environment. The symbols employed in the literature, however, either lack descriptive accuracy or are too specific for the targeted task, resulting in the application of the proposed teaching methodologies only to simple scenarios. This paper addresses these issues by introducing a methodology for symbolically describing general-purpose spatial relations between entities in a workspace, enhancing the flexibility and the range of application of cobots symbolic reasoning for complex manipulation tasks. The proposed approach involves defining a tunable set of predicates for relative positions and orientations, enabling precise symbolic representations, necessary for real-world tasks. The adoption of these symbols into a Programming by Demonstration framework empowers non-expert users to teach skills and deploy cobots in complex industrial tasks without coding. Experimental results demonstrate the effectiveness of this method, showing that first-time users can deploy cobots for a complex machine tending task comprising parts reorientations.
•Application of semantic-informed Programming by Demonstration for industrial tasks.•Definition of tunable, general-use quantitative symbols for relative positions.•Development of a strategy for representing relative orientations symbolically.•Validation through a user study on a machine-tending task with part reorientations. |
|---|---|
| AbstractList | Collaborative robots (cobots) are democratizing industrial automation with their user-friendly programming approaches. Nevertheless, the Blockly-like interfaces typically available on cobots still require the user to define the program logic flow. Recent advancements in robotics research provide the robotic system with the reasoning capabilities given by symbolic artificial intelligence. This way, the cobot can acquire a new skill from a user demonstration, understand its semantics, and use symbolic planning for grounding and sequencing. Such methodologies rely on a symbolic description of the scene that should adequately represent how the cobot’s actions modify the environment. The symbols employed in the literature, however, either lack descriptive accuracy or are too specific for the targeted task, resulting in the application of the proposed teaching methodologies only to simple scenarios. This paper addresses these issues by introducing a methodology for symbolically describing general-purpose spatial relations between entities in a workspace, enhancing the flexibility and the range of application of cobots symbolic reasoning for complex manipulation tasks. The proposed approach involves defining a tunable set of predicates for relative positions and orientations, enabling precise symbolic representations, necessary for real-world tasks. The adoption of these symbols into a Programming by Demonstration framework empowers non-expert users to teach skills and deploy cobots in complex industrial tasks without coding. Experimental results demonstrate the effectiveness of this method, showing that first-time users can deploy cobots for a complex machine tending task comprising parts reorientations.
•Application of semantic-informed Programming by Demonstration for industrial tasks.•Definition of tunable, general-use quantitative symbols for relative positions.•Development of a strategy for representing relative orientations symbolically.•Validation through a user study on a machine-tending task with part reorientations. |
| ArticleNumber | 112882 |
| Author | Rocco, Paolo Zappa, Isacco Zanchettin, Andrea Maria Vignali, Sara |
| Author_xml | – sequence: 1 givenname: Isacco orcidid: 0000-0003-2370-9867 surname: Zappa fullname: Zappa, Isacco email: isacco.zappa@polimi.it – sequence: 2 givenname: Sara orcidid: 0009-0003-8159-7944 surname: Vignali fullname: Vignali, Sara – sequence: 3 givenname: Andrea Maria orcidid: 0000-0002-1866-7482 surname: Zanchettin fullname: Zanchettin, Andrea Maria – sequence: 4 givenname: Paolo orcidid: 0000-0001-6716-434X surname: Rocco fullname: Rocco, Paolo |
| BookMark | eNqFkM9KxDAQh3NYwd3VV5C-QOskaWN6Uxb_wYKCeg5pMpXUtilJXdi3N0v17GlgZr4fM9-GrEY_IiFXFAoKVFx3BY6fepq0KxiwqqCUSclWZA11xXJa34hzsomxAwAuS7Emr2_HofG9M1nAKWDEcdaz82Pm28w3HZo5pkmfegfMJh8xZq0PWfCNnxM06NFN3_2CzDp-xQty1uo-4uVv3ZKPh_v33VO-f3l83t3tc8OhnnNNdSVoJVFDU9YltQbANgaQcluJsgSuBeO2FloyVra2gUpK3qbNxEnG-ZaIJdcEH2PAVk3BDTocFQV1cqE69edCnVyoxUUCbxcQ03UHh0FF43A0aF1I7yrr3X8RP3KGcDU |
| Cites_doi | 10.1177/0278364919897133 10.1080/13658816.2017.1420794 10.1613/jair.1705 10.1016/j.robot.2014.11.003 10.1109/TSMCC.2004.826273 10.1007/s00371-019-01708-4 10.1007/s12369-021-00775-9 10.1016/j.engappai.2024.108247 10.1177/0278364919850295 10.1016/j.engappai.2024.109456 10.1016/j.patcog.2020.107707 10.1109/CVPR52733.2024.01370 10.1613/jair.1.13754 10.1016/j.rcim.2015.04.002 10.3390/app13074635 10.1177/0278364911410459 10.24963/ijcai.2018/266 10.1109/LRA.2019.2928782 10.55417/fr.2022017 10.1613/jair.5575 10.1016/j.robot.2023.104452 10.1016/0952-1976(93)90063-4 10.1016/j.robot.2023.104367 10.1162/tacl_a_00220 10.1016/j.ifacol.2018.08.236 10.1016/j.robot.2012.06.001 10.1109/LRA.2019.2949221 10.1162/tacl_a_00566 10.1177/0278364911408155 10.1080/13658816.2022.2092115 |
| ContentType | Journal Article |
| Copyright | 2025 The Authors |
| Copyright_xml | – notice: 2025 The Authors |
| DBID | 6I. AAFTH AAYXX CITATION |
| DOI | 10.1016/j.engappai.2025.112882 |
| DatabaseName | ScienceDirect Open Access Titles Elsevier:ScienceDirect:Open Access CrossRef |
| DatabaseTitle | CrossRef |
| DatabaseTitleList | |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Applied Sciences Computer Science |
| ExternalDocumentID | 10_1016_j_engappai_2025_112882 S0952197625029136 |
| GroupedDBID | --K --M .DC .~1 0R~ 1B1 1~. 1~5 4.4 457 4G. 5GY 5VS 6I. 7-5 71M 8P~ 9JN AABNK AAEDT AAEDW AAFTH AAIKJ AAKOC AALRI AAOAW AAQFI AATTM AAXKI AAXUO AAYFN AAYWO ABBOA ABJNI ABMAC ACDAQ ACGFS ACLOT ACRLP ACVFH ACZNC ADBBV ADCNI ADEZE ADTZH AEBSH AECPX AEIPS AEKER AENEX AEUPX AFJKZ AFPUW AFTJW AGHFR AGUBO AGYEJ AHHHB AHJVU AHZHX AIALX AIEXJ AIGII AIIUN AIKHN AITUG AKBMS AKRWK AKYEP ALMA_UNASSIGNED_HOLDINGS AMRAJ ANKPU AOUOD APXCP AXJTR BJAXD BKOJK BLXMC CS3 DU5 EBS EFJIC EFKBS EFLBG EO8 EO9 EP2 EP3 F5P FDB FIRID FNPLU FYGXN G-Q GBLVA GBOLZ IHE J1W JJJVA KOM LG9 LY7 M41 MO0 N9A O-L O9- OAUVE OZT P-8 P-9 P2P PC. Q38 ROL RPZ SDF SDG SDP SES SEW SPC SPCBC SST SSV SSZ T5K TN5 ~G- ~HD 29G 9DU AAQXK AAYXX ABWVN ABXDB ACNNM ACRPL ADJOM ADMUD ADNMO AGQPQ ASPBG AVWKF AZFZN CITATION EJD FEDTE FGOYB G-2 HLZ HVGLF HZ~ R2- SBC SET UHS WUQ ZMT |
| ID | FETCH-LOGICAL-c309t-a1a56158ea0b4941dc00dbc0e13d564403a623d96a8224fdb05883f941a568233 |
| ISICitedReferencesCount | 0 |
| ISICitedReferencesURI | http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=001607298900003&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| ISSN | 0952-1976 |
| IngestDate | Thu Nov 27 01:04:33 EST 2025 Wed Dec 10 14:25:28 EST 2025 |
| IsDoiOpenAccess | true |
| IsOpenAccess | true |
| IsPeerReviewed | true |
| IsScholarly | true |
| Keywords | Collaborative robotics Symbolic knowledge representation Programming by demonstration Robot skill programming Symbolic artificial intelligence |
| Language | English |
| License | This is an open access article under the CC BY-NC-ND license. |
| LinkModel | OpenURL |
| MergedId | FETCHMERGED-LOGICAL-c309t-a1a56158ea0b4941dc00dbc0e13d564403a623d96a8224fdb05883f941a568233 |
| ORCID | 0009-0003-8159-7944 0000-0003-2370-9867 0000-0001-6716-434X 0000-0002-1866-7482 |
| OpenAccessLink | https://dx.doi.org/10.1016/j.engappai.2025.112882 |
| ParticipantIDs | crossref_primary_10_1016_j_engappai_2025_112882 elsevier_sciencedirect_doi_10_1016_j_engappai_2025_112882 |
| PublicationCentury | 2000 |
| PublicationDate | 2026-01-01 2026-01-00 |
| PublicationDateYYYYMMDD | 2026-01-01 |
| PublicationDate_xml | – month: 01 year: 2026 text: 2026-01-01 day: 01 |
| PublicationDecade | 2020 |
| PublicationTitle | Engineering applications of artificial intelligence |
| PublicationYear | 2026 |
| Publisher | Elsevier Ltd |
| Publisher_xml | – name: Elsevier Ltd |
| References | Kartmann, Liu, Asfour (b28) 2021 Bredeweg, Struss (b6) 2003; 24 Cheng, Yin, Fu, Guo, Yang, Kautz, Wang, Liu (b10) 2024 Liang, Pellier, Fiorino, Pesty (b37) 2022; 14 Wächter, Schulz, Asfour, Aksoy, Wörgötter, Dillmann (b55) 2013 Krishnamurthy, Kollar (b30) 2013; 1 Villani, Pini, Leali, Secchi, Fantuzzi (b54) 2018; 51 Lee, Hofmann, Williams (b33) 2019 Shridhar, Mittal, Hsu (b46) 2020; 39 Diehl, Paxton, Ramirez-Amaro (b12) 2021 Ghallab, Nau, Traverso (b22) 1998 Kulick, Toussaint, Lang, Lopes (b31) 2013 Lee, Hong, Hofmann, Williams (b34) 2020 Liu, Emerson, Collier (b38) 2023; 11 Pedersen, Nalpantidis, Andersen, Schou, Bøgh, Krüger, Madsen (b44) 2016; 37 Sjöö, Aydemir, Jensfelt (b47) 2012; 60 Fathi, Ramirez, Tavares, Gilliland (b16) 1993; 6 Konidaris, Kaelbling, Lozano-Perez (b29) 2018; 61 Wang, Chang, Liu, Wang (b56) 2024; 133 Berretti, Del Bimbo (b5) 2006; vol. 1 Gemignani, Capobianco, Nardi (b20) 2015 Steinmetz, Nitsch, Stulp (b50) 2019; 4 Aksoy, Abramov, Dörr, Ning, Dellen, Wörgötter (b3) 2011; 30 Sjöö, Jensfelt (b48) 2011 Eiband, Liebl, Willibald, Lee (b15) 2023; 162 Ma, Chen, Zhang, Chou, de Melo, Yuille (b39) 2024 Freksa (b18) 2015 Hart, Staveland (b24) 1988; vol. 52 Mota, T., Sridharan, M., 2018. Learning the grounding of expressions for spatial relations between objects. In: Workshop on Perception, Inference and Learning for Joint Semantic, Geometric and Physical Understanding at ICRA 2018. Aksoy, Tamosiunaite, Wörgötter (b4) 2015; 71 Jiang, He, Zhang, Zhao, Tan (b27) 2021; 112 George, Cheng, Pang, Neville (b21) 2023; 13 Aein, Aksoy, Wörgötter (b1) 2019; 38 Zanchettin (b61) 2023; 166 Skubic, Perzanowski, Blisard, Schultz, Adams, Bugajska, Brock (b49) 2004; 34 Chen, B., Xu, Z., Kirmani, S., Ichter, B., Sadigh, D., Guibas, L., Xia, F., 2024. Spatialvlm: Endowing vision-language models with spatial reasoning capabilities. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. pp. 14455–14465. Brooke (b7) 1996; 189 Chen, Guhur, Tapaswi, Schmid, Laptev (b8) 2022; 35 Tan, Ju, Liu (b51) 2014 Rosman, Ramamoorthy (b45) 2011; 30 Helmert (b25) 2006; 26 Mees, Abdo, Mazuran, Burgard (b40) 2017 Cormen, Leiserson, Rivest, Stein (b11) 2022 Lambers (b32) 2020; 36 Weintrop, Shepherd, Francis, Franklin (b57) 2017 Wu, Li, Sun, Lu (b58) 2023; 36 Yang, Garrett, Fox, Lozano-Pérez, Kaelbling (b59) 2024 Thippur, Burbridge, Kunze, Alberti, Folkesson, Jensfelt, Hawes (b53) 2015; vol. 29 Lewis, Sauro (b35) 2009 Mees, Emek, Vertens, Burgard (b41) 2020 Dreher, Wächter, Asfour (b14) 2019; 5 Diehl, Zappa, Zanchettin, Ramirez-Amaro (b13) 2024 Zhu, Janowicz, Cai, Mai (b62) 2022; 36 Guadarrama, Riano, Golland, Go, Jia, Klein, Abbeel, Darrell (b23) 2013 Park, J., Kim, Y.S., et al., 2007. Visual reasoning and design processes. In: DS 42: Proceedings of ICED 2007, the 16th International Conference on Engineering Design, Paris, France, 28.-31.07. 2007. pp. 333–334. Tellex, Kollar, Dickerson, Walter, Banerjee, Teller, Roy (b52) 2011; vol. 25 Ahmetoglu, Seker, Piater, Oztop, Ugur (b2) 2022; 75 Li, Li, Chen (b36) 2024; 138 Freksa, van de Ven, Wolter (b19) 2018; 32 Fichtl, McManus, Mustafa, Kraft, Krüger, Guerin (b17) 2014 Howard, Stump, Fink, Arkin, Paul, Park, Roy, Barber, Bendell, Schmeckpeper (b26) 2022; 2 Zampogiannis, Yang, Fermüller, Aloimonos (b60) 2015 Mees (10.1016/j.engappai.2025.112882_b40) 2017 Villani (10.1016/j.engappai.2025.112882_b54) 2018; 51 Ghallab (10.1016/j.engappai.2025.112882_b22) 1998 Wang (10.1016/j.engappai.2025.112882_b56) 2024; 133 Zanchettin (10.1016/j.engappai.2025.112882_b61) 2023; 166 10.1016/j.engappai.2025.112882_b9 Chen (10.1016/j.engappai.2025.112882_b8) 2022; 35 10.1016/j.engappai.2025.112882_b43 Eiband (10.1016/j.engappai.2025.112882_b15) 2023; 162 Zampogiannis (10.1016/j.engappai.2025.112882_b60) 2015 10.1016/j.engappai.2025.112882_b42 Liang (10.1016/j.engappai.2025.112882_b37) 2022; 14 Mees (10.1016/j.engappai.2025.112882_b41) 2020 Sjöö (10.1016/j.engappai.2025.112882_b47) 2012; 60 Helmert (10.1016/j.engappai.2025.112882_b25) 2006; 26 Kulick (10.1016/j.engappai.2025.112882_b31) 2013 Zhu (10.1016/j.engappai.2025.112882_b62) 2022; 36 Berretti (10.1016/j.engappai.2025.112882_b5) 2006; vol. 1 Aein (10.1016/j.engappai.2025.112882_b1) 2019; 38 Shridhar (10.1016/j.engappai.2025.112882_b46) 2020; 39 Fichtl (10.1016/j.engappai.2025.112882_b17) 2014 Konidaris (10.1016/j.engappai.2025.112882_b29) 2018; 61 Tellex (10.1016/j.engappai.2025.112882_b52) 2011; vol. 25 Steinmetz (10.1016/j.engappai.2025.112882_b50) 2019; 4 Liu (10.1016/j.engappai.2025.112882_b38) 2023; 11 Gemignani (10.1016/j.engappai.2025.112882_b20) 2015 Diehl (10.1016/j.engappai.2025.112882_b12) 2021 Lewis (10.1016/j.engappai.2025.112882_b35) 2009 Tan (10.1016/j.engappai.2025.112882_b51) 2014 Li (10.1016/j.engappai.2025.112882_b36) 2024; 138 Cormen (10.1016/j.engappai.2025.112882_b11) 2022 Ma (10.1016/j.engappai.2025.112882_b39) 2024 Freksa (10.1016/j.engappai.2025.112882_b19) 2018; 32 Freksa (10.1016/j.engappai.2025.112882_b18) 2015 Hart (10.1016/j.engappai.2025.112882_b24) 1988; vol. 52 Aksoy (10.1016/j.engappai.2025.112882_b4) 2015; 71 Bredeweg (10.1016/j.engappai.2025.112882_b6) 2003; 24 Howard (10.1016/j.engappai.2025.112882_b26) 2022; 2 Lee (10.1016/j.engappai.2025.112882_b33) 2019 George (10.1016/j.engappai.2025.112882_b21) 2023; 13 Lee (10.1016/j.engappai.2025.112882_b34) 2020 Skubic (10.1016/j.engappai.2025.112882_b49) 2004; 34 Fathi (10.1016/j.engappai.2025.112882_b16) 1993; 6 Ahmetoglu (10.1016/j.engappai.2025.112882_b2) 2022; 75 Cheng (10.1016/j.engappai.2025.112882_b10) 2024 Weintrop (10.1016/j.engappai.2025.112882_b57) 2017 Wächter (10.1016/j.engappai.2025.112882_b55) 2013 Aksoy (10.1016/j.engappai.2025.112882_b3) 2011; 30 Jiang (10.1016/j.engappai.2025.112882_b27) 2021; 112 Pedersen (10.1016/j.engappai.2025.112882_b44) 2016; 37 Lambers (10.1016/j.engappai.2025.112882_b32) 2020; 36 Diehl (10.1016/j.engappai.2025.112882_b13) 2024 Thippur (10.1016/j.engappai.2025.112882_b53) 2015; vol. 29 Yang (10.1016/j.engappai.2025.112882_b59) 2024 Brooke (10.1016/j.engappai.2025.112882_b7) 1996; 189 Dreher (10.1016/j.engappai.2025.112882_b14) 2019; 5 Wu (10.1016/j.engappai.2025.112882_b58) 2023; 36 Guadarrama (10.1016/j.engappai.2025.112882_b23) 2013 Kartmann (10.1016/j.engappai.2025.112882_b28) 2021 Krishnamurthy (10.1016/j.engappai.2025.112882_b30) 2013; 1 Rosman (10.1016/j.engappai.2025.112882_b45) 2011; 30 Sjöö (10.1016/j.engappai.2025.112882_b48) 2011 |
| References_xml | – volume: 34 start-page: 154 year: 2004 end-page: 167 ident: b49 article-title: Spatial language for human-robot dialogs publication-title: IEEE Trans. Syst. Man, Cybern. Part C (Applications Reviews) – volume: vol. 29 year: 2015 ident: b53 article-title: A comparison of qualitative and metric spatial relation models for scene understanding publication-title: Proceedings of the AAAI Conference on Artificial Intelligence – volume: 36 start-page: 1043 year: 2020 end-page: 1051 ident: b32 article-title: Survey of cube mapping methods in interactive computer graphics publication-title: Vis. Comput. – volume: 11 start-page: 635 year: 2023 end-page: 651 ident: b38 article-title: Visual spatial reasoning publication-title: Trans. Assoc. Comput. Linguist. – year: 2024 ident: b10 article-title: SpatialRGPT: Grounded spatial reasoning in vision language models – volume: 35 start-page: 20522 year: 2022 end-page: 20535 ident: b8 article-title: Language conditioned spatial relation reasoning for 3d object grounding publication-title: Adv. Neural Inf. Process. Syst. – volume: 36 start-page: 2194 year: 2022 end-page: 2225 ident: b62 article-title: Reasoning over higher-order qualitative spatial relations via spatially explicit neural networks publication-title: Int. J. Geogr. Inf. Sci. – volume: 5 start-page: 187 year: 2019 end-page: 194 ident: b14 article-title: Learning object-action relations from bimanual human demonstration using graph networks publication-title: IEEE Robot. Autom. Lett. – volume: 26 start-page: 191 year: 2006 end-page: 246 ident: b25 article-title: The fast downward planning system publication-title: J. Artificial Intelligence Res. – volume: 1 start-page: 193 year: 2013 end-page: 206 ident: b30 article-title: Jointly learning to parse and perceive: Connecting natural language to the physical world publication-title: Trans. Assoc. Comput. Linguist. – start-page: 1640 year: 2013 end-page: 1647 ident: b23 article-title: Grounding spatial relations for human-robot interaction publication-title: 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems – volume: 32 start-page: 2514 year: 2018 end-page: 2534 ident: b19 article-title: Formal representation of qualitative direction publication-title: Int. J. Geogr. Inf. Sci. – reference: Park, J., Kim, Y.S., et al., 2007. Visual reasoning and design processes. In: DS 42: Proceedings of ICED 2007, the 16th International Conference on Engineering Design, Paris, France, 28.-31.07. 2007. pp. 333–334. – volume: 75 start-page: 709 year: 2022 end-page: 745 ident: b2 article-title: Deepsym: Deep symbol generation and rule learning for planning from unsupervised robot interaction publication-title: J. Artificial Intelligence Res. – volume: 2 start-page: 468 year: 2022 end-page: 512 ident: b26 article-title: An intelligence architecture for grounded language communication with field robots publication-title: Field Robot. – volume: 61 start-page: 215 year: 2018 end-page: 289 ident: b29 article-title: From skills to symbols: Learning symbolic representations for abstract high-level planning publication-title: J. Artificial Intelligence Res. – volume: 133 year: 2024 ident: b56 article-title: Human–robot interaction-oriented video understanding of human actions publication-title: Eng. Appl. Artif. Intell. – volume: 112 year: 2021 ident: b27 article-title: Learning to transfer focus of graph neural network for scene graph parsing publication-title: Pattern Recognit. – start-page: 3175 year: 2017 end-page: 3182 ident: b40 article-title: Metric learning for generalizing spatial relations to new objects publication-title: 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems – volume: vol. 25 start-page: 1507 year: 2011 end-page: 1514 ident: b52 article-title: Understanding natural language commands for robotic navigation and mobile manipulation publication-title: Proceedings of the AAAI Conference on Artificial Intelligence – volume: 38 start-page: 910 year: 2019 end-page: 934 ident: b1 article-title: Library of actions: Implementing a generic robot execution framework by using manipulation action semantics publication-title: Int. J. Robot. Res. – start-page: 94 year: 2020 end-page: 100 ident: b41 article-title: Learning object placements for relational instructions by hallucinating scene representations publication-title: 2020 IEEE International Conference on Robotics and Automation – start-page: 189 year: 2013 end-page: 195 ident: b55 article-title: Action sequence reproduction based on automatic segmentation and object-action complexes publication-title: 2013 13th IEEE-RAS International Conference on Humanoid Robots (Humanoids) – volume: 37 year: 2016 ident: b44 article-title: Robot skills for manufacturing: From concept to industrial deployment publication-title: Robot. Comput.-Integr. Manuf. – volume: 138 year: 2024 ident: b36 article-title: Convolutional point transformer for semantic segmentation of sewer sonar point clouds publication-title: Eng. Appl. Artif. Intell. – volume: 162 year: 2023 ident: b15 article-title: Online task segmentation by merging symbolic and data-driven skill recognition during kinesthetic teaching publication-title: Robot. Auton. Syst. – start-page: 2348 year: 2024 end-page: 2355 ident: b13 article-title: Learning robot skills from demonstration for multi-agent planning publication-title: 2024 IEEE 20th International Conference on Automation Science and Engineering – start-page: 1451 year: 2013 end-page: 1457 ident: b31 article-title: Active learning for teaching a robot grounded relational symbols publication-title: IJCAI – volume: 30 start-page: 1328 year: 2011 end-page: 1342 ident: b45 article-title: Learning spatial relationships between objects publication-title: Int. J. Robot. Res. – volume: 166 year: 2023 ident: b61 article-title: Symbolic representation of what robots are taught in one demonstration publication-title: Robot. Auton. Syst. – start-page: 94 year: 2009 end-page: 103 ident: b35 article-title: The factor structure of the system usability scale publication-title: Human Centered Design: First International Conference, HCD 2009, Held As Part of HCI International 2009, San Diego, CA, USA, July 19-24, 2009 Proceedings 1 – start-page: 501 year: 2014 end-page: 508 ident: b17 article-title: Learning spatial relationships from 3D vision using histograms publication-title: 2014 IEEE International Conference on Robotics and Automation – start-page: 452 year: 2015 end-page: 464 ident: b20 article-title: Approaching qualitative spatial reasoning about distances and directions in robotics publication-title: Congress of the Italian Association for Artificial Intelligence – start-page: 1513 year: 2011 end-page: 1519 ident: b48 article-title: Learning spatial relations from functional simulation publication-title: 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems – volume: 30 start-page: 1229 year: 2011 end-page: 1249 ident: b3 article-title: Learning the semantics of object–action relations by observation publication-title: Int. J. Robot. Res. – volume: 51 start-page: 66 year: 2018 end-page: 71 ident: b54 article-title: Survey on human-robot interaction for robot programming in industrial applications publication-title: Ifac-PapersOnline – volume: 14 start-page: 177 year: 2022 end-page: 191 ident: b37 article-title: iRoPro: An interactive robot programming framework publication-title: Int. J. Soc. Robot. – volume: 36 start-page: 29680 year: 2023 end-page: 29691 ident: b58 article-title: Symbol-LLM: leverage language models for symbolic system in visual human activity reasoning publication-title: Adv. Neural Inf. Process. Syst. – year: 2024 ident: b39 article-title: 3Dsrbench: A comprehensive 3d spatial reasoning benchmark – volume: 39 start-page: 217 year: 2020 end-page: 232 ident: b46 article-title: Ingress: Interactive visual grounding of referring expressions publication-title: Int. J. Robot. Res. – start-page: 8057 year: 2020 end-page: 8064 ident: b34 article-title: QSRNet: Estimating qualitative spatial representations from RGB-D images publication-title: 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems – volume: 60 start-page: 1093 year: 2012 end-page: 1107 ident: b47 article-title: Topological spatial relations for active visual search publication-title: Robot. Auton. Syst. – volume: 189 start-page: 4 year: 1996 end-page: 7 ident: b7 article-title: SUS-A quick and dirty usability scale publication-title: Usability Eval. Ind. – start-page: 65 year: 2015 end-page: 86 ident: b18 article-title: Strong spatial cognition publication-title: International Conference on Spatial Information Theory – volume: 6 start-page: 203 year: 1993 end-page: 218 ident: b16 article-title: Symbolic reasoning and quantitative analysis for fault detection and isolation in process plants publication-title: Eng. Appl. Artif. Intell. – start-page: 736 year: 2019 end-page: 743 ident: b33 article-title: A model-based human activity recognition for human–robot collaboration publication-title: 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems – volume: 4 start-page: 3742 year: 2019 end-page: 3749 ident: b50 article-title: Intuitive task-level programming by demonstration through semantic skill recognition publication-title: IEEE Robot. Autom. Lett. – start-page: 1743 year: 2014 end-page: 1750 ident: b51 article-title: Grounding spatial relations in natural language by fuzzy representation for human-robot interaction publication-title: 2014 IEEE International Conference on Fuzzy Systems – volume: 24 year: 2003 ident: b6 article-title: Current topics in qualitative reasoning publication-title: AI Mag. – start-page: 6732 year: 2021 end-page: 6738 ident: b12 article-title: Automated generation of robotic planning domains from observations publication-title: 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems – volume: vol. 52 start-page: 139 year: 1988 end-page: 183 ident: b24 article-title: Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research publication-title: Advances in Psychology – year: 2022 ident: b11 article-title: Introduction to Algorithms – volume: 13 start-page: 4635 year: 2023 ident: b21 article-title: Task complexity and the skills dilemma in the programming and control of collaborative robots for manufacturing publication-title: Appl. Sci. – reference: Chen, B., Xu, Z., Kirmani, S., Ichter, B., Sadigh, D., Guibas, L., Xia, F., 2024. Spatialvlm: Endowing vision-language models with spatial reasoning capabilities. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. pp. 14455–14465. – volume: 71 start-page: 118 year: 2015 end-page: 133 ident: b4 article-title: Model-free incremental learning of the semantics of manipulation actions publication-title: Robot. Auton. Syst. – reference: Mota, T., Sridharan, M., 2018. Learning the grounding of expressions for spatial relations between objects. In: Workshop on Perception, Inference and Learning for Joint Semantic, Geometric and Physical Understanding at ICRA 2018. – year: 2017 ident: b57 article-title: Blockly goes to work: Block-based programming for industrial robots publication-title: 2017 IEEE Blocks and beyond Workshop (B&B) – year: 2024 ident: b59 article-title: Guiding long-horizon task and motion planning with vision language models – volume: vol. 1 start-page: 119 year: 2006 end-page: 122 ident: b5 article-title: Modeling spatial relationships between 3d objects publication-title: 18th International Conference on Pattern Recognition – start-page: 306 year: 2021 end-page: 313 ident: b28 article-title: Semantic scene manipulation based on 3D spatial object relations and language instructions publication-title: 2020 IEEE-RAS 20th International Conference on Humanoid Robots (Humanoids) – start-page: 1389 year: 2015 end-page: 1396 ident: b60 article-title: Learning the spatial semantics of manipulation actions through preposition grounding publication-title: 2015 IEEE International Conference on Robotics and Automation – year: 1998 ident: b22 article-title: PDDL - The Planning Domain Definition Language – volume: 39 start-page: 217 issue: 2–3 year: 2020 ident: 10.1016/j.engappai.2025.112882_b46 article-title: Ingress: Interactive visual grounding of referring expressions publication-title: Int. J. Robot. Res. doi: 10.1177/0278364919897133 – start-page: 1513 year: 2011 ident: 10.1016/j.engappai.2025.112882_b48 article-title: Learning spatial relations from functional simulation – volume: 32 start-page: 2514 issue: 12 year: 2018 ident: 10.1016/j.engappai.2025.112882_b19 article-title: Formal representation of qualitative direction publication-title: Int. J. Geogr. Inf. Sci. doi: 10.1080/13658816.2017.1420794 – volume: 26 start-page: 191 year: 2006 ident: 10.1016/j.engappai.2025.112882_b25 article-title: The fast downward planning system publication-title: J. Artificial Intelligence Res. doi: 10.1613/jair.1705 – start-page: 306 year: 2021 ident: 10.1016/j.engappai.2025.112882_b28 article-title: Semantic scene manipulation based on 3D spatial object relations and language instructions – year: 2024 ident: 10.1016/j.engappai.2025.112882_b10 – year: 2024 ident: 10.1016/j.engappai.2025.112882_b59 – year: 2017 ident: 10.1016/j.engappai.2025.112882_b57 article-title: Blockly goes to work: Block-based programming for industrial robots – volume: 71 start-page: 118 year: 2015 ident: 10.1016/j.engappai.2025.112882_b4 article-title: Model-free incremental learning of the semantics of manipulation actions publication-title: Robot. Auton. Syst. doi: 10.1016/j.robot.2014.11.003 – year: 2024 ident: 10.1016/j.engappai.2025.112882_b39 – volume: 34 start-page: 154 issue: 2 year: 2004 ident: 10.1016/j.engappai.2025.112882_b49 article-title: Spatial language for human-robot dialogs publication-title: IEEE Trans. Syst. Man, Cybern. Part C (Applications Reviews) doi: 10.1109/TSMCC.2004.826273 – volume: 36 start-page: 1043 issue: 5 year: 2020 ident: 10.1016/j.engappai.2025.112882_b32 article-title: Survey of cube mapping methods in interactive computer graphics publication-title: Vis. Comput. doi: 10.1007/s00371-019-01708-4 – volume: 14 start-page: 177 issue: 1 year: 2022 ident: 10.1016/j.engappai.2025.112882_b37 article-title: iRoPro: An interactive robot programming framework publication-title: Int. J. Soc. Robot. doi: 10.1007/s12369-021-00775-9 – volume: 133 year: 2024 ident: 10.1016/j.engappai.2025.112882_b56 article-title: Human–robot interaction-oriented video understanding of human actions publication-title: Eng. Appl. Artif. Intell. doi: 10.1016/j.engappai.2024.108247 – volume: 38 start-page: 910 issue: 8 year: 2019 ident: 10.1016/j.engappai.2025.112882_b1 article-title: Library of actions: Implementing a generic robot execution framework by using manipulation action semantics publication-title: Int. J. Robot. Res. doi: 10.1177/0278364919850295 – start-page: 6732 year: 2021 ident: 10.1016/j.engappai.2025.112882_b12 article-title: Automated generation of robotic planning domains from observations – volume: vol. 25 start-page: 1507 year: 2011 ident: 10.1016/j.engappai.2025.112882_b52 article-title: Understanding natural language commands for robotic navigation and mobile manipulation – start-page: 501 year: 2014 ident: 10.1016/j.engappai.2025.112882_b17 article-title: Learning spatial relationships from 3D vision using histograms – volume: 138 year: 2024 ident: 10.1016/j.engappai.2025.112882_b36 article-title: Convolutional point transformer for semantic segmentation of sewer sonar point clouds publication-title: Eng. Appl. Artif. Intell. doi: 10.1016/j.engappai.2024.109456 – start-page: 189 year: 2013 ident: 10.1016/j.engappai.2025.112882_b55 article-title: Action sequence reproduction based on automatic segmentation and object-action complexes – volume: 112 year: 2021 ident: 10.1016/j.engappai.2025.112882_b27 article-title: Learning to transfer focus of graph neural network for scene graph parsing publication-title: Pattern Recognit. doi: 10.1016/j.patcog.2020.107707 – ident: 10.1016/j.engappai.2025.112882_b9 doi: 10.1109/CVPR52733.2024.01370 – volume: 75 start-page: 709 year: 2022 ident: 10.1016/j.engappai.2025.112882_b2 article-title: Deepsym: Deep symbol generation and rule learning for planning from unsupervised robot interaction publication-title: J. Artificial Intelligence Res. doi: 10.1613/jair.1.13754 – start-page: 1451 year: 2013 ident: 10.1016/j.engappai.2025.112882_b31 article-title: Active learning for teaching a robot grounded relational symbols – volume: 36 start-page: 29680 year: 2023 ident: 10.1016/j.engappai.2025.112882_b58 article-title: Symbol-LLM: leverage language models for symbolic system in visual human activity reasoning publication-title: Adv. Neural Inf. Process. Syst. – volume: 37 year: 2016 ident: 10.1016/j.engappai.2025.112882_b44 article-title: Robot skills for manufacturing: From concept to industrial deployment publication-title: Robot. Comput.-Integr. Manuf. doi: 10.1016/j.rcim.2015.04.002 – volume: 13 start-page: 4635 issue: 7 year: 2023 ident: 10.1016/j.engappai.2025.112882_b21 article-title: Task complexity and the skills dilemma in the programming and control of collaborative robots for manufacturing publication-title: Appl. Sci. doi: 10.3390/app13074635 – volume: vol. 29 year: 2015 ident: 10.1016/j.engappai.2025.112882_b53 article-title: A comparison of qualitative and metric spatial relation models for scene understanding – volume: 30 start-page: 1229 issue: 10 year: 2011 ident: 10.1016/j.engappai.2025.112882_b3 article-title: Learning the semantics of object–action relations by observation publication-title: Int. J. Robot. Res. doi: 10.1177/0278364911410459 – ident: 10.1016/j.engappai.2025.112882_b42 doi: 10.24963/ijcai.2018/266 – volume: 4 start-page: 3742 issue: 4 year: 2019 ident: 10.1016/j.engappai.2025.112882_b50 article-title: Intuitive task-level programming by demonstration through semantic skill recognition publication-title: IEEE Robot. Autom. Lett. doi: 10.1109/LRA.2019.2928782 – volume: 2 start-page: 468 year: 2022 ident: 10.1016/j.engappai.2025.112882_b26 article-title: An intelligence architecture for grounded language communication with field robots publication-title: Field Robot. doi: 10.55417/fr.2022017 – volume: 61 start-page: 215 year: 2018 ident: 10.1016/j.engappai.2025.112882_b29 article-title: From skills to symbols: Learning symbolic representations for abstract high-level planning publication-title: J. Artificial Intelligence Res. doi: 10.1613/jair.5575 – start-page: 94 year: 2009 ident: 10.1016/j.engappai.2025.112882_b35 article-title: The factor structure of the system usability scale – start-page: 1640 year: 2013 ident: 10.1016/j.engappai.2025.112882_b23 article-title: Grounding spatial relations for human-robot interaction – start-page: 1743 year: 2014 ident: 10.1016/j.engappai.2025.112882_b51 article-title: Grounding spatial relations in natural language by fuzzy representation for human-robot interaction – volume: 166 year: 2023 ident: 10.1016/j.engappai.2025.112882_b61 article-title: Symbolic representation of what robots are taught in one demonstration publication-title: Robot. Auton. Syst. doi: 10.1016/j.robot.2023.104452 – start-page: 8057 year: 2020 ident: 10.1016/j.engappai.2025.112882_b34 article-title: QSRNet: Estimating qualitative spatial representations from RGB-D images – volume: vol. 52 start-page: 139 year: 1988 ident: 10.1016/j.engappai.2025.112882_b24 article-title: Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research – volume: vol. 1 start-page: 119 year: 2006 ident: 10.1016/j.engappai.2025.112882_b5 article-title: Modeling spatial relationships between 3d objects – volume: 6 start-page: 203 issue: 3 year: 1993 ident: 10.1016/j.engappai.2025.112882_b16 article-title: Symbolic reasoning and quantitative analysis for fault detection and isolation in process plants publication-title: Eng. Appl. Artif. Intell. doi: 10.1016/0952-1976(93)90063-4 – volume: 35 start-page: 20522 year: 2022 ident: 10.1016/j.engappai.2025.112882_b8 article-title: Language conditioned spatial relation reasoning for 3d object grounding publication-title: Adv. Neural Inf. Process. Syst. – volume: 162 year: 2023 ident: 10.1016/j.engappai.2025.112882_b15 article-title: Online task segmentation by merging symbolic and data-driven skill recognition during kinesthetic teaching publication-title: Robot. Auton. Syst. doi: 10.1016/j.robot.2023.104367 – start-page: 94 year: 2020 ident: 10.1016/j.engappai.2025.112882_b41 article-title: Learning object placements for relational instructions by hallucinating scene representations – volume: 1 start-page: 193 year: 2013 ident: 10.1016/j.engappai.2025.112882_b30 article-title: Jointly learning to parse and perceive: Connecting natural language to the physical world publication-title: Trans. Assoc. Comput. Linguist. doi: 10.1162/tacl_a_00220 – year: 1998 ident: 10.1016/j.engappai.2025.112882_b22 – year: 2022 ident: 10.1016/j.engappai.2025.112882_b11 – volume: 51 start-page: 66 issue: 11 year: 2018 ident: 10.1016/j.engappai.2025.112882_b54 article-title: Survey on human-robot interaction for robot programming in industrial applications publication-title: Ifac-PapersOnline doi: 10.1016/j.ifacol.2018.08.236 – volume: 60 start-page: 1093 issue: 9 year: 2012 ident: 10.1016/j.engappai.2025.112882_b47 article-title: Topological spatial relations for active visual search publication-title: Robot. Auton. Syst. doi: 10.1016/j.robot.2012.06.001 – start-page: 2348 year: 2024 ident: 10.1016/j.engappai.2025.112882_b13 article-title: Learning robot skills from demonstration for multi-agent planning – start-page: 736 year: 2019 ident: 10.1016/j.engappai.2025.112882_b33 article-title: A model-based human activity recognition for human–robot collaboration – start-page: 65 year: 2015 ident: 10.1016/j.engappai.2025.112882_b18 article-title: Strong spatial cognition – volume: 5 start-page: 187 issue: 1 year: 2019 ident: 10.1016/j.engappai.2025.112882_b14 article-title: Learning object-action relations from bimanual human demonstration using graph networks publication-title: IEEE Robot. Autom. Lett. doi: 10.1109/LRA.2019.2949221 – volume: 11 start-page: 635 year: 2023 ident: 10.1016/j.engappai.2025.112882_b38 article-title: Visual spatial reasoning publication-title: Trans. Assoc. Comput. Linguist. doi: 10.1162/tacl_a_00566 – start-page: 1389 year: 2015 ident: 10.1016/j.engappai.2025.112882_b60 article-title: Learning the spatial semantics of manipulation actions through preposition grounding – volume: 189 start-page: 4 issue: 194 year: 1996 ident: 10.1016/j.engappai.2025.112882_b7 article-title: SUS-A quick and dirty usability scale publication-title: Usability Eval. Ind. – start-page: 3175 year: 2017 ident: 10.1016/j.engappai.2025.112882_b40 article-title: Metric learning for generalizing spatial relations to new objects – volume: 30 start-page: 1328 issue: 11 year: 2011 ident: 10.1016/j.engappai.2025.112882_b45 article-title: Learning spatial relationships between objects publication-title: Int. J. Robot. Res. doi: 10.1177/0278364911408155 – volume: 24 issue: 4 year: 2003 ident: 10.1016/j.engappai.2025.112882_b6 article-title: Current topics in qualitative reasoning publication-title: AI Mag. – volume: 36 start-page: 2194 issue: 11 year: 2022 ident: 10.1016/j.engappai.2025.112882_b62 article-title: Reasoning over higher-order qualitative spatial relations via spatially explicit neural networks publication-title: Int. J. Geogr. Inf. Sci. doi: 10.1080/13658816.2022.2092115 – start-page: 452 year: 2015 ident: 10.1016/j.engappai.2025.112882_b20 article-title: Approaching qualitative spatial reasoning about distances and directions in robotics – ident: 10.1016/j.engappai.2025.112882_b43 |
| SSID | ssj0003846 |
| Score | 2.4447565 |
| Snippet | Collaborative robots (cobots) are democratizing industrial automation with their user-friendly programming approaches. Nevertheless, the Blockly-like... |
| SourceID | crossref elsevier |
| SourceType | Index Database Publisher |
| StartPage | 112882 |
| SubjectTerms | Collaborative robotics Programming by demonstration Robot skill programming Symbolic artificial intelligence Symbolic knowledge representation |
| Title | Symbolic representation of objects relative poses for robotic manipulation tasks |
| URI | https://dx.doi.org/10.1016/j.engappai.2025.112882 |
| Volume | 163 |
| WOSCitedRecordID | wos001607298900003&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| journalDatabaseRights | – providerCode: PRVESC databaseName: Elsevier SD Freedom Collection Journals 2021 issn: 0952-1976 databaseCode: AIEXJ dateStart: 19950201 customDbUrl: isFulltext: true dateEnd: 99991231 titleUrlDefault: https://www.sciencedirect.com omitProxy: false ssIdentifier: ssj0003846 providerName: Elsevier |
| link | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwtV1Lb9QwELaWtgcuQFsQ5SUfuEUpzts-VqiI9lBVpVR7i-zYqXaBZLUJq_JT-LeMX9lsqYAeuESrkT27yXyafJ6dB0JvuRKCskqFecqSMFVFFDJgBaEo0poJlRHO7bCJ4uyMTqfsfDL56WthVl-LpqE3N2zxX00NMjC2Lp29h7kHpSCAz2B0uILZ4fpPhv_045vQzX4D06_S1xYZVtiKuUnesAUsKxUs2k6ZhgzBshWt7t2q22H4kV5Bz7sv3Ubsft29MBj_9W2yCZYm7cgMARn1-Rwi07DeENWTjldV68VXs2t9FPDB6fXqBtDUDx0OJHBbXVc0G1ZctKDFcmDw3-PgRTwOXvgoZBxGzI6AGRyyc3nWpQIhpHY-0W_e3gYe5oequdb3MIPjfpwdrjdstte-9dobkhF9ntu89HpKrae0eh6g7bjIGPj87aOT4-np8JpPqK0C83cwKj-_-xfdzXxGbObyCXrkjiH4yMJnF01Us4ceuyMJdg6_A5Gf-uFl--jcAwxvAgy3NXYAwx5g2AAMA8CwAxgeAwwbgD1Fnz8cX77_GLq5HGGVENaHPOLAujOqOBEpSyNZESJFRVSUyAz4NUk4kGrJcq5TlGspSEZpUsNK2EfjJHmGtpq2Uc8RjnPK80zleQ0bVcVBH6eyrmUuI1IXxQF6559ZubDtV8o_2-sAMf9oS0ciLTksATV_2fvi3t_2Ej1cw_oV2uqX39VrtFOt-lm3fOMg8wv7QJv6 |
| linkProvider | Elsevier |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Symbolic+representation+of+objects+relative+poses+for+robotic+manipulation+tasks&rft.jtitle=Engineering+applications+of+artificial+intelligence&rft.au=Zappa%2C+Isacco&rft.au=Vignali%2C+Sara&rft.au=Zanchettin%2C+Andrea+Maria&rft.au=Rocco%2C+Paolo&rft.date=2026-01-01&rft.issn=0952-1976&rft.volume=163&rft.spage=112882&rft_id=info:doi/10.1016%2Fj.engappai.2025.112882&rft.externalDBID=n%2Fa&rft.externalDocID=10_1016_j_engappai_2025_112882 |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0952-1976&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0952-1976&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0952-1976&client=summon |