Computer Vision Interface for Symbolic Programming of Cartesian Motion to introduce Visually Impaired Children into Robotic Sciences
Didactic material, aimed at sightless children interested in Robotics, should provide a suitable working environment for their specific sensory capacities and instill a spatial perception of motion and an ability to describe it in a logical and structured way. In this paper, to improve the user expe...
Gespeichert in:
| Veröffentlicht in: | International Conference on Electrical Engineering, Computing Science, and Automatic Control (Online) S. 1 - 6 |
|---|---|
| Hauptverfasser: | , |
| Format: | Tagungsbericht |
| Sprache: | Englisch |
| Veröffentlicht: |
IEEE
09.11.2022
|
| Schlagworte: | |
| ISSN: | 2642-3766 |
| Online-Zugang: | Volltext |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| Abstract | Didactic material, aimed at sightless children interested in Robotics, should provide a suitable working environment for their specific sensory capacities and instill a spatial perception of motion and an ability to describe it in a logical and structured way. In this paper, to improve the user experience learning the basics of coding robotic motion in a non-visual environment, we introduce a symbolic programming interface of assembling tokens based on artificial vision recognition that preserves the working space free of obstacles and simplifies the programming process by sliding tokens together on a flat board instead of requiring complex electromechanical connections between them. The computer vision system detects symbols and numbers based on a Boundary Object approach that extracts the main features of the captured images and assigns them to the closest class contained in a reference library. Detected symbols and numbers are identified as part of an ordered array and interpreted as commands with an argument, providing auditory assistance in the case of errors, before being executed in a real mobile robot for instant learning reinforcement. Tokens were ergonomically redesigned for children allowing a simple manipulation for easy assembling and providing tactile and visual information to allow easy recognition by users, their instructors, and the artificial vision system. Throughout the paper, we discuss the design criteria before presenting the final implementation and its first results. |
|---|---|
| AbstractList | Didactic material, aimed at sightless children interested in Robotics, should provide a suitable working environment for their specific sensory capacities and instill a spatial perception of motion and an ability to describe it in a logical and structured way. In this paper, to improve the user experience learning the basics of coding robotic motion in a non-visual environment, we introduce a symbolic programming interface of assembling tokens based on artificial vision recognition that preserves the working space free of obstacles and simplifies the programming process by sliding tokens together on a flat board instead of requiring complex electromechanical connections between them. The computer vision system detects symbols and numbers based on a Boundary Object approach that extracts the main features of the captured images and assigns them to the closest class contained in a reference library. Detected symbols and numbers are identified as part of an ordered array and interpreted as commands with an argument, providing auditory assistance in the case of errors, before being executed in a real mobile robot for instant learning reinforcement. Tokens were ergonomically redesigned for children allowing a simple manipulation for easy assembling and providing tactile and visual information to allow easy recognition by users, their instructors, and the artificial vision system. Throughout the paper, we discuss the design criteria before presenting the final implementation and its first results. |
| Author | Ruiz-Sanchez, Francisco J. Cavazos-Carrizales, Juan P. |
| Author_xml | – sequence: 1 givenname: Juan P. surname: Cavazos-Carrizales fullname: Cavazos-Carrizales, Juan P. email: juan.cavazos@cinvestav.mx organization: CINVESTAV-Saltillo,Robotica y Manufactura Avanzada,Saltillo, Coah.,Mexico,25000 – sequence: 2 givenname: Francisco J. surname: Ruiz-Sanchez fullname: Ruiz-Sanchez, Francisco J. email: fruiz@cinvestav.mx organization: CINVESTAV-Saltillo,Robotica y Manufactura Avanzada,Saltillo, Coah.,Mexico,25000 |
| BookMark | eNotkM1KAzEUhaMoWGufQIS8wNT8Z7KUoWqhotjitmQyNzUyk5TMdNG9D-4UuzmXyznfWZxbdBVTBIQeKJlTSsxjVS2k0sTMGWFsboyWRvALNDO6pEpJISUpxSWaMCVYwbVSN2jW9z-EEE7NKGqCfqvU7Q8DZPwV-pAiXsbx8dYB9inj9bGrUxsc_shpl23XhbjDyePK5gH6YCN-S8MJGxIOccipOYzkWHWwbXvEy25vQ4YGV9-hbTLEUyjhz1SPlMNrFyA66O_QtbdtD7PznaLN82JTvRar95dl9bQqgihVoTlpwAEzSvCSMss9Fb70lgKltal9Cb6mnumacCtLr5Wm3ikmx6QZfcmn6P6_NgDAdp9DZ_Nxe56N_wFtW2YB |
| ContentType | Conference Proceeding |
| DBID | 6IE 6IL CBEJK RIE RIL |
| DOI | 10.1109/CCE56709.2022.9975943 |
| DatabaseName | IEEE Electronic Library (IEL) Conference Proceedings IEEE Proceedings Order Plan All Online (POP All Online) 1998-present by volume IEEE Xplore All Conference Proceedings IEEE Electronic Library (IEL) IEEE Proceedings Order Plans (POP All) 1998-Present |
| DatabaseTitleList | |
| Database_xml | – sequence: 1 dbid: RIE name: IEEE Electronic Library (IEL) url: https://ieeexplore.ieee.org/ sourceTypes: Publisher |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Engineering |
| EISBN | 9781665455084 166545508X |
| EISSN | 2642-3766 |
| EndPage | 6 |
| ExternalDocumentID | 9975943 |
| Genre | orig-research |
| GroupedDBID | 6IE 6IF 6IL 6IN AAJGR AAWTH ABLEC ADZIZ ALMA_UNASSIGNED_HOLDINGS BEFXN BFFAM BGNUA BKEBE BPEOZ CBEJK CHZPO IEGSK OCL RIE RIL |
| ID | FETCH-LOGICAL-i486-730dece29643812a3f14f8fa1e11b9bf8efb1f27b03a58f7671fc6252a39b9b53 |
| IEDL.DBID | RIE |
| IngestDate | Wed Aug 27 02:18:55 EDT 2025 |
| IsPeerReviewed | false |
| IsScholarly | false |
| Language | English |
| LinkModel | DirectLink |
| MergedId | FETCHMERGED-LOGICAL-i486-730dece29643812a3f14f8fa1e11b9bf8efb1f27b03a58f7671fc6252a39b9b53 |
| PageCount | 6 |
| ParticipantIDs | ieee_primary_9975943 |
| PublicationCentury | 2000 |
| PublicationDate | 2022-Nov.-9 |
| PublicationDateYYYYMMDD | 2022-11-09 |
| PublicationDate_xml | – month: 11 year: 2022 text: 2022-Nov.-9 day: 09 |
| PublicationDecade | 2020 |
| PublicationTitle | International Conference on Electrical Engineering, Computing Science, and Automatic Control (Online) |
| PublicationTitleAbbrev | CCE |
| PublicationYear | 2022 |
| Publisher | IEEE |
| Publisher_xml | – name: IEEE |
| SSID | ssj0003190036 |
| Score | 1.8124505 |
| Snippet | Didactic material, aimed at sightless children interested in Robotics, should provide a suitable working environment for their specific sensory capacities and... |
| SourceID | ieee |
| SourceType | Publisher |
| StartPage | 1 |
| SubjectTerms | Computer vision Robot motion Robot sensing systems Symbols Three-dimensional displays Visualization Webcams |
| Title | Computer Vision Interface for Symbolic Programming of Cartesian Motion to introduce Visually Impaired Children into Robotic Sciences |
| URI | https://ieeexplore.ieee.org/document/9975943 |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| link | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1LSwMxEA61eNCLj1Z8k4NHt93sK8l5aVHQUrSU3kqSTaDQdqUPoXd_uDPpWhW8eFt2M1nIZGd2JvN9Q8hdxpPMgecPUmEgQNEmCrQQRcAsDzMtlAt9t4bhE-_1xGgk-zVyv8PCWGt98Zlt4aU_yy9Ks8ZUWVtKnsok3iN7nGdbrNYunwJbCblVKpAOC2U7zzspspNBEBhFrUr2VxMV70O6R_97-zFpfoPxaH_nZk5Izc5PyeEPHsEG-fjqzUCHHipOfZ7PKZCEf1L6uplppP_FabAYawZCtHQ0x3pOBFHSZ9_Lh65KOsHK9QL0jVOt1XS6oY9gMcAwFjSvgN84qKQvpQYpQyvrsGySQbczyB-Cqr1CMElEFsCnXVhj8dgVvHakYscSJ5xiljEttRPWaeYirsNYpcLxjDNnIFqCkRKep_EZqc_LuT0nNA0tcsokWkqI9iKhTFQ4LsJCoT0x7II0cDnHb1sCjXG1kpd_374iB6gxD_iT16S-WqztDdk376vJcnHrtf4Jwnuv6A |
| linkProvider | IEEE |
| linkToHtml | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1LTwIxEG4QTdSLDzC-7cGjC9t9tucNBCIQooRwI9tum5AAa3iYcPeHO1NW1MSLt81up5u03Zmddr7vI-QxioPIQOR3Qq4gQZHKcyTnmcN07EaSp8a1ag3DTtzr8dFI9EvkaYeF0Vrb4jNdw0t7lp_lao1bZXUh4lAE_h7ZR-UssUVr7XZUYDEhu0oB02GuqCdJI0R-MkgDPa9WWP-SUbFRpHnyv_efkuo3HI_2d4HmjJT0_Jwc_2ASrJCPL3UGOrRgcWp3-kwKlvBXSl83M4kEwNgNlmPNwIjmhiZY0YkwStq1aj50ldMJ1q5nMOPY1TqdTje0DT4DXGNGkwL6jY1y-pJLsFK08A_LKhk0G4Ok5RQCC84k4JEDH3emlcaDV4jbXuobFhhuUqYZk0Iaro1kxoul66chN3EUM6MgX4KWAp6H_gUpz_O5viQ0dDWyygRSCMj3PJ4qLzMxd7MUPYpiV6SCwzl-21JojIuRvP779gM5bA26nXGn3Xu-IUc4exb-J25JebVY6ztyoN5Xk-Xi3q6ATyISszc |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=proceeding&rft.title=International+Conference+on+Electrical+Engineering%2C+Computing+Science%2C+and+Automatic+Control+%28Online%29&rft.atitle=Computer+Vision+Interface+for+Symbolic+Programming+of+Cartesian+Motion+to+introduce+Visually+Impaired+Children+into+Robotic+Sciences&rft.au=Cavazos-Carrizales%2C+Juan+P.&rft.au=Ruiz-Sanchez%2C+Francisco+J.&rft.date=2022-11-09&rft.pub=IEEE&rft.eissn=2642-3766&rft.spage=1&rft.epage=6&rft_id=info:doi/10.1109%2FCCE56709.2022.9975943&rft.externalDocID=9975943 |