Implementation and Evaluation of multimodal input/output channels for task-based industrial robot programming

Programming industrial robots is not very intuitive, and the programmer has to be a domain expert for e.g. welding and programming to know how the task is optimally executed. For SMEs such employees are not affordable, nor cost-effective. Therefore a new system is needed where domain experts from a...

Full description

Saved in:
Bibliographic Details
Published in:arXiv.org
Main Author: Profanter, Stefan
Format: Paper
Language:English
Published: Ithaca Cornell University Library, arXiv.org 17.03.2015
Subjects:
Assembly
Automation
Graphical user interface
Industrial robots
Manufacturing engineering
Programming languages
Robotics
Robots
Structural hierarchy
Subject specialists
Task analysis
Touch
Welding
ISSN:2331-8422
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Abstract Programming industrial robots is not very intuitive, and the programmer has to be a domain expert for e.g. welding and programming to know how the task is optimally executed. For SMEs such employees are not affordable, nor cost-effective. Therefore a new system is needed where domain experts from a specific area, like welding or assembly, can easily program a robot without knowing anything about programming languages or how to use TeachPads. Such a system needs to be flexible to adapt to new tasks and functions. These requirements can be met by using a task based programming approach where the robot program is built up using a hierarchical structure of process, tasks and skills. It also needs to be intuitive so that domain experts don't need much training time on handling the system. Intuitive interaction is achieved by using different input and output modalities like gesture input, speech input, or touch input which are suitable for the current task. This master thesis focuses on the implementation of a user interface (GUI) for task based industrial robot programming and evaluates different input modalities (gesture, speech, touch, pen input) for the interaction with the system. The evaluation is based on a user study conducted with 30 participants as a Wizard-Of-Oz experiment, where non expert users had to program assembly and welding tasks to an industrial robot, using the previously developed GUI and various input and output modalities. The findings of the task analysis and user study are then used for creating a semantic description which will be used in the cognitive robotics-worker cell for automatically inferring required system components, and to provide the best suited input modality.
AbstractList Programming industrial robots is not very intuitive, and the programmer has to be a domain expert for e.g. welding and programming to know how the task is optimally executed. For SMEs such employees are not affordable, nor cost-effective. Therefore a new system is needed where domain experts from a specific area, like welding or assembly, can easily program a robot without knowing anything about programming languages or how to use TeachPads. Such a system needs to be flexible to adapt to new tasks and functions. These requirements can be met by using a task based programming approach where the robot program is built up using a hierarchical structure of process, tasks and skills. It also needs to be intuitive so that domain experts don't need much training time on handling the system. Intuitive interaction is achieved by using different input and output modalities like gesture input, speech input, or touch input which are suitable for the current task. This master thesis focuses on the implementation of a user interface (GUI) for task based industrial robot programming and evaluates different input modalities (gesture, speech, touch, pen input) for the interaction with the system. The evaluation is based on a user study conducted with 30 participants as a Wizard-Of-Oz experiment, where non expert users had to program assembly and welding tasks to an industrial robot, using the previously developed GUI and various input and output modalities. The findings of the task analysis and user study are then used for creating a semantic description which will be used in the cognitive robotics-worker cell for automatically inferring required system components, and to provide the best suited input modality.
Author Profanter, Stefan
Author_xml – sequence: 1
  givenname: Stefan
  surname: Profanter
  fullname: Profanter, Stefan
BookMark eNotjk1LAzEYhIMoWGt_gLeA522TN5vs7lFK1ULBS-8lm4-6dZPUTVL8-Qba0zDDw8w8oXsfvEHohZJl3XJOVnL6Gy5LyglbkroTzR2aAWO0amuAR7SI8UQIAdEA52yG3NadR-OMTzINwWPpNd5c5JivNljs8pgGF7Qc8eDPOa1CTkWw-pbemzFiGyacZPypehmNLpDOMU1D4afQh4TPUzhO0rnBH5_Rg5VjNIubztH-fbNff1a7r4_t-m1XSQ5d1XTlm9VU1FQaoS30DVClODdMsb5RttOtEVybToEVICXRTJSwV5xCQzWbo9drbZn-zSamwynkyZfFA5CWtgSAdOwf0lZfUQ
ContentType Paper
Copyright 2015. This work is published under http://arxiv.org/licenses/nonexclusive-distrib/1.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.
Copyright_xml – notice: 2015. This work is published under http://arxiv.org/licenses/nonexclusive-distrib/1.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.
DBID 8FE
8FG
ABJCF
ABUWG
AFKRA
AZQEC
BENPR
BGLVJ
CCPQU
DWQXO
HCIFZ
L6V
M7S
PHGZM
PHGZT
PIMPY
PKEHL
PQEST
PQGLB
PQQKQ
PQUKI
PRINS
PTHSS
DOI 10.48550/arxiv.1503.04967
DatabaseName ProQuest SciTech Collection
ProQuest Technology Collection
Materials Science & Engineering Collection
ProQuest Central (Alumni)
ProQuest Central UK/Ireland
ProQuest Central Essentials - QC
ProQuest Central
ProQuest Technology Collection
ProQuest One Community College
ProQuest Central Korea
SciTech Premium Collection
ProQuest Engineering Collection
Engineering Database
ProQuest Central Premium
ProQuest One Academic (New)
Publicly Available Content Database
ProQuest One Academic Middle East (New)
ProQuest One Academic Eastern Edition (DO NOT USE)
ProQuest One Applied & Life Sciences
ProQuest One Academic (retired)
ProQuest One Academic UKI Edition
ProQuest Central China
Engineering Collection
DatabaseTitle Publicly Available Content Database
Engineering Database
Technology Collection
ProQuest One Academic Middle East (New)
ProQuest Central Essentials
ProQuest One Academic Eastern Edition
ProQuest Central (Alumni Edition)
SciTech Premium Collection
ProQuest One Community College
ProQuest Technology Collection
ProQuest SciTech Collection
ProQuest Central China
ProQuest Central
ProQuest One Applied & Life Sciences
ProQuest Engineering Collection
ProQuest One Academic UKI Edition
ProQuest Central Korea
Materials Science & Engineering Collection
ProQuest Central (New)
ProQuest One Academic
ProQuest One Academic (New)
Engineering Collection
DatabaseTitleList Publicly Available Content Database
Database_xml – sequence: 1
  dbid: PIMPY
  name: Publicly Available Content Database
  url: http://search.proquest.com/publiccontent
  sourceTypes: Aggregation Database
DeliveryMethod fulltext_linktorsrc
Discipline Physics
EISSN 2331-8422
Genre Working Paper/Pre-Print
GroupedDBID 8FE
8FG
ABJCF
ABUWG
AFKRA
ALMA_UNASSIGNED_HOLDINGS
AZQEC
BENPR
BGLVJ
CCPQU
DWQXO
FRJ
HCIFZ
L6V
M7S
M~E
PHGZM
PHGZT
PIMPY
PKEHL
PQEST
PQGLB
PQQKQ
PQUKI
PRINS
PTHSS
ID FETCH-LOGICAL-a529-79255fd1641ae6df2b721cc55e3c3b7cf9d8e65de9c2f62aa0d36f9dbc51271d3
IEDL.DBID M7S
IngestDate Mon Jun 30 09:36:57 EDT 2025
IsDoiOpenAccess true
IsOpenAccess true
IsPeerReviewed false
IsScholarly false
Language English
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-a529-79255fd1641ae6df2b721cc55e3c3b7cf9d8e65de9c2f62aa0d36f9dbc51271d3
Notes SourceType-Working Papers-1
ObjectType-Working Paper/Pre-Print-1
content type line 50
OpenAccessLink https://www.proquest.com/docview/2081802209?pq-origsite=%requestingapplication%
PQID 2081802209
PQPubID 2050157
ParticipantIDs proquest_journals_2081802209
PublicationCentury 2000
PublicationDate 20150317
PublicationDateYYYYMMDD 2015-03-17
PublicationDate_xml – month: 03
  year: 2015
  text: 20150317
  day: 17
PublicationDecade 2010
PublicationPlace Ithaca
PublicationPlace_xml – name: Ithaca
PublicationTitle arXiv.org
PublicationYear 2015
Publisher Cornell University Library, arXiv.org
Publisher_xml – name: Cornell University Library, arXiv.org
SSID ssj0002672553
Score 1.5582246
SecondaryResourceType preprint
Snippet Programming industrial robots is not very intuitive, and the programmer has to be a domain expert for e.g. welding and programming to know how the task is...
SourceID proquest
SourceType Aggregation Database
SubjectTerms Assembly
Automation
Graphical user interface
Industrial robots
Manufacturing engineering
Programming languages
Robotics
Robots
Structural hierarchy
Subject specialists
Task analysis
Touch
Welding
Title Implementation and Evaluation of multimodal input/output channels for task-based industrial robot programming
URI https://www.proquest.com/docview/2081802209
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwpV07T8MwELagBYmJt3iUygOr28Sp43hCArUCCaoIKlSmyrEdqYImJUkrfj5nNy1iYWGK8hgin3z33fm7-xC69gRlRumUsMhXpKcFI5GigiSR8IwwKuFOY-n1kQ-H0Xgs4rrgVta0yrVPdI5a58rWyCFJt13JlHriZv5JrGqUPV2tJTS2UdNOSfAdde9lU2OhIQfEHKwOM93orq4svqbLDqCgoAPYeKUu_8sFu7gy2P_vHx2gZiznpjhEWyY7QruOz6nKYzRzU39ndWNRhmWmcX8z2BvnKXZMwlmu5QeeZvNF1c0XFVyw7QTOIGBiQLO4kuU7sYFOw0drjQ9c5Ele4ZrZNYPYd4JGg_7o7p7UygpEMjAEBwOxVEOm5EsT6pQmkAcqxZgJVJBwlQodmZBpIxRNQyqlp4MQHiYK4AH3dXCKGlmemTOEg6AXUiV7qRVB0p5OfAURzosS6kvOfXWOWuvFm9S7o5z8rNzF368v0R4AFGY5Xz5voUZVLMwV2lHLaloWbdS87Q_j57YzOtzFD0_x2zchwbsw
linkProvider ProQuest
linkToHtml http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMw1V3JTsMwEB2xCk7sYscHOIYmTh3HB8SBRSBKhUSFuFWO7UgVNClJyvJR_CNjtwFx4dYDp0hJZDkex_PGfjMP4NAXlBmlU4_FgfKaWjAvVlR4SSx8I4xKuNNYemjxdjt-fBR3U_BZ58JYWmW9JrqFWufK7pFjkG6zkin1xengxbOqUfZ0tZbQGE2LG_PxhiFbeXJ9jvY9ovTyonN25Y1VBTzJsBMcO8dSjVFCIE2kU5pgDKQUYyZUYcJVKnRsIqaNUDSNqJS-DiO8mSh0jTzQITY7DbOIIqhwTMH77y0dGnFsOxydnbpKYQ1ZvPdejxF0hccIxUdi9r9WfOfGLpf-2QAsw-ydHJhiBaZMtgrzjq2qyjXou5rG_XHaVEZkpsnFd9lykqfE8ST7uZbPpJcNhlUjH1Z4ITbPOUM4QBCrk0qWT5514xpfqhVMSJEneUXGvLU-evZ16EziAzdgJsszswkkDJsRVbKZWokn7eskUOi__TihgeQ8UFuwW9uqO_73y-6Pobb_fnwAC1ed21a3dd2-2YFFhGLMstsCvgszVTE0ezCnXqteWey7eUagO2GzfgH0_hWP
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Implementation+and+Evaluation+of+multimodal+input%2Foutput+channels+for+task-based+industrial+robot+programming&rft.jtitle=arXiv.org&rft.au=Profanter%2C+Stefan&rft.date=2015-03-17&rft.pub=Cornell+University+Library%2C+arXiv.org&rft.eissn=2331-8422&rft_id=info:doi/10.48550%2Farxiv.1503.04967