Assessing industrial end-user programming of robotic production cells: A controlled experiment
Adapting the behavior of robots and their interaction with other machines on the shop floor is typically accomplished by non-programmers. Often these non-programmers use visual languages to specify the robot’s and/or machine’s control logic. While visual languages are explored as a means to enable n...
Uložené v:
| Vydané v: | The Journal of systems and software Ročník 195; s. 111547 |
|---|---|
| Hlavní autori: | , , , , |
| Médium: | Journal Article |
| Jazyk: | English |
| Vydavateľské údaje: |
Elsevier Inc
01.01.2023
|
| Predmet: | |
| ISSN: | 0164-1212, 1873-1228 |
| On-line prístup: | Získať plný text |
| Tagy: |
Pridať tag
Žiadne tagy, Buďte prvý, kto otaguje tento záznam!
|
| Abstract | Adapting the behavior of robots and their interaction with other machines on the shop floor is typically accomplished by non-programmers. Often these non-programmers use visual languages to specify the robot’s and/or machine’s control logic. While visual languages are explored as a means to enable novices to program, there is little understanding of what problems novices face when tasked with realistic adaptation programming tasks on the shop floor. In this paper, we report the results of a controlled experiment where domain experts in the injection molding industry inspected and changed realistic programs involving a robot, injection molding machine, and additional external machines. We found that participants were comparably quick to understand the program behavior with a familiar sequential function chart-based language and a Blockly-based language used for the first time. We also observed that these non-programmers had difficulty in multiple aspects independent of language due to the interweaving of physical and software-centric interaction between robot and machine. We conclude that assistance needs to go beyond optimizing available language elements to include suggesting relevant programming elements and their sequence.
•We compare Blockly and a Sequential Function Chart-based visual language.•Blockly is easy to understand for industrial non-programmers reading it for the first time.•Visual languages provide too little support to non-programmers to implement realistic tasks.•Non-programmers would need additional assistance.•Challenges were robot moving and gripping commands and interaction with external machines. |
|---|---|
| AbstractList | Adapting the behavior of robots and their interaction with other machines on the shop floor is typically accomplished by non-programmers. Often these non-programmers use visual languages to specify the robot’s and/or machine’s control logic. While visual languages are explored as a means to enable novices to program, there is little understanding of what problems novices face when tasked with realistic adaptation programming tasks on the shop floor. In this paper, we report the results of a controlled experiment where domain experts in the injection molding industry inspected and changed realistic programs involving a robot, injection molding machine, and additional external machines. We found that participants were comparably quick to understand the program behavior with a familiar sequential function chart-based language and a Blockly-based language used for the first time. We also observed that these non-programmers had difficulty in multiple aspects independent of language due to the interweaving of physical and software-centric interaction between robot and machine. We conclude that assistance needs to go beyond optimizing available language elements to include suggesting relevant programming elements and their sequence.
•We compare Blockly and a Sequential Function Chart-based visual language.•Blockly is easy to understand for industrial non-programmers reading it for the first time.•Visual languages provide too little support to non-programmers to implement realistic tasks.•Non-programmers would need additional assistance.•Challenges were robot moving and gripping commands and interaction with external machines. |
| ArticleNumber | 111547 |
| Author | Fürschuss, Harald Hohensinger, Doris Salomon, Christian Mayr-Dorn, Christoph Winterer, Mario |
| Author_xml | – sequence: 1 givenname: Christoph orcidid: 0000-0001-9791-6442 surname: Mayr-Dorn fullname: Mayr-Dorn, Christoph email: christoph.mayr-dorn@jku.at organization: Institute for Software Systems Engineering, Johannes Kepler University, Linz, Austria – sequence: 2 givenname: Mario surname: Winterer fullname: Winterer, Mario email: mario.winterer@scch.at organization: Software Competence Center Hagenberg GmbH, Hagenberg, Austria – sequence: 3 givenname: Christian surname: Salomon fullname: Salomon, Christian email: christian.salomon@scch.at organization: Software Competence Center Hagenberg GmbH, Hagenberg, Austria – sequence: 4 givenname: Doris surname: Hohensinger fullname: Hohensinger, Doris email: doris.hohensinger@scch.at organization: Software Competence Center Hagenberg GmbH, Hagenberg, Austria – sequence: 5 givenname: Harald surname: Fürschuss fullname: Fürschuss, Harald organization: ENGEL Austria GmbH, Schwertberg, Austria |
| BookMark | eNp9kE1OwzAQhS1UJNrCAdj5Agkex60TWFUVf1IlNrDFcu1J5Si1K9tFcHsSlRWLrmY0877RmzcjEx88EnILrAQGy7uu7FIqOeO8BICFkBdkCrWsCuC8npDpoBFDD_yKzFLqGGNyEE_J5yolTMn5HXXeHlOOTvcUvS2OCSM9xLCLer8f96GlMWxDdmYc26PJLnhqsO_TPV1RE3yOoe_RUvw-YHR79PmaXLa6T3jzV-fk4-nxff1SbN6eX9erTWEqwXIBpqlEIyVuG7Cy4gwQubDADN9aAQ3atmkWVi-qtm2ErZmWaMUSa62XhiFWcyJPd00MKUVslXFZjwZz1K5XwNQYk-rUEJMaY1KnmAYS_pGHwbqOP2eZhxODw0tfDqNKxqE3aF1Ek5UN7gz9C4xThMk |
| CitedBy_id | crossref_primary_10_1080_03601277_2024_2412367 |
| Cites_doi | 10.1007/s10664-013-9279-3 10.1109/BLOCKS.2017.8120412 10.1109/MESA.2014.6935597 10.1109/IROS.2018.8594127 10.1109/ICRA.2019.8793988 10.1109/VLHCC.2018.8506557 10.1016/j.compedu.2018.01.011 10.1145/3358711.3361630 10.1145/1352135.1352260 10.1109/ACCESS.2019.2895913 10.1109/ICRA.2015.7139973 10.1145/2676723.2691871 10.1145/1868358.1868363 10.1145/3015455 10.1145/3173574.3173940 |
| ContentType | Journal Article |
| Copyright | 2022 The Author(s) |
| Copyright_xml | – notice: 2022 The Author(s) |
| DBID | 6I. AAFTH AAYXX CITATION |
| DOI | 10.1016/j.jss.2022.111547 |
| DatabaseName | ScienceDirect Open Access Titles Elsevier:ScienceDirect:Open Access CrossRef |
| DatabaseTitle | CrossRef |
| DatabaseTitleList | |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Computer Science |
| EISSN | 1873-1228 |
| ExternalDocumentID | 10_1016_j_jss_2022_111547 S0164121222002230 |
| GroupedDBID | --K --M -~X .DC .~1 0R~ 1B1 1~. 1~5 29L 4.4 457 4G. 5GY 5VS 6I. 7-5 71M 8P~ 9JN 9M8 AABNK AACTN AAEDT AAEDW AAFTH AAIKJ AAKOC AALRI AAOAW AAQFI AAQXK AAXUO AAYFN AAYOK ABBOA ABEFU ABFNM ABFRF ABFSI ABJNI ABMAC ABTAH ABXDB ABYKQ ACDAQ ACGFO ACGFS ACGOD ACNNM ACRLP ACZNC ADBBV ADEZE ADHUB ADJOM ADMUD AEBSH AEFWE AEKER AENEX AFKWA AFTJW AGHFR AGUBO AGYEJ AHHHB AHZHX AI. AIALX AIEXJ AIKHN AITUG AJBFU AJOXV ALMA_UNASSIGNED_HOLDINGS AMFUW AMRAJ AOUOD ASPBG AVWKF AXJTR AZFZN BKOJK BKOMP BLXMC CS3 DU5 E.L EBS EFJIC EFLBG EJD EO8 EO9 EP2 EP3 FDB FEDTE FGOYB FIRID FNPLU FYGXN G-Q G8K GBLVA GBOLZ HLZ HVGLF HZ~ IHE J1W KOM LG9 M41 MO0 MS~ N9A O-L O9- OAUVE OZT P-8 P-9 P2P PC. PQQKQ Q38 R2- RIG RNS ROL RPZ RXW SBC SDF SDG SDP SES SEW SPC SPCBC SSV SSZ T5K TAE TN5 TWZ UHS UNMZH VH1 WUQ XPP ZMT ZY4 ~G- 9DU AATTM AAXKI AAYWO AAYXX ABDPE ABWVN ACLOT ACRPL ACVFH ADCNI ADNMO AEIPS AEUPX AFJKZ AFPUW AGQPQ AIGII AIIUN AKBMS AKRWK AKYEP ANKPU APXCP CITATION EFKBS ~HD |
| ID | FETCH-LOGICAL-c340t-1c934977eb91d73201ee24d10c2bd419edf995da53ff94d80a7ed46e8aa6c0ee3 |
| ISICitedReferencesCount | 2 |
| ISICitedReferencesURI | http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000906907300009&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| ISSN | 0164-1212 |
| IngestDate | Tue Nov 18 22:42:21 EST 2025 Sat Nov 29 07:24:31 EST 2025 Fri Feb 23 02:39:30 EST 2024 |
| IsDoiOpenAccess | true |
| IsOpenAccess | true |
| IsPeerReviewed | true |
| IsScholarly | true |
| Keywords | Sequential function charts End-user programming Block-based programming languages Manufacturing automation Robot programming |
| Language | English |
| License | This is an open access article under the CC BY license. |
| LinkModel | OpenURL |
| MergedId | FETCHMERGED-LOGICAL-c340t-1c934977eb91d73201ee24d10c2bd419edf995da53ff94d80a7ed46e8aa6c0ee3 |
| ORCID | 0000-0001-9791-6442 |
| OpenAccessLink | https://dx.doi.org/10.1016/j.jss.2022.111547 |
| ParticipantIDs | crossref_citationtrail_10_1016_j_jss_2022_111547 crossref_primary_10_1016_j_jss_2022_111547 elsevier_sciencedirect_doi_10_1016_j_jss_2022_111547 |
| PublicationCentury | 2000 |
| PublicationDate | January 2023 2023-01-00 |
| PublicationDateYYYYMMDD | 2023-01-01 |
| PublicationDate_xml | – month: 01 year: 2023 text: January 2023 |
| PublicationDecade | 2020 |
| PublicationTitle | The Journal of systems and software |
| PublicationYear | 2023 |
| Publisher | Elsevier Inc |
| Publisher_xml | – name: Elsevier Inc |
| References | Almusaly, I., Metoyer, R., Jensen, C., 2018. Evaluation of a visual programming keyboard on touchscreen devices. In: 2018 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC). pp. 57–64. Selwyn-Smith, B., Homer, M., Anslow, C., 2017. Towards collaborative block-based programming on digital tabletops. In: 2017 IEEE Blocks and beyond Workshop (B B). pp. 57–60. Alexandrova, S., Tatlock, Z., Cakmak, M., 2015. Roboflow: A flow-based visual programming language for mobile manipulation tasks. In: 2015 IEEE International Conference on Robotics and Automation. ICRA, pp. 5537–5544. Trower, J., Gray, J., 2015. Blockly language creation and applications: Visual programming for media computation and bluetooth robotics control. In: Proceedings of the 46th ACM Technical Symposium on Computer Science Education. p. 5. Ritschel, Kovalenko, Holmes, Garcia, Shepherd (b25) 2020 Corral, Ruíz-Rube, Balcells, Mota-Macías, Morgado-Estévez, Dodero (b12) 2019; 7 Bangor, Kortum, Miller (b5) 2009; 4 Fraser (b13) 2015 Sauro, Dumas (b26) 2009 Shepherd, Kraft, Francis (b29) 2019 Maloney, Resnick, Rusk, Silverman, Eastmond (b19) 2010; 10 Sutherland, MacDonald (b30) 2018 Weintrop, D., Afzal, A., Salac, J., Francis, P., Li, B., Shepherd, D.C., Franklin, D., 2018. Evaluating coblox: A comparative study of robotics programming environments for adult novices. In: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. pp. 1–12. Blume (b8) 2013 Bau, Gray, Kelleher, Sheldon, Turbak (b6) 2017; 60 Paxton, C., Jonathan, F., Hundt, A., Mutlu, B., Hager, G.D., 2018. Evaluating methods for end-user creation of robot task plans. In: 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems. IROS, pp. 6086–6092. Weintrop, Shepherd, Francis, Franklin (b34) 2017 Topalli, Cagiltay (b31) 2018; 120 Coronado, Mastrogiovanni, Venture (b11) 2019 Lewis, Lewis (b17) 1998 Bischoff, Kazi, Seyfarth (b7) 2002 Mayr-Dorn, Winterer, Salomon, Hohensinger, Ramler (b21) 2021 Ball, T., Chatra, A., de Halleux, P., Hodges, S., Moskal, M., Russell, J., 2019. Microsoft makecode: embedded programming for education, in blocks and typescript. In: Proceedings of the 2019 ACM SIGPLAN Symposium on SPLASH-E. pp. 7–12. McDermott, Ghallab, Howe, Knoblock, Ram, Veloso, Weld, Wilkins (b22) 1998 Kumaar, Tsb (b16) 2011 Winterer, Salomon, Köberle, Ramler, Schittengruber (b35) 2020 Brooke (b9) 1996; 189 Ko, LaToza, Burnett (b15) 2015; 20 Mateo, C., Brunete, A., Gambao, E., Hernando, M., 2014. Hammer: An android based application for end-user industrial robot programming. In: 2014 IEEE/ASME 10th International Conference on Mechatronic and Embedded Systems and Applications. MESA, pp. 1–6. Ajaykumar, Huang (b1) 2020 Maloney, J.H., Peppler, K., Kafai, Y., Resnick, M., Rusk, N., 2008. Programming by choice: urban youth learning programming with scratch. In: Proceedings of the 39th SIGCSE Technical Symposium on Computer Science Education. pp. 367–371. Rahman, Roy, Lo (b24) 2016 Caraco, Deibel, Ma, Milne (b10) 2019 Sefidgar, Agarwal, Cakmak (b27) 2017 Gadre, S.Y., Rosen, E., Chien, G., Phillips, E., Tellex, S., Konidaris, G., 2019. End-user robot programming using mixed reality. In: 2019 International Conference on Robotics and Automation. ICRA, pp. 2707–2713. 10.1016/j.jss.2022.111547_b32 Caraco (10.1016/j.jss.2022.111547_b10) 2019 Sefidgar (10.1016/j.jss.2022.111547_b27) 2017 10.1016/j.jss.2022.111547_b33 Bischoff (10.1016/j.jss.2022.111547_b7) 2002 10.1016/j.jss.2022.111547_b18 McDermott (10.1016/j.jss.2022.111547_b22) 1998 Topalli (10.1016/j.jss.2022.111547_b31) 2018; 120 10.1016/j.jss.2022.111547_b14 Shepherd (10.1016/j.jss.2022.111547_b29) 2019 Corral (10.1016/j.jss.2022.111547_b12) 2019; 7 Winterer (10.1016/j.jss.2022.111547_b35) 2020 Weintrop (10.1016/j.jss.2022.111547_b34) 2017 Blume (10.1016/j.jss.2022.111547_b8) 2013 Kumaar (10.1016/j.jss.2022.111547_b16) 2011 10.1016/j.jss.2022.111547_b3 10.1016/j.jss.2022.111547_b2 10.1016/j.jss.2022.111547_b20 10.1016/j.jss.2022.111547_b23 10.1016/j.jss.2022.111547_b4 Ritschel (10.1016/j.jss.2022.111547_b25) 2020 Sutherland (10.1016/j.jss.2022.111547_b30) 2018 Ajaykumar (10.1016/j.jss.2022.111547_b1) 2020 Ko (10.1016/j.jss.2022.111547_b15) 2015; 20 10.1016/j.jss.2022.111547_b28 Fraser (10.1016/j.jss.2022.111547_b13) 2015 Bau (10.1016/j.jss.2022.111547_b6) 2017; 60 Brooke (10.1016/j.jss.2022.111547_b9) 1996; 189 Bangor (10.1016/j.jss.2022.111547_b5) 2009; 4 Lewis (10.1016/j.jss.2022.111547_b17) 1998 Mayr-Dorn (10.1016/j.jss.2022.111547_b21) 2021 Rahman (10.1016/j.jss.2022.111547_b24) 2016 Coronado (10.1016/j.jss.2022.111547_b11) 2019 Maloney (10.1016/j.jss.2022.111547_b19) 2010; 10 Sauro (10.1016/j.jss.2022.111547_b26) 2009 |
| References_xml | – start-page: 450 year: 2019 end-page: 457 ident: b11 article-title: Design of a human-centered robot framework for end-user programming and applications publication-title: ROMANSY 22–Robot Design, Dynamics and Control – start-page: 85 year: 2013 end-page: 86 ident: b8 article-title: Iprogram: intuitive programming of an industrial hri cell publication-title: 2013 8th ACM/IEEE International Conference on Human-Robot Interaction – start-page: 49 year: 2015 end-page: 50 ident: b13 article-title: Ten things we’ve learned from blockly publication-title: 2015 IEEE Blocks and beyond Workshop (Blocks and beyond) – start-page: 1599 year: 2009 end-page: 1608 ident: b26 article-title: Comparison of three one-question, post-task usability questionnaires publication-title: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Ser. CHI ’09 – start-page: 13 year: 2019 end-page: 16 ident: b29 article-title: Visualizing the “hidden” variables in robot programs publication-title: Proceedings of the 2nd International Workshop on Robotics Software Engineering, RoSE@ICSE 2019, Montreal, QC, Canada, May 27, 2019 – reference: Alexandrova, S., Tatlock, Z., Cakmak, M., 2015. Roboflow: A flow-based visual programming language for mobile manipulation tasks. In: 2015 IEEE International Conference on Robotics and Automation. ICRA, pp. 5537–5544. – reference: Weintrop, D., Afzal, A., Salac, J., Francis, P., Li, B., Shepherd, D.C., Franklin, D., 2018. Evaluating coblox: A comparative study of robotics programming environments for adult novices. In: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. pp. 1–12. – volume: 120 start-page: 64 year: 2018 end-page: 74 ident: b31 article-title: Improving programming skills in engineering education through problem-based game projects with scratch publication-title: Comput. Educ. – reference: Ball, T., Chatra, A., de Halleux, P., Hodges, S., Moskal, M., Russell, J., 2019. Microsoft makecode: embedded programming for education, in blocks and typescript. In: Proceedings of the 2019 ACM SIGPLAN Symposium on SPLASH-E. pp. 7–12. – reference: Almusaly, I., Metoyer, R., Jensen, C., 2018. Evaluation of a visual programming keyboard on touchscreen devices. In: 2018 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC). pp. 57–64. – start-page: 93 year: 2020 end-page: 95 ident: b1 article-title: User needs and design opportunities in end-user robot programming publication-title: Companion of the 2020 ACM/IEEE International Conference on Human-Robot Interaction, Ser. HRI ’20 – start-page: 1 year: 2020 ident: b25 article-title: Comparing block-based programming models for two-armed robots publication-title: IEEE Trans. Softw. Eng. – year: 1998 ident: b17 article-title: Programming Industrial Control Systems using IEC 1131-3 – reference: Gadre, S.Y., Rosen, E., Chien, G., Phillips, E., Tellex, S., Konidaris, G., 2019. End-user robot programming using mixed reality. In: 2019 International Conference on Robotics and Automation. ICRA, pp. 2707–2713. – start-page: 5 year: 2021 end-page: 12 ident: b21 article-title: Considerations for using block-based languages for industrial robot programming - a case study publication-title: 3rd IEEE/ACM International Workshop on Robotics Software Engineering, RoSE@ICSE 2021, Madrid, Spain, June 2, 2021 – start-page: 1231 year: 2020 end-page: 1234 ident: b35 article-title: An expert review on the applicability of Blockly for industrial robot programming publication-title: 25th IEEE International Conference on Emerging Technologies and Factory Automation, ETFA 2020, Vienna, Austria, September (2020) 8-11 – volume: 7 start-page: 17 535 year: 2019 end-page: 17 550 ident: b12 article-title: A study on the suitability of visual languages for non-expert robot programmers publication-title: IEEE Access – year: 1998 ident: b22 article-title: PDDL—the Planning Domain Definition Language – start-page: 29 year: 2017 end-page: 36 ident: b34 article-title: Blockly goes to work: Block-based programming for industrial robots publication-title: 2017 IEEE Blocks and beyond Workshop (B & B) – volume: 20 start-page: 110 year: 2015 end-page: 141 ident: b15 article-title: A practical guide to controlled experiments of software engineering tools with human participants publication-title: Empir. Softw. Eng. – reference: Paxton, C., Jonathan, F., Hundt, A., Mutlu, B., Hager, G.D., 2018. Evaluating methods for end-user creation of robot task plans. In: 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems. IROS, pp. 6086–6092. – start-page: 473 year: 2017 end-page: 482 ident: b27 article-title: Situated tangible robot programming publication-title: Proceedings of the 2017 ACM/IEEE International Conference on Human-Robot Interaction, Ser. HRI ’17 – volume: 189 year: 1996 ident: b9 article-title: SUS: a “quick and dirty” usability scale publication-title: Usability Eval. Ind. – start-page: 349 year: 2016 end-page: 359 ident: b24 article-title: Rack: Automatic api recommendation using crowdsourced knowledge publication-title: 2016 IEEE 23rd International Conference on Software Analysis, Evolution, and Reengineering (SANER), Vol. 1 – start-page: 482 year: 2002 end-page: 487 ident: b7 article-title: The morpha style guide for icon-based programming publication-title: Proceedings. 11th IEEE International Workshop on Robot and Human Interactive Communication – volume: 10 start-page: 1 year: 2010 end-page: 15 ident: b19 article-title: The scratch programming language and environment publication-title: ACM Trans. Comput. Educ. (TOCE) – reference: Trower, J., Gray, J., 2015. Blockly language creation and applications: Visual programming for media computation and bluetooth robotics control. In: Proceedings of the 46th ACM Technical Symposium on Computer Science Education. p. 5. – volume: 60 start-page: 72 year: 2017 end-page: 80 ident: b6 article-title: Learnable programming: blocks and beyond publication-title: Commun. ACM – reference: Maloney, J.H., Peppler, K., Kafai, Y., Resnick, M., Rusk, N., 2008. Programming by choice: urban youth learning programming with scratch. In: Proceedings of the 39th SIGCSE Technical Symposium on Computer Science Education. pp. 367–371. – reference: Mateo, C., Brunete, A., Gambao, E., Hernando, M., 2014. Hammer: An android based application for end-user industrial robot programming. In: 2014 IEEE/ASME 10th International Conference on Mechatronic and Embedded Systems and Applications. MESA, pp. 1–6. – start-page: 206 year: 2011 end-page: 209 ident: b16 article-title: Mobile robot programming by demonstration publication-title: Proceedings of the 2011 Fourth International Conference on Emerging Trends in Engineering & Technology, Ser. ICETET ’11 – start-page: 648 year: 2019 end-page: 650 ident: b10 article-title: Making the blockly library accessible via touchscreen publication-title: the 21st International ACM SIGACCESS Conference on Computers and Accessibility, Ser. ASSETS ’19 – reference: Selwyn-Smith, B., Homer, M., Anslow, C., 2017. Towards collaborative block-based programming on digital tabletops. In: 2017 IEEE Blocks and beyond Workshop (B B). pp. 57–60. – volume: 4 start-page: 114 year: 2009 end-page: 123 ident: b5 article-title: Determining what individual sus scores mean: Adding an adjective rating scale publication-title: J. Usability Stud. – start-page: 431 year: 2018 end-page: 436 ident: b30 article-title: Naoblocks: A case study of developing a children’s robot programming environment publication-title: 2018 15th International Conference on Ubiquitous Robots – start-page: 450 year: 2019 ident: 10.1016/j.jss.2022.111547_b11 article-title: Design of a human-centered robot framework for end-user programming and applications – start-page: 1 year: 2020 ident: 10.1016/j.jss.2022.111547_b25 article-title: Comparing block-based programming models for two-armed robots publication-title: IEEE Trans. Softw. Eng. – volume: 20 start-page: 110 issue: 1 year: 2015 ident: 10.1016/j.jss.2022.111547_b15 article-title: A practical guide to controlled experiments of software engineering tools with human participants publication-title: Empir. Softw. Eng. doi: 10.1007/s10664-013-9279-3 – ident: 10.1016/j.jss.2022.111547_b28 doi: 10.1109/BLOCKS.2017.8120412 – ident: 10.1016/j.jss.2022.111547_b20 doi: 10.1109/MESA.2014.6935597 – start-page: 5 year: 2021 ident: 10.1016/j.jss.2022.111547_b21 article-title: Considerations for using block-based languages for industrial robot programming - a case study – start-page: 85 year: 2013 ident: 10.1016/j.jss.2022.111547_b8 article-title: Iprogram: intuitive programming of an industrial hri cell – start-page: 1231 year: 2020 ident: 10.1016/j.jss.2022.111547_b35 article-title: An expert review on the applicability of Blockly for industrial robot programming – start-page: 349 year: 2016 ident: 10.1016/j.jss.2022.111547_b24 article-title: Rack: Automatic api recommendation using crowdsourced knowledge – ident: 10.1016/j.jss.2022.111547_b23 doi: 10.1109/IROS.2018.8594127 – start-page: 431 year: 2018 ident: 10.1016/j.jss.2022.111547_b30 article-title: Naoblocks: A case study of developing a children’s robot programming environment – start-page: 49 year: 2015 ident: 10.1016/j.jss.2022.111547_b13 article-title: Ten things we’ve learned from blockly – ident: 10.1016/j.jss.2022.111547_b14 doi: 10.1109/ICRA.2019.8793988 – volume: 4 start-page: 114 issue: 3 year: 2009 ident: 10.1016/j.jss.2022.111547_b5 article-title: Determining what individual sus scores mean: Adding an adjective rating scale publication-title: J. Usability Stud. – volume: 189 year: 1996 ident: 10.1016/j.jss.2022.111547_b9 article-title: SUS: a “quick and dirty” usability scale publication-title: Usability Eval. Ind. – start-page: 473 year: 2017 ident: 10.1016/j.jss.2022.111547_b27 article-title: Situated tangible robot programming – ident: 10.1016/j.jss.2022.111547_b3 doi: 10.1109/VLHCC.2018.8506557 – volume: 120 start-page: 64 year: 2018 ident: 10.1016/j.jss.2022.111547_b31 article-title: Improving programming skills in engineering education through problem-based game projects with scratch publication-title: Comput. Educ. doi: 10.1016/j.compedu.2018.01.011 – ident: 10.1016/j.jss.2022.111547_b4 doi: 10.1145/3358711.3361630 – year: 1998 ident: 10.1016/j.jss.2022.111547_b17 – ident: 10.1016/j.jss.2022.111547_b18 doi: 10.1145/1352135.1352260 – volume: 7 start-page: 17 535 year: 2019 ident: 10.1016/j.jss.2022.111547_b12 article-title: A study on the suitability of visual languages for non-expert robot programmers publication-title: IEEE Access doi: 10.1109/ACCESS.2019.2895913 – ident: 10.1016/j.jss.2022.111547_b2 doi: 10.1109/ICRA.2015.7139973 – start-page: 482 year: 2002 ident: 10.1016/j.jss.2022.111547_b7 article-title: The morpha style guide for icon-based programming – ident: 10.1016/j.jss.2022.111547_b32 doi: 10.1145/2676723.2691871 – start-page: 93 year: 2020 ident: 10.1016/j.jss.2022.111547_b1 article-title: User needs and design opportunities in end-user robot programming – volume: 10 start-page: 1 issue: 4 year: 2010 ident: 10.1016/j.jss.2022.111547_b19 article-title: The scratch programming language and environment publication-title: ACM Trans. Comput. Educ. (TOCE) doi: 10.1145/1868358.1868363 – start-page: 13 year: 2019 ident: 10.1016/j.jss.2022.111547_b29 article-title: Visualizing the “hidden” variables in robot programs – start-page: 648 year: 2019 ident: 10.1016/j.jss.2022.111547_b10 article-title: Making the blockly library accessible via touchscreen – volume: 60 start-page: 72 issue: 6 year: 2017 ident: 10.1016/j.jss.2022.111547_b6 article-title: Learnable programming: blocks and beyond publication-title: Commun. ACM doi: 10.1145/3015455 – start-page: 29 year: 2017 ident: 10.1016/j.jss.2022.111547_b34 article-title: Blockly goes to work: Block-based programming for industrial robots – year: 1998 ident: 10.1016/j.jss.2022.111547_b22 – ident: 10.1016/j.jss.2022.111547_b33 doi: 10.1145/3173574.3173940 – start-page: 206 year: 2011 ident: 10.1016/j.jss.2022.111547_b16 article-title: Mobile robot programming by demonstration – start-page: 1599 year: 2009 ident: 10.1016/j.jss.2022.111547_b26 article-title: Comparison of three one-question, post-task usability questionnaires |
| SSID | ssj0007202 |
| Score | 2.3825998 |
| Snippet | Adapting the behavior of robots and their interaction with other machines on the shop floor is typically accomplished by non-programmers. Often these... |
| SourceID | crossref elsevier |
| SourceType | Enrichment Source Index Database Publisher |
| StartPage | 111547 |
| SubjectTerms | Block-based programming languages End-user programming Manufacturing automation Robot programming Sequential function charts |
| Title | Assessing industrial end-user programming of robotic production cells: A controlled experiment |
| URI | https://dx.doi.org/10.1016/j.jss.2022.111547 |
| Volume | 195 |
| WOSCitedRecordID | wos000906907300009&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| journalDatabaseRights | – providerCode: PRVESC databaseName: Elsevier SD Freedom Collection Journals 2021 customDbUrl: eissn: 1873-1228 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0007202 issn: 0164-1212 databaseCode: AIEXJ dateStart: 19950101 isFulltext: true titleUrlDefault: https://www.sciencedirect.com providerName: Elsevier |
| link | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwtV3LbtQwFLWGKQs2vBHlJS9YIaVKbOdhdiNUVBBULAqaFZFfkTqaJqNkKOVP-FyuYyfOVC2iCzbRKIo90ZwzzvHNveci9NoomaW54pFSUkRMwT9dUpvjbkycKVDIpPfS-_YpPz4ulkv-ZTb7PdTCnK_zui4uLvjmv0IN5wBsWzp7A7jHSeEEfAbQ4Qiww_GfgHevcV2pytiWw9Q6svGIIR_rzCc7t41srGXrxhm_Wi7YUH7nCtZ9HvsaRGnoBDCVs6GwrJe0zhbauT53sL7_FNPU2l9tZPsh71gahLCPBdjR5zNs35sx8iPWzVkzGTSh85EtLen6uKTbC7SnO1EMQidRDB_YzKx_YrK7MvN0srYm1jkov3LZdxGI1cGqsw7shByEa3ctti89-saExCHXbVXCFKWdonRT3EJ7JE95MUd7iw-Hy4_jUz4nfT7reN_DG_M-d_DSfVyteSY65uQ-uuvRwgtHnAdoZuqH6N7Q3AP7tf4R-j7yCAce4YFHeMIj3FTY8wgHHuGeR2_xAgcW4cCix-jr-8OTd0eRb8YRKcribZQoThlsFozkic4p6EZjCNNJrIjULOFGV5ynWqS0qjjTRSxyo1lmCiEyFRtDn6B53dTmKcI6rooklVpSQlkqMkl1VoCytfESQaTcR_Hwc5XKO9Xbhinr8lqY9tGbccjG2bT87WI2YFB6nen0Ywl8un7Ys5t8x3N0J9D8BZpv2x_mJbqtzrenXfvKk-kPxwGjCQ |
| linkProvider | Elsevier |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Assessing+industrial+end-user+programming+of+robotic+production+cells%3A+A+controlled+experiment&rft.jtitle=The+Journal+of+systems+and+software&rft.au=Mayr-Dorn%2C+Christoph&rft.au=Winterer%2C+Mario&rft.au=Salomon%2C+Christian&rft.au=Hohensinger%2C+Doris&rft.date=2023-01-01&rft.issn=0164-1212&rft.volume=195&rft.spage=111547&rft_id=info:doi/10.1016%2Fj.jss.2022.111547&rft.externalDBID=n%2Fa&rft.externalDocID=10_1016_j_jss_2022_111547 |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0164-1212&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0164-1212&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0164-1212&client=summon |