Enhancing User Interaction: Gesture-Enabled Virtual Cursor with Voice Integration

The research article proposes a novel approach combining voice control with gesture-enabled virtual mouse technology to enhance human-computer interaction. Using this cutting-edge technology, which uses computer vision techniques to identify hand landmarks, users may control cursor motions using ges...

Celý popis

Uložené v:
Podrobná bibliografia
Vydané v:2024 4th International Conference on Pervasive Computing and Social Networking (ICPCSN) s. 279 - 286
Hlavní autori: Devi, V. Anjana, E, Jahnavi, R, Kavipriya
Médium: Konferenčný príspevok..
Jazyk:English
Vydavateľské údaje: IEEE 03.05.2024
Predmet:
On-line prístup:Získať plný text
Tagy: Pridať tag
Žiadne tagy, Buďte prvý, kto otaguje tento záznam!
Abstract The research article proposes a novel approach combining voice control with gesture-enabled virtual mouse technology to enhance human-computer interaction. Using this cutting-edge technology, which uses computer vision techniques to identify hand landmarks, users may control cursor motions using gestures. However, a number of problems with the current methods, such as snapshot algorithms, cloud-based voice assistants, and hand contour extraction, restrict their effectiveness. The accuracy of cursor control may be impacted by challenges in precisely interpreting user gestures due to the intricacy of gesture mapping and a restricted gesture language. Furthermore, the voice assistant component of the system is not robust enough to handle a variety of speech instructions and dynamic voice commands, and it is also dependent on an internet connection. Additionally, there aren't many error handling capabilities, which might lead to worse-than-ideal user experiences when orders aren't carried out precisely. Notwithstanding these difficulties, the proposed system incorporates voice assistant features beyond mouse control, enabling users to utilize mouse motions and natural language instructions to do a variety of activities, including sending emails, opening apps, executing mouse functions, searching the web, and managing files. To fully realize the potential of this integrated voice and gesture-controlled system in improving user experiences and accessibility, it will be imperative to address these issues through enhanced gesture vocabulary, expanded gesture recognition algorithms, and improved voice command processing.
AbstractList The research article proposes a novel approach combining voice control with gesture-enabled virtual mouse technology to enhance human-computer interaction. Using this cutting-edge technology, which uses computer vision techniques to identify hand landmarks, users may control cursor motions using gestures. However, a number of problems with the current methods, such as snapshot algorithms, cloud-based voice assistants, and hand contour extraction, restrict their effectiveness. The accuracy of cursor control may be impacted by challenges in precisely interpreting user gestures due to the intricacy of gesture mapping and a restricted gesture language. Furthermore, the voice assistant component of the system is not robust enough to handle a variety of speech instructions and dynamic voice commands, and it is also dependent on an internet connection. Additionally, there aren't many error handling capabilities, which might lead to worse-than-ideal user experiences when orders aren't carried out precisely. Notwithstanding these difficulties, the proposed system incorporates voice assistant features beyond mouse control, enabling users to utilize mouse motions and natural language instructions to do a variety of activities, including sending emails, opening apps, executing mouse functions, searching the web, and managing files. To fully realize the potential of this integrated voice and gesture-controlled system in improving user experiences and accessibility, it will be imperative to address these issues through enhanced gesture vocabulary, expanded gesture recognition algorithms, and improved voice command processing.
Author E, Jahnavi
R, Kavipriya
Devi, V. Anjana
Author_xml – sequence: 1
  givenname: V. Anjana
  surname: Devi
  fullname: Devi, V. Anjana
  email: anjanadevi.aby06@gmail.com
  organization: Rajalakshmi Institute of Technology,Computer Science and Engineering,Chennai,Tamil Nadu,India
– sequence: 2
  givenname: Jahnavi
  surname: E
  fullname: E, Jahnavi
  email: jahnavi.e.2020.cse@ritchennai.edu.in
  organization: Rajalakshmi Institute of Technology,Computer Science and Engineering,Chennai,Tamil Nadu,India
– sequence: 3
  givenname: Kavipriya
  surname: R
  fullname: R, Kavipriya
  email: kavipriya.r.2020.cse@ritchennai.edu.in
  organization: Rajalakshmi Institute of Technology,Computer Science and Engineering,Chennai,Tamil Nadu,India
BookMark eNotzMtKxDAUgOEIutBx3kAkL9B6kjQ3d1LqWBi8oDPbIU1PZwI1lTSD-PbiZfWvvv-CnMYpIiHXDErGwN609XP9-qi4VKbkwKsSACQ_IUurrREShFGisufkpYkHF32Ie7qZMdE2ZkzO5zDFW7rCOR8TFk103Yg93YaUj26k9THNU6KfIR_odgoef9k-uR92Sc4GN864_O-CbO6bt_qhWD-t2vpuXQSmVS44OGZQdxaV7g1jFQcD2CPXnRJgK9MNFRrhtUSuet-h8EYzXjE7OKGhFwty9fcNiLj7SOHdpa8dAwVaSSm-ASLwTek
CODEN IEEPAD
ContentType Conference Proceeding
DBID 6IE
6IL
CBEJK
RIE
RIL
DOI 10.1109/ICPCSN62568.2024.00052
DatabaseName IEEE Electronic Library (IEL) Conference Proceedings
IEEE Xplore POP ALL
IEEE Xplore All Conference Proceedings
IEEE Electronic Library (IEL)
IEEE Proceedings Order Plans (POP All) 1998-Present
DatabaseTitleList
Database_xml – sequence: 1
  dbid: RIE
  name: IEEE Electronic Library (IEL)
  url: https://ieeexplore.ieee.org/
  sourceTypes: Publisher
DeliveryMethod fulltext_linktorsrc
EISBN 9798350386349
EndPage 286
ExternalDocumentID 10607655
Genre orig-research
GroupedDBID 6IE
6IL
CBEJK
RIE
RIL
ID FETCH-LOGICAL-i176t-20a18e7b9e67d81142080ede27b630948bf4e83c75e26dcbe3c8712419fa370d3
IEDL.DBID RIE
ISICitedReferencesCount 0
ISICitedReferencesURI http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=001289477900045&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
IngestDate Wed Aug 07 05:31:02 EDT 2024
IsPeerReviewed false
IsScholarly false
Language English
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-i176t-20a18e7b9e67d81142080ede27b630948bf4e83c75e26dcbe3c8712419fa370d3
PageCount 8
ParticipantIDs ieee_primary_10607655
PublicationCentury 2000
PublicationDate 2024-May-3
PublicationDateYYYYMMDD 2024-05-03
PublicationDate_xml – month: 05
  year: 2024
  text: 2024-May-3
  day: 03
PublicationDecade 2020
PublicationTitle 2024 4th International Conference on Pervasive Computing and Social Networking (ICPCSN)
PublicationTitleAbbrev ICPCSN
PublicationYear 2024
Publisher IEEE
Publisher_xml – name: IEEE
Score 1.8689694
Snippet The research article proposes a novel approach combining voice control with gesture-enabled virtual mouse technology to enhance human-computer interaction....
SourceID ieee
SourceType Publisher
StartPage 279
SubjectTerms Cloud-based voice assistant
Computer vision
Gesture-Enabled Virtual Mouse
Human-Computer Interaction
Personal voice assistants
Smart homes
Snapshot algorithm
Social networking (online)
Tracking
Virtual reality
Vocabulary
Voice Assistant
Title Enhancing User Interaction: Gesture-Enabled Virtual Cursor with Voice Integration
URI https://ieeexplore.ieee.org/document/10607655
WOSCitedRecordID wos001289477900045&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV07T8MwELZoxcAEiCLe8sAaiOPGF7NGLSChqghadats51K6pCht-P2cnfJYGNgsS7al8-Pzd77vzNi1laVNwLjIZgaivnQistrYSAgoMuF0YkxImf8Eo1E2m-nxVqwetDCIGILP8MYXw1t-sXKNd5XRDldEu9O0wzoA0Iq1tqpfEevbx3ycv4zoQq98zFbi02LHXlD069uUgBrD_X-Od8B6P_o7Pv5GlkO2g9URex5Ubz45RrXgE1o3PPjyWlnCHb-nw72pMRoEKVTBp8vaC0N43tCFuube28qnKzoUQrNFO-09NhkOXvOHaPshQrQUoDa0oo3IEKxG5S0p_NN4jAUmYJUknpbZso-ZdJBiogpnUTriQ4TRujQS4kIes261qvCEcSchVSVxQZ0SSBPncKUVfUeQRh0YSE5Zz9tj_t7mvJh_meLsj_pztudNHkIB5QXrbuoGL9mu-9gs1_VVmKlP2--WMw
linkProvider IEEE
linkToHtml http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV07T8MwELagIMEEiCLeeGANxHYSJ6xRSytKVERbdats59J2SVFo-P2cnfJYGNgsS7al8-Pzd77vTMitFoXmUhlPx0p6gTDM04nSHmMyj5lJuFIuZf5AZlk8nSbDjVjdaWEAwAWfwZ0turf8fGVq6yrDHR4h7Q7DbbITBgFnjVxro_tlfnLfT4fpa4ZX-shGbXGbGNu3kqJfH6c43Oge_HPEQ9L-UeDR4Te2HJEtKI_JS6dc2PQY5ZyOceVQ581rhAkP9BGP97oCr-PEUDmdLCsrDaFpjVfqilp_K52s8FhwzebNxLfJuNsZpT1v8yWCt2QyWuOaViwGqROIrC2ZfRz3IQcudSSQqcW6CCAWRobAo9xoEAYZEaJ0Uigh_VyckFa5KuGUUCNkGBXIBpMQYRpZhyk0CwyCGnagJD8jbWuP2VuT9WL2ZYrzP-pvyF5v9DyYDfrZ0wXZt-Z3gYHikrTWVQ1XZNd8rJfv1bWbtU_dAZl6
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=proceeding&rft.title=2024+4th+International+Conference+on+Pervasive+Computing+and+Social+Networking+%28ICPCSN%29&rft.atitle=Enhancing+User+Interaction%3A+Gesture-Enabled+Virtual+Cursor+with+Voice+Integration&rft.au=Devi%2C+V.+Anjana&rft.au=E%2C+Jahnavi&rft.au=R%2C+Kavipriya&rft.date=2024-05-03&rft.pub=IEEE&rft.spage=279&rft.epage=286&rft_id=info:doi/10.1109%2FICPCSN62568.2024.00052&rft.externalDocID=10607655