mmJaw: Remote Jaw Gesture Recognition with COTS mmWave Radar
With the increasing prevalence of IoT devices and smart systems in daily life, there is a growing demand for new modalities in Human-Computer Interaction (HCI) to improve accessibility, particularly for users who require hands-free and eyes-free interaction in contexts like VR environments, as well...
Gespeichert in:
| Veröffentlicht in: | Proceedings - International Conference on Parallel and Distributed Systems S. 52 - 59 |
|---|---|
| Hauptverfasser: | , , , , , |
| Format: | Tagungsbericht |
| Sprache: | Englisch |
| Veröffentlicht: |
IEEE
10.10.2024
|
| Schlagworte: | |
| ISSN: | 2690-5965 |
| Online-Zugang: | Volltext |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| Abstract | With the increasing prevalence of IoT devices and smart systems in daily life, there is a growing demand for new modalities in Human-Computer Interaction (HCI) to improve accessibility, particularly for users who require hands-free and eyes-free interaction in contexts like VR environments, as well as for individuals with special needs or limited mobility. In this paper, we propose teeth gestures as an input modality for HCI. We find that teeth gestures, such as tapping, clenching, and sliding, are generated by various facial muscle movements that are often imperceptible to the naked eye but can be effectively captured using mm-wave radar. By capturing and analyzing the distinct patterns of these muscle movements, we propose a hands-free and eyes-free HCI solution based on three different gestures. Key challenges addressed in this paper include user range identification amidst background noise and other irrelevant facial movements. Results from 16 volunteers demonstrate the robustness of our approach, achieving 93% accuracy for up to a 2.5m range. |
|---|---|
| AbstractList | With the increasing prevalence of IoT devices and smart systems in daily life, there is a growing demand for new modalities in Human-Computer Interaction (HCI) to improve accessibility, particularly for users who require hands-free and eyes-free interaction in contexts like VR environments, as well as for individuals with special needs or limited mobility. In this paper, we propose teeth gestures as an input modality for HCI. We find that teeth gestures, such as tapping, clenching, and sliding, are generated by various facial muscle movements that are often imperceptible to the naked eye but can be effectively captured using mm-wave radar. By capturing and analyzing the distinct patterns of these muscle movements, we propose a hands-free and eyes-free HCI solution based on three different gestures. Key challenges addressed in this paper include user range identification amidst background noise and other irrelevant facial movements. Results from 16 volunteers demonstrate the robustness of our approach, achieving 93% accuracy for up to a 2.5m range. |
| Author | Wang, Shufan Xie, Yadong Siddiqi, Awais Ahmad He, Yuan Chen, Yande Sun, Yimao |
| Author_xml | – sequence: 1 givenname: Awais Ahmad surname: Siddiqi fullname: Siddiqi, Awais Ahmad email: xidq19@mail.tsinghua.edu.cn organization: Tsinghua University,School of Software & BNRist,China – sequence: 2 givenname: Yuan surname: He fullname: He, Yuan email: heyuan@tsinghua.edu.cn organization: Tsinghua University,School of Software & BNRist,China – sequence: 3 givenname: Yande surname: Chen fullname: Chen, Yande email: cyd22@mails.tsinghua.edu.cn organization: Tsinghua University,School of Software & BNRist,China – sequence: 4 givenname: Yimao surname: Sun fullname: Sun, Yimao email: sym21@mails.tsinghua.edu.cn organization: Tsinghua University,School of Software & BNRist,China – sequence: 5 givenname: Shufan surname: Wang fullname: Wang, Shufan email: wangshufan6622@outlook.com organization: Tsinghua University,School of Software & BNRist,China – sequence: 6 givenname: Yadong surname: Xie fullname: Xie, Yadong email: ydxie@mail.tsinghua.edu.cn organization: Tsinghua University,School of Software & BNRist,China |
| BookMark | eNotTl9LwzAcjKLgNvcNRPIFWn_534gvo-o2GUzcxMeRpolGTCttdfjtjbiXu-OOO26MTpq2cQhdEsgJAX21LB9ntxvJmICcAuU5ABB1hKZa6YIxIojQUh6jEZUasqTFGRr3_TsAhdQZoZsYH8z-Gj-52A4OJ43nrh--Opcs2742YQhtg_dheMPlervBMb6Y7xSa2nTn6NSbj95NDzxBz_d323KRrdbzZTlbZYEoOWRGeqGt4BSqStSqsqBMIYvCm9r-_ZCec6qphzoBM6AE51Y5w6iwXiVrgi7-d4NzbvfZhWi6nx0BJZnQiv0CKIlJ9Q |
| CODEN | IEEPAD |
| ContentType | Conference Proceeding |
| DBID | 6IE 6IL CBEJK RIE RIL |
| DOI | 10.1109/ICPADS63350.2024.00017 |
| DatabaseName | IEEE Electronic Library (IEL) Conference Proceedings IEEE Proceedings Order Plan All Online (POP All Online) 1998-present by volume IEEE Xplore All Conference Proceedings IEEE Electronic Library (IEL) IEEE Proceedings Order Plans (POP All) 1998-Present |
| DatabaseTitleList | |
| Database_xml | – sequence: 1 dbid: RIE name: IEEE Electronic Library (IEL) url: https://ieeexplore.ieee.org/ sourceTypes: Publisher |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Computer Science |
| EISBN | 9798331515966 |
| EISSN | 2690-5965 |
| EndPage | 59 |
| ExternalDocumentID | 10763597 |
| Genre | orig-research |
| GrantInformation_xml | – fundername: National Natural Science Foundation of China funderid: 10.13039/501100001809 |
| GroupedDBID | 29O 6IE 6IF 6IH 6IK 6IL 6IM 6IN AAJGR AAWTH ABLEC ADZIZ ALMA_UNASSIGNED_HOLDINGS BEFXN BFFAM BGNUA BKEBE BPEOZ CBEJK CHZPO IEGSK IPLJI OCL RIE RIL RNS |
| ID | FETCH-LOGICAL-i176t-a6f59c5420bb5d7bc07a8688fadc02036f44292f0d92f3a07544c7ea325cf72f3 |
| IEDL.DBID | RIE |
| ISICitedReferencesCount | 0 |
| ISICitedReferencesURI | http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=001481011800007&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| IngestDate | Wed Aug 27 01:59:30 EDT 2025 |
| IsPeerReviewed | false |
| IsScholarly | true |
| Language | English |
| LinkModel | DirectLink |
| MergedId | FETCHMERGED-LOGICAL-i176t-a6f59c5420bb5d7bc07a8688fadc02036f44292f0d92f3a07544c7ea325cf72f3 |
| PageCount | 8 |
| ParticipantIDs | ieee_primary_10763597 |
| PublicationCentury | 2000 |
| PublicationDate | 2024-Oct.-10 |
| PublicationDateYYYYMMDD | 2024-10-10 |
| PublicationDate_xml | – month: 10 year: 2024 text: 2024-Oct.-10 day: 10 |
| PublicationDecade | 2020 |
| PublicationTitle | Proceedings - International Conference on Parallel and Distributed Systems |
| PublicationTitleAbbrev | ICPADS |
| PublicationYear | 2024 |
| Publisher | IEEE |
| Publisher_xml | – name: IEEE |
| SSID | ssj0020350 |
| Score | 2.2913446 |
| Snippet | With the increasing prevalence of IoT devices and smart systems in daily life, there is a growing demand for new modalities in Human-Computer Interaction (HCI)... |
| SourceID | ieee |
| SourceType | Publisher |
| StartPage | 52 |
| SubjectTerms | Accuracy Human computer interaction Human-Computer Interface Internet of Things Millimeter wave communication mmWave Muscles Radar Radar detection Robustness Sensing Sensors Smart systems Teeth Gestures |
| Title | mmJaw: Remote Jaw Gesture Recognition with COTS mmWave Radar |
| URI | https://ieeexplore.ieee.org/document/10763597 |
| WOSCitedRecordID | wos001481011800007&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| link | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV07T8MwELZoxcBUHkW85YHVYMdxHCMWVCiPoapaEN0qP6UOSVBoy9_HdtMiBgYWyzoPls66O5_P330AXPogpokVGCllDEozJpGQlCHHCCeWYoOZi2QTfDDIJxMxbMDqEQtjrY2fz-xVmMZavqn0IjyVeQsP7dMEb4EW53wF1tpkV6FE1kCACRbXz73h3f04o17qs8Ak9MjG5DeHSgwh_c4_N98F3R8wHhxuwswe2LLlPuis2RhgY5wH4LYoXuTXDRxZr30L_Rw-epe_qC0crX8JVSUMD6_QJ_JjWBTvcukXpZF1F7z1H157T6jhRkAzwrM5kpljQrM0wUoxw5XGXOZZnjtpdCwuujQQUTls_EAlDn3uNLeSJkw77kWHoF1WpT0CUKicppZR5a-KKTfe7cg0ZS6jxCXSCXYMukEb049V-4vpWhEnf8hPwU5QeHDwBJ-B9rxe2HOwrZfz2Wd9EQ_tGw2BlnA |
| linkProvider | IEEE |
| linkToHtml | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1LTwIxEG4UTfSEDwy-e_C62m7b7dZ4MSiCIiGAkRvp9pFw2MWsgH_fdlkwHjx4aZrpock0M9Pp9JsPgCsXxBQ2AgVJonVAIyYDIQkLLMMcG4I0YrYgm-DdbjwaiV4JVi-wMMaY4vOZufbTopavp2run8qchfv2aYJvgi1GaYiXcK11fuWLZCUIGCNx02707h8GEXFSlweGvks2wr9ZVIog0qz-c_s9UPuB48HeOtDsgw2THYDqio8BluZ5CO7S9Fl-3cK-cfo30M3hk3P689zA_uqf0DSD_ukVulR-ANP0XS7cotQyr4G35uOw0QpKdoRggnk0C2RkmVCMhihJmOaJQlzGURxbqVVRXrTUU1FZpN1AJPKd7hQ3koRMWe5ER6CSTTNTB1AkMaGGkcRdFinXzvFISpmNCLahtIIdg5rXxvhj2QBjvFLEyR_yS7DTGr52xp129-UU7Hrle3eP0RmozPK5OQfbajGbfOYXxQF-AxS-mbc |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=proceeding&rft.title=Proceedings+-+International+Conference+on+Parallel+and+Distributed+Systems&rft.atitle=mmJaw%3A+Remote+Jaw+Gesture+Recognition+with+COTS+mmWave+Radar&rft.au=Siddiqi%2C+Awais+Ahmad&rft.au=He%2C+Yuan&rft.au=Chen%2C+Yande&rft.au=Sun%2C+Yimao&rft.date=2024-10-10&rft.pub=IEEE&rft.eissn=2690-5965&rft.spage=52&rft.epage=59&rft_id=info:doi/10.1109%2FICPADS63350.2024.00017&rft.externalDocID=10763597 |