The use of handheld marker to calibrate a field-programmable gate array based eye tracker for artificial vision system
Tracking the eye of a blind patient can enhance the usability of an artificial vision system. In systems where the sensing element, i.e. the scene camera that captures the visual information, is mounted on the patient's head, the user must use head scanning in order to steer the line of sight o...
Uloženo v:
| Vydáno v: | Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference Ročník 2020; s. 3323 - 3326 |
|---|---|
| Hlavní autoři: | , , , , , |
| Médium: | Konferenční příspěvek Journal Article |
| Jazyk: | angličtina |
| Vydáno: |
IEEE
01.07.2020
|
| ISSN: | 2694-0604, 1558-4615, 2694-0604 |
| On-line přístup: | Získat plný text |
| Tagy: |
Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
|
| Abstract | Tracking the eye of a blind patient can enhance the usability of an artificial vision system. In systems where the sensing element, i.e. the scene camera that captures the visual information, is mounted on the patient's head, the user must use head scanning in order to steer the line of sight of the implant to the region of interest. Integrating an eye tracker in the prosthesis will enable scanning using eye movements. The eye position will set the region of interest within the wide field-of-view of the scene camera. An essential requirement of an eye tracker is the need to calibrate it. Obviously, off-the-shelf calibration methods that require looking at known points in space cannot be used with blind users.Here we tested the feasibility of calibrating the eye-tracker based on pupil position and the location of the percept reported by the implant recipient, using a handheld marker. Pupil positions were extracted using custom image processing in a field-programmable-gate-array built into a glasses-mounted eye tracker. In the calibration process, electrodes were directly stimulated and the subject reported the location of the percept using a handheld marker. Linear regression was used to extract the transfer function from pupil position to gaze direction in the coordinates of the scene camera.In using the eye tracker with the proposed calibration method, patients demonstrated improved precision on a localization task with corresponding reduction of head movements. |
|---|---|
| AbstractList | Tracking the eye of a blind patient can enhance the usability of an artificial vision system. In systems where the sensing element, i.e. the scene camera that captures the visual information, is mounted on the patient's head, the user must use head scanning in order to steer the line of sight of the implant to the region of interest. Integrating an eye tracker in the prosthesis will enable scanning using eye movements. The eye position will set the region of interest within the wide field-of-view of the scene camera. An essential requirement of an eye tracker is the need to calibrate it. Obviously, off-the-shelf calibration methods that require looking at known points in space cannot be used with blind users.Here we tested the feasibility of calibrating the eye-tracker based on pupil position and the location of the percept reported by the implant recipient, using a handheld marker. Pupil positions were extracted using custom image processing in a field-programmable-gate-array built into a glasses-mounted eye tracker. In the calibration process, electrodes were directly stimulated and the subject reported the location of the percept using a handheld marker. Linear regression was used to extract the transfer function from pupil position to gaze direction in the coordinates of the scene camera.In using the eye tracker with the proposed calibration method, patients demonstrated improved precision on a localization task with corresponding reduction of head movements.Tracking the eye of a blind patient can enhance the usability of an artificial vision system. In systems where the sensing element, i.e. the scene camera that captures the visual information, is mounted on the patient's head, the user must use head scanning in order to steer the line of sight of the implant to the region of interest. Integrating an eye tracker in the prosthesis will enable scanning using eye movements. The eye position will set the region of interest within the wide field-of-view of the scene camera. An essential requirement of an eye tracker is the need to calibrate it. Obviously, off-the-shelf calibration methods that require looking at known points in space cannot be used with blind users.Here we tested the feasibility of calibrating the eye-tracker based on pupil position and the location of the percept reported by the implant recipient, using a handheld marker. Pupil positions were extracted using custom image processing in a field-programmable-gate-array built into a glasses-mounted eye tracker. In the calibration process, electrodes were directly stimulated and the subject reported the location of the percept using a handheld marker. Linear regression was used to extract the transfer function from pupil position to gaze direction in the coordinates of the scene camera.In using the eye tracker with the proposed calibration method, patients demonstrated improved precision on a localization task with corresponding reduction of head movements. Tracking the eye of a blind patient can enhance the usability of an artificial vision system. In systems where the sensing element, i.e. the scene camera that captures the visual information, is mounted on the patient's head, the user must use head scanning in order to steer the line of sight of the implant to the region of interest. Integrating an eye tracker in the prosthesis will enable scanning using eye movements. The eye position will set the region of interest within the wide field-of-view of the scene camera. An essential requirement of an eye tracker is the need to calibrate it. Obviously, off-the-shelf calibration methods that require looking at known points in space cannot be used with blind users.Here we tested the feasibility of calibrating the eye-tracker based on pupil position and the location of the percept reported by the implant recipient, using a handheld marker. Pupil positions were extracted using custom image processing in a field-programmable-gate-array built into a glasses-mounted eye tracker. In the calibration process, electrodes were directly stimulated and the subject reported the location of the percept using a handheld marker. Linear regression was used to extract the transfer function from pupil position to gaze direction in the coordinates of the scene camera.In using the eye tracker with the proposed calibration method, patients demonstrated improved precision on a localization task with corresponding reduction of head movements. |
| Author | Kartha, Arathy Caspi, Avi Roy, Arup Sadeghi, Roksana Barry, Michael P. Dagnelie, Gislin |
| Author_xml | – sequence: 1 givenname: Avi surname: Caspi fullname: Caspi, Avi organization: Jerusalem College of Technology,Jerusalem,Israel – sequence: 2 givenname: Arup surname: Roy fullname: Roy, Arup organization: Second Sight Medical Products, Inc,Sylmar,CA – sequence: 3 givenname: Michael P. surname: Barry fullname: Barry, Michael P. organization: Second Sight Medical Products, Inc,Sylmar,CA – sequence: 4 givenname: Roksana surname: Sadeghi fullname: Sadeghi, Roksana organization: Wilmer Eye Institute,Johns Hopkins University,Baltimore,MD,United States – sequence: 5 givenname: Arathy surname: Kartha fullname: Kartha, Arathy organization: Wilmer Eye Institute,Johns Hopkins University,Baltimore,MD,United States – sequence: 6 givenname: Gislin surname: Dagnelie fullname: Dagnelie, Gislin organization: Wilmer Eye Institute,Johns Hopkins University,Baltimore,MD,United States |
| BookMark | eNotkEtPwzAQhA0qEm3hFyAhH7mk2I7txEeoykMq4kDvke2sW0MexU4r5d9joKdd6ZtZ7cwMTbq-A4RuKVlQStT96u1xyXnaFowwslC0ECXJz9CMFqykVClCz9GUClFmXFIxQVMmFc-IJPwSzWL8JMlGBJ2i42YH-BAB9w7vdFfvoKlxq8MXBDz02OrGm6AHwBo7n1i2D_026LbVpgG8_SMh6BEbHaHGMAIegra_dteHxAbvvPW6wUcffd_hOMYB2it04XQT4fo05-jjabVZvmTr9-fX5cM68yyXQ1ZzYQgwVecpHkhplbUmd0bWhJhaWKuI0QUFC8I660BoqlxuSysEcMjn6O7_anr6-wBxqFofLTSN7qA_xIpxXpacFUIm6c2_1ANAtQ8-dTBWp2LzH6VmcBA |
| ContentType | Conference Proceeding Journal Article |
| DBID | 6IE 6IH CBEJK RIE RIO 7X8 |
| DOI | 10.1109/EMBC44109.2020.9175803 |
| DatabaseName | IEEE Electronic Library (IEL) Conference Proceedings IEEE Proceedings Order Plan (POP) 1998-present by volume IEEE Xplore All Conference Proceedings IEEE/IET Electronic Library (IEL) (UW System Shared) IEEE Proceedings Order Plans (POP) 1998-present MEDLINE - Academic |
| DatabaseTitle | MEDLINE - Academic |
| DatabaseTitleList | MEDLINE - Academic |
| Database_xml | – sequence: 1 dbid: RIE name: IEEE/IET Electronic Library (IEL) (UW System Shared) url: https://ieeexplore.ieee.org/ sourceTypes: Publisher – sequence: 2 dbid: 7X8 name: MEDLINE - Academic url: https://search.proquest.com/medline sourceTypes: Aggregation Database |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Engineering |
| EISBN | 1728119901 9781728119908 |
| EISSN | 1558-4615 2694-0604 |
| EndPage | 3326 |
| ExternalDocumentID | 9175803 |
| Genre | orig-research |
| GroupedDBID | 6IE 6IF 6IH AAJGR ACGFS AFFNX ALMA_UNASSIGNED_HOLDINGS CBEJK M43 RIE RIO RNS 7X8 |
| ID | FETCH-LOGICAL-i236t-d45b0e29d3803e66c9ccb3fb6d00bd5cc90ba71ece5cfcfe5a19f3c8c55e4e3 |
| IEDL.DBID | RIE |
| ISICitedReferencesCount | 0 |
| ISICitedReferencesURI | http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000621592203164&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| ISSN | 2694-0604 |
| IngestDate | Thu Oct 02 20:05:30 EDT 2025 Wed Aug 27 02:33:47 EDT 2025 |
| IsPeerReviewed | true |
| IsScholarly | true |
| Language | English |
| LinkModel | DirectLink |
| MergedId | FETCHMERGED-LOGICAL-i236t-d45b0e29d3803e66c9ccb3fb6d00bd5cc90ba71ece5cfcfe5a19f3c8c55e4e3 |
| Notes | ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 23 |
| PQID | 2448842756 |
| PQPubID | 23479 |
| PageCount | 4 |
| ParticipantIDs | ieee_primary_9175803 proquest_miscellaneous_2448842756 |
| PublicationCentury | 2000 |
| PublicationDate | 2020-07-01 |
| PublicationDateYYYYMMDD | 2020-07-01 |
| PublicationDate_xml | – month: 07 year: 2020 text: 2020-07-01 day: 01 |
| PublicationDecade | 2020 |
| PublicationTitle | Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference |
| PublicationTitleAbbrev | EMBC |
| PublicationYear | 2020 |
| Publisher | IEEE |
| Publisher_xml | – name: IEEE |
| SSID | ssj0020051 ssib061542107 ssib053545923 ssib042469959 |
| Score | 2.1098504 |
| Snippet | Tracking the eye of a blind patient can enhance the usability of an artificial vision system. In systems where the sensing element, i.e. the scene camera that... |
| SourceID | proquest ieee |
| SourceType | Aggregation Database Publisher |
| StartPage | 3323 |
| Title | The use of handheld marker to calibrate a field-programmable gate array based eye tracker for artificial vision system |
| URI | https://ieeexplore.ieee.org/document/9175803 https://www.proquest.com/docview/2448842756 |
| Volume | 2020 |
| WOSCitedRecordID | wos000621592203164&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| link | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV3PS8MwFA5zeNCLPzZx_hhP8Gi3LG3S9urY8KBjoMhuI01edKCtdN1g_71JW6egF2-FEmjzPfLeS77vCyHX3FadSjFuEdDCNigi8KQ06FGWUKO44aI003m-DyeTaDaLpw1ys9XCIGJJPsOeeyzP8nWmVm6rrG9bCx45a8-dMBSVVmvbXLnoqhXAAxr3Rw-3Q5vpqdOiMNqrR9ZXqPxad8tkMj7432cckva3Kg-m23xzRBqYHpP9H4aCLbK2qMNqiZAZcFvir_im4d0xcHIoMrB4uO64QJBQUte8mp717gRU8FK-yXO5AZfcNOAGocilY16ALW7BhVnlOAGVJh0qI-g2eRyPnoZ3Xn2zgrdgvig8HfCEIou1b_8DhVAWr8Q3idCUJporFdNEhgNUyJVRBrkcxMZXkeIcA_RPSDPNUjwlIGNmGCouQmVbH4aJsRWhZgMlbTnsh0GHtNz8zT8q64x5PXUdcvUFwNyGszujkClmq-XcVhtRFDhP-rO_h56TPYdoxZi9IM0iX-El2VXrYrHMuzYyZlG3jIxPRYG8DA |
| linkProvider | IEEE |
| linkToHtml | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1NS8QwEA2yCurFb_x2BI9W07Tpx1VxUVwXQRFvJU0muqCtdLuC_95MW1dBL94KJdDmDZmZ5L0Xxo6kqzq1FtIhYCLXoEShp5RFj4ucWy2tjBoznYdBPBwmj4_p7Qw7nmphELEhn-EJPTZn-abUE9oqO3WthUzI2nNWhqHgrVpr2l5RfHUaYJ-npxc3Z-cu13NSowh-0o3tLlH5tfI26aS_9L8PWWbr37o8uJ1mnBU2g8UqW_xhKbjG3h3uMBkjlBZoU_wZXwy8EgengroEhwj1xzWCgoa85nUErVeSUMFT86aq1AdQejOAHwh1pYh7Aa68BQq01nMCWlU6tFbQ6-yuf3F_ful1dyt4IxFEtWdCmXMUqQncf2AUaYdYHtg8MpznRmqd8lzFPmqU2mqLUvmpDXSipcQQgw3WK8oCNxmoVFiBWkaxds2PwNy6mtAIXytXEAdxuMXWaP6yt9Y8I-umbosdfgGQuYCmUwpVYDkZZ67eSJKQXOm3_x56wOYv728G2eBqeL3DFgjdlj-7y3p1NcE9Nqff69G42m_i4xPCBb5r |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=proceeding&rft.title=Proceedings+of+the+annual+international+conference+of+the+IEEE+Engineering+in+Medicine+and+Biology+Society&rft.atitle=The+use+of+handheld+marker+to+calibrate+a+field-programmable+gate+array+based+eye+tracker+for+artificial+vision+system&rft.au=Caspi%2C+Avi&rft.au=Roy%2C+Arup&rft.au=Barry%2C+Michael+P.&rft.au=Sadeghi%2C+Roksana&rft.date=2020-07-01&rft.pub=IEEE&rft.eissn=1558-4615&rft.spage=3323&rft.epage=3326&rft_id=info:doi/10.1109%2FEMBC44109.2020.9175803&rft.externalDocID=9175803 |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=2694-0604&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=2694-0604&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=2694-0604&client=summon |