Task Mode: Dynamic Filtering for Task-Specific Web Navigation using LLMs.

Gespeichert in:
Bibliographische Detailangaben
Titel: Task Mode: Dynamic Filtering for Task-Specific Web Navigation using LLMs.
Autoren: Gubbi Mohanbabu, Ananya, Sechayk, Yotam, Pavel, Amy
Quelle: ACM SIGACCESS Conference on Computers & Accessibility; 2025, p1-18, 18p
Schlagwörter: WEB accessibility, INFORMATION filtering, USER interfaces, WEB browsing, ASSISTIVE technology, LANGUAGE models, HUMAN experimentation
Abstract: Modern web interfaces are unnecessarily complex to use as they overwhelm users with excess text and visuals unrelated to their current goals. Such interfaces can particularly impact screen reader users (SRUs), who may need to navigate content sequentially and thus spend minutes traversing irrelevant elements compared to vision users (VUs) who visually skim in seconds. We present Task Mode, a system that dynamically filters web content based on user-specified goals using large language models to identify and prioritize relevant elements while minimizing distractions. Our approach preserves page structure while offering multiple viewing modes tailored to different access needs. Our user study with 12 participants (6 VUs, 6 SRUs) demonstrates that our approach halved task completion time for SRUs while maintaining performance for VUs, decreasing the completion time gap between groups from 2x to 1.2x. 11 of 12 participants wanted to use Task Mode in the future, reporting that Task Mode supported completing tasks with less effort and fewer distractions. This work demonstrates how designing new interactions simultaneously for visual and non-visual access can reduce rather than reinforce accessibility disparities in future technology created by researchers and practitioners. [ABSTRACT FROM AUTHOR]
Copyright of ACM SIGACCESS Conference on Computers & Accessibility is the property of Association for Computing Machinery and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Datenbank: Biomedical Index
Beschreibung
Abstract:Modern web interfaces are unnecessarily complex to use as they overwhelm users with excess text and visuals unrelated to their current goals. Such interfaces can particularly impact screen reader users (SRUs), who may need to navigate content sequentially and thus spend minutes traversing irrelevant elements compared to vision users (VUs) who visually skim in seconds. We present Task Mode, a system that dynamically filters web content based on user-specified goals using large language models to identify and prioritize relevant elements while minimizing distractions. Our approach preserves page structure while offering multiple viewing modes tailored to different access needs. Our user study with 12 participants (6 VUs, 6 SRUs) demonstrates that our approach halved task completion time for SRUs while maintaining performance for VUs, decreasing the completion time gap between groups from 2x to 1.2x. 11 of 12 participants wanted to use Task Mode in the future, reporting that Task Mode supported completing tasks with less effort and fewer distractions. This work demonstrates how designing new interactions simultaneously for visual and non-visual access can reduce rather than reinforce accessibility disparities in future technology created by researchers and practitioners. [ABSTRACT FROM AUTHOR]
DOI:10.1145/3663547.3746401