On the Validity and Benefit of Manual and Automated Drift Correction in Reading Tasks

Drift represents a common distortion that affects the position of fixations in eye tracking data. While manual correction is considered very accurate, it is considered subjective and time-consuming. On the other hand, automated correction is fast, objective, and considered less accurate. An objectiv...

Full description

Saved in:
Bibliographic Details
Published in:Journal of eye movement research Vol. 18; no. 3; p. 17
Main Author: Al Madi, Naser
Format: Journal Article
Language:English
Published: Switzerland MDPI 09.05.2025
MDPI AG
Subjects:
automated-algorithms
correction
distortion
drift
eye tracking
reading
automated-algorithms
reading
correction
eye tracking
distortion
drift
ISSN:1995-8692, 1995-8692
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Drift represents a common distortion that affects the position of fixations in eye tracking data. While manual correction is considered very accurate, it is considered subjective and time-consuming. On the other hand, automated correction is fast, objective, and considered less accurate. An objective comparison of the accuracy of manual and automated correction has not been conducted before, and the extent of subjectivity in manual correction is not entirely quantified. In this paper, we compare the accuracy of manual and automated correction of eye tracking data in reading tasks through a novel approach that relies on synthetic data with known ground truth. Moreover, we quantify the subjectivity in manual human correction with real eye tracking data. Our results show that expert human correction is significantly more accurate than automated algorithms, yet novice human correctors are on par with the best automated algorithms. In addition, we found that human correctors show excellent agreement in their correction, challenging the notion that manual correction is “highly subjective”. Our findings provide unique insights, quantifying the benefits of manual and automated correction.
Bibliography:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 23
ISSN:1995-8692
1995-8692
DOI:10.3390/jemr18030017