A Process‐Oriented Approach to Analyze Analysts' Use of Visualizations: Revealing Insights into the What, When, and How

Despite Visual Analytics (VA) tools being essential for supporting data analysis, evaluating their use in real‐world analytical processes remains challenging. Traditional evaluation methods often overlook the nuanced and evolving nature of analysis processes and are not always suitable for investiga...

Full description

Saved in:
Bibliographic Details
Published in:Computer graphics forum Vol. 44; no. 3
Main Authors: Zimmermann, L., Zerbato, F., Vrotsou, K., Weber, B.
Format: Journal Article
Language:English
Published: Oxford Blackwell Publishing Ltd 01.06.2025
Subjects:
CCS Concepts
Data analysis
Evaluation
General and reference → Empirical studies
Human‐centered computing → Visualization design and evaluation methods
Qualitative analysis
Visualization systems and tools
ISSN:0167-7055, 1467-8659, 1467-8659
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Despite Visual Analytics (VA) tools being essential for supporting data analysis, evaluating their use in real‐world analytical processes remains challenging. Traditional evaluation methods often overlook the nuanced and evolving nature of analysis processes and are not always suitable for investigating scenarios in which analysts combine multiple tools and visualization types. In this paper, we propose a flexible analysis approach for studying analysts' use of visualizations within and across VA tools. Our qualitative method allows researchers to extract user behavior and cognitive steps from screen recordings and think‐aloud data and generate event sequences that capture analytic processes. This enables the analysis of usage patterns from multiple perspectives and levels of granularity and allows for the evaluation of effectiveness measures, such as efficiency and accuracy. We demonstrate our approach in the domain of process mining, where our findings provide insights into the use of existing visualizations, and we reflect on lessons learned from this application.
Bibliography:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ISSN:0167-7055
1467-8659
1467-8659
DOI:10.1111/cgf.70104