Using Close Reading as a Method for Evaluating Visualizations


Journal article


Annie Bares, Stephanie Zeller, Cullen D. Jackson, Daniel F. Keefe, F. Samsel
Workshop on Beyond Time and Errors: Novel Evaluation Methods for Visualization, 2020

Semantic Scholar DBLP DOI
Cite

Cite

APA   Click to copy
Bares, A., Zeller, S., Jackson, C. D., Keefe, D. F., & Samsel, F. (2020). Using Close Reading as a Method for Evaluating Visualizations. Workshop on Beyond Time and Errors: Novel Evaluation Methods for Visualization.


Chicago/Turabian   Click to copy
Bares, Annie, Stephanie Zeller, Cullen D. Jackson, Daniel F. Keefe, and F. Samsel. “Using Close Reading as a Method for Evaluating Visualizations.” Workshop on Beyond Time and Errors: Novel Evaluation Methods for Visualization (2020).


MLA   Click to copy
Bares, Annie, et al. “Using Close Reading as a Method for Evaluating Visualizations.” Workshop on Beyond Time and Errors: Novel Evaluation Methods for Visualization, 2020.


BibTeX   Click to copy

@article{annie2020a,
  title = {Using Close Reading as a Method for Evaluating Visualizations},
  year = {2020},
  journal = {Workshop on Beyond Time and Errors: Novel Evaluation Methods for Visualization},
  author = {Bares, Annie and Zeller, Stephanie and Jackson, Cullen D. and Keefe, Daniel F. and Samsel, F.}
}

Abstract

Visualization research and practice that incorporates the arts make claims to being more effective in connecting with users on a human level. However, these claims are difficult to measure quantitatively. In this paper, we present a follow-on study to use close reading, a humanities method from literary studies, to evaluate visualizations created using artistic processes [Bares 2020]. Close reading is a method in literary studies that we’ve previously explored as a method for evaluating visualizations. To use close reading as an evaluation method, we guide participants through a series of steps designed to prompt them to interpret the visualization’s formal, informational, and contextual features. Here we elaborate on our motivations for using close reading as a method to evaluate visualizations, and enumerate the procedures we used in the study to evaluate a 2D visualization, including modifications made because of the COVID-19 pandemic. Key findings of this study include that close reading is an effective formative method to elicit information related to interpretation and critique; user subject position; and suspicion or skepticism. Information gained through close reading is valuable in the visualization design and iteration processes, both related to designing features and other formal elements more effectively, as well as in considering larger questions of context and framing.