A Nested Model for Visualization Design and Validation

TLDR

The paper introduces a nested model for visualization design that delineates four layers—problem characterization, data abstraction, visual encoding and interaction, and algorithmic execution—and highlights often overlooked steps in the design and evaluation process. The model organizes the design process hierarchically, with each layer’s output feeding into the next, thereby illustrating how upstream errors propagate downstream. The model yields prescriptive guidance for evaluation by pinpointing level‑specific validity threats and offers three recommendations: distinguish levels when claiming contributions, state upstream assumptions, and encourage venues to accept more domain‑characterization papers.

Abstract

We present a nested model for the visualization design process with four layers: characterize the problem domain, abstract into operations on data types, design visual encoding and interaction techniques, and create algorithms to execute techniques efficiently. The output from a level above is input to the level below, bringing attention to the design challenge that an upstream error inevitably cascades to all downstream levels. This model provides prescriptive guidance for determining appropriate evaluation approaches by identifying threats to validity unique to each level. We call attention to specific steps in the design and evaluation process that are often given short shrift. We also provide three recommendations motivated by this model:authors should distinguish between these levels when claiming contributions at more than one of them, authors should explicitly state upstream assumptions at levels above the focus of a paper, and visualization venues should accept more papers on domain characterization.