We propose a new method for assessing the perceptual organization of information graphics, based on the premise that the visual structure of an image should match the structure of the data it is intended to convey. The core of our method is a new formal model of one type of perceptual structure, based on classical machine vision techniques for analyzing an image at multiple resolutions. The model takes as input an arbitrary grayscale image and returns a lattice structure describing the visual organization of the image. We show how this model captures several aspects of traditional design aesthetics, and we describe a software tool that implements the model to help designers analyze and refine visual displays. Our emphasis here is on demonstrating the model's potential as a design aid rather than as a description of human perception, but given its initial promise we propose a variety of ways in which the model could be extended and validated.
WareC.Information Visualization: Perception for Design. Morgan-Kaufmann: San Francisco, 2000.
2.
ClevelandW.The Elements of Graphing Data. Wadsworth: Monterey, CA, 1980.
3.
MackinlayJD. Applying a theory of graphical presentation to the graphic design of user interfaces. Proceedings of the ACM SIGGRAPH Symposium on User Interface Software (UIST 1988), 1988; 179–189.
4.
HealeyCGBoothKSEnnsJT. Harnessing preattentive processes for multivariate data visualization. Proceedings Graphics Interface 1993, 1993; 107–117.
TullisTS. A computer-based tool for evaluating alphanumeric displays. Proceedings of INTERACT1984, 1984.
8.
ShneidermanBChimeraRJogNStimartRWhiteD.Evaluating spatial and textual style of displays. Proceedings of Getting the Best from State-of-the-Art Display Systems 1995. London 1995.
9.
SaundE.Symbolic construction of a 2-D scale-space image. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1990; 12: 817–830.
10.
WattenbergMFisherD.A multi-scale model of perceptual organization in information graphics. InfoVis 2003, 2003.
11.
BertinJ.The Semiology of Graphics. University of Wisconsin Press: Madison, WI, 1983.
12.
WertheimerM.Gestalt theory. In: EllisWD (Ed). A Sourcebook of Gestalt Psychology. The Humanities Press: New York, 1924/1950; 1–110.
13.
NavonD.Forest before trees: The precedence of global features in visual perception. Cognitive Psychology, 1977; 9: 353–383.
LiZ.A neural model of contour integration in the primary visual cortex. Neural Computation, 1998; 10: 903–940.
17.
LoganGD. The CODE theory of visual attention. Psychological Review, 1996; 103: 603–649.
18.
PirolliPCardSKvan der WegeMM. Visual information foraging in a focus+context visualization. Proceedings, CHI01, Human Factors in Computing Systems, 2001.
19.
WitkinATenenbaumM.On the role of structure in vision. In: RosenfeldA (Ed). Human and Machine Vision. Academic Press: New York, 1983.
20.
IijimaT.Basic theory of pattern observation. Papers of Technical Group on Automata Control, IECE, Japan, 1959.
21.
KoenderinkJJ. The structure of images. Biological Cybernetics, 1984; 50: 363–370.
22.
LindebergT.Scale-Space Theory in Computer Vision. Kluwer: Dordrecht, 1994.
23.
FurnasGWBedersonB.Space-scale diagrams: understanding multiscale interfaces. Proceedings CHI 95. Human Factors in Computing Systems, 1995.
24.
MarrDHildrethE.Theory of edge detection. Proceedings of the Royal Society of London, Series B, 1980; 207: 187–217.
25.
CannyJ.A computational approach to edge detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1986; 8: 679–698.
26.
ShenJCastanS.An optimal linear operator for step edge detection. Computer Vision, Graphics, and Image Processing, 1992; 34: 321–343.
27.
ParkerJR. Algorithms for Image Processing and Computer Vision. John Wiley & Sons: New York, 1997.
28.
WitkinA.1983. Scale-space filtering. Proceedings of the Eighth International Joint Conference on Artificial Intelligence (IJCAI ′83). Karlsruhe 8–12 August, 1983.
29.
LeungYZhangJSXuZB. Clustering by scale-space filtering. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2000; 22: 12.
30.
PalmerSRockI.Rethinking perceptual organization: The role of uniform connectedness. Psychonomic Bulletin and Review, 1994; 1: 29–55.
31.
AntoineJPCarrettePMurenziRPietteB.Image analysis with two-dimensional continuous wavelet transform. Signal Processing, 1993; 31: 241–272.
32.
ScottDW. Multivariate Density Estimation. Wiley-Interscience: New York, 1992.
33.
BurtPJAdelsonEH. The Laplacian pyramid as a compact image code. IEEE Transactions on Communications, 1983; 31: 532–540.
ter Haar RomenyBGeusebroekJMVan OstaPvan den BoomgaardRKoenderinkJJ. Color differential structure. Scale-Space 2001, 2001; 353–361.
41.
KalitzinBter Haar RomenyBViergeverM.Invertible orientation bundles on 2d scalar images. Scale-Space Theories in Computer Vision. Springer: Berlin, 1997; 77–88.
42.
MozerMZemelRSBehrmannMWilliamsCKI. Learning to segment images using dynamic feature binding. Neural Computation, 1992; 4: 650–665.
43.
PeronaPMalikJ.Scale-space and edge detection using anisotropic diffusion. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1990; 12: 629–639.
44.
WickensCDCarswellCM. The proximity compatibility principle: Its psychological foundation and relevance to display design. Human Factors, 1995; 37: 473–495.
