Why is it that we can recognize object identity and 3D shape from line drawings, even though they do not exist in the natural world? This article hypothesizes that the human visual system perceives line drawings as if they were approximately realistic images. Moreover, the techniques of line drawing are chosen to accurately convey shape to a human observer. Several implications and variants of this hypothesis are explored.
BénardP.HertzmannA. (2019).
Line drawings from 3D models: A tutorial. Foundations and Trends in Computer Graphics and Vision,
11, 1–159.
2.
BiedermanI. (1981). On the semantics of a glance at a scene. In KubovyM.PomerantzJ. (Eds.), Perceptual organization (pp. 213–253).
Laurence Erlbaum Associates.
3.
BiedermanI.JuG. (1988).
Surface versus edge-based determinants of visual recognition. Cognitive Psychology,
20, 38–64.
4.
ColeF.GolovinskiyA.LimpaecherA.BarrosH. S.FinkelsteinA.FunkhouserT.RusinkiewiczS. (2008).
Where do people draw lines?ACM Transactions on Graphics,
27, 88:1–88:11.
5.
ColeF.SanikK.DeCarloD.FinkelsteinA.FunkhouserT.RusinkiewiczS.SinghM. (2009).
How well do line drawings depict shape?ACM Transactions on Graphics,
28, 28:1–28:9.
6.
DeCarloD. (2012). Depicting 3d shape using lines. In Proc. SPIE Human Vision and Electronic Imaging XVII (Vol. 8291, pp. 361--376). International Society for Optics and Photonics.
7.
DeCarloD.FinkelsteinA.RusinkiewiczS.SantellaA. (2003).
Suggestive contours for conveying shape. ACM Transactions on Graphics,
22, 848–855.
8.
DeLoacheJ. S.PierroutsakosS. L.UttalD. H.RosengrenK. S.GottliebA. (1998).
Grasping the nature of pictures. Psychological Science,
9, 205–210.
9.
DurandF. (2002). An invitation to discuss computer depiction. In Proceedings of the 2nd International Symposium on Non-Photorealistic Animation and Rendering, NPAR ‘02 (pp. 111–124). ACM.
10.
FreemanW. T. (1994).
The generic viewpoint assumption in a framework for visual perception. Science,
368, 542–545.
11.
GombrichE. H. (1961). Art and illusion: A study in the psychology of pictorial representation (2nd ed.).
Princeton University Press.
12.
GoodmanN. (1968). Languages of art: An approach to a theory of symbols.
The Bobbs-Merrill Company.
13.
GoodwinT.VollickI.HertzmannA. (2007). Isophote distance: A shading approach to artistic stroke thicknes. In Proceedings of the 5th International Symposium on Non-Photorealistic Animation and Rendering, NPAR ‘07 (pp. 53–62). ACM.
14.
GrabliS.TurquinE.DurandF.SillionF. X. (2010).
Programmable rendering of line drawing from 3d scenes. ACM Transactions on Graphics,
29, 18:1–18:20.
15.
GuptillA. L. (1997). Rendering in pen and ink (60th anniversary ed.). In S. R. Meyer (Ed.), The classic book on pen and ink techniques for artists, illustrators, architects, and designers. Watson-Guptill.
16.
HertzmannA. (2003).
A survey of stroke-based rendering. IEEE Computer Graphics & Applications,
23, 70–81.
17.
HertzmannA.ZorinD. (2000). Illustrating smooth surfaces. In SIGGRAPH ’00: Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques (pp. 517–526). ACM.
18.
HochbergJ.BrooksV. (1962).
Pictorial recognition as an unlearned ability: A study of one child’s performance. The American Journal of Psychology,
75, 624–628.
19.
JacobsonJ.WernerS. (2004).
Why cast shadows are expendable: Insensitivity of human observers and the inherent ambiguity of cast shadows in pictorial art. Perception,
33, 1369–1383.
20.
JahodaG.DeregowskiJ. B.AmpeneE.WilliamsN. (1977). Pictorial recognition as an unlearned ability: A replication with children from pictorially deprived environments. In ButterworthG. (Ed.), The child’s representation of the world (pp. 203–217).
Springer.
21.
JuddT.DurandF.AdelsonE. (2007).
Apparent ridges for line drawing. ACM Transactions on Graphics,
26.
22.
KennedyJ. M. (1974). A psychology of picture perception: Images and information.
Jossey-Bass.
23.
KennedyJ. M.RossA. S. (1975).
Outline picture perception by the songe of papua. Perception,
4, 391–406.
24.
KerstenD.MamassianP.YuilleA. (2004).
Object perception as Bayesian inference. Annual Review of Psychology,
55, 271–304.
25.
KoenderinkJ. J. (1984).
What does the occluding contour tell us about solid shape?Perception,
13, 321–330.
26.
LasingerK.RanftlR.SchindlerK.KoltunV. (2019). Towards robust monocular depth estimation: Mixing datasets for zero-shot cross-dataset transfer. arXiv. Retrieved from https://arxiv.org/abs/1907.01341v1
27.
LeeY.MarkosianL.LeeS.HughesJ. F. (2007).
Line drawings via abstracted shading. ACM Transactions on Graphics,
26.
28.
MamassianP.LandyM. S. (1998).
Observer biases in the 3D interpretation of line drawings. Vision Research,
38, 2817–2832.
29.
MellorJ. F. J.ParkE.GaninY.BabuschkinI.KulkarniT.RosenbaumD.EslamiS. M. A. (2019). Unsupervised doodling and painting with improved spiral. arXiv. Retrieved from https://arxiv.org/abs/1910.01007
30.
MillerG. (1994). Efficient algorithms for local and global accessibility shading. In SIGGRAPH ’94: Proceedings of the 21st Annual Conference on Computer Graphics and Interactive techniques (pp. 319–326). ACM.
31.
MumfordD. (1994). Pattern theory: A unifying perspective. In A. Joseph, F. Mignot, F. Murat, B. Prum, & R. Rentschler (Eds.), First European Congress of Mathematics: Paris, July 6–10, 1992 Volume I Invited Lectures (Part 1, pp. 187–224). Birkhäuser.
32.
NakanoR. (2019). Neural painters: A learned differentiable constraint for generating brushstroke paintings. arXiv. Retrieved from https://arxiv.org/abs/1904.08410
33.
OstrovskyY.CavanaghP.SinhaP. (2005).
Perceiving illumination inconsistencies in scenes. Perception,
34, 1301–1314.
34.
PearsonD. E.RobinsonJ. A. (1985).
Visual communication at very low data rates. Proceedings of the IEEE,
73, 795–812.
35.
PepperellR. (2015).
Artworks as dichotomous objects: Implications for the scientific study of aesthetic experience. Frontiers in Human Neuroscience,
9(295). Retrieved from https://www.frontiersin.org/articles/10.3389/fnhum.2015.00295/full
36.
SayimB.CavanaghP. (2011).
What line drawings reveal about the visual brain. Frontiers in Human Neuroscience,
5, 118.
37.
WillatsJ.DurandF. (2005).
Defining pictorial style: Lessons from linguistics and computer graphics. Axiomathes,
15, 319–351.
38.
WinkenbachG.SalesinD. H. (1994). Computer-generated pen-and-ink illustration. In SIGGRAPH ’94: Proceedings of the 21st Annual Conference on Computer Graphics and Interactive Techniques (pp. 91–100). ACM.
39.
WinnemöllerH.KyprianidisJ. E.OlsenS. C. (2012).
Xdog: An extended difference-of-gaussians compendium including advanced image stylization. Computers & Graphics,
36, 740–753.