The human visual system can extract 3-D shape information of unfamiliar moving objects from their projected transformations. Computational studies of this capacity have established that 3-D shape can be extracted correctly from a brief presentation, provided the moving objects are rigid. The human visual system requires a longer temporal extension, but it can cope with considerable deviations from rigidity. It is shown how the 3-D structure of rigid as well as nonrigid objects can be recovered by maintaining an internal model of the viewed object and modifying it at each instant by the minimal nonrigid change that is sufficient to account for the observed transformation. The results of applying this incremental rigidity scheme to rigid and nonrigid objects in motion are described and compared with human perception.
Get full access to this article
View all access options for this article.
References
1.
AdelsonE HMovshonJ A, 1982“Phenomenal coherence of moving visual patterns”Nature (London)300523–525.
2.
BobickA, 1983“A hybrid approach to structure-from-motion” in Proceedings of the ACM Interdisciplinary Workshop on Motion, Toronto, Canada, April, 1983 pp 91–109.
3.
BraddickO J, 1974“A short-range process in apparent motion”Vision Research14519–527.
4.
BraunsteinM L, 1962“Depth perception in rotation dot patterns: Effects of numerosity and perspective”Journal of Experimental Psychology64415–420.
5.
BraunsteinM L, 1976Depth Perception through Motion (New York: Academic Press).
6.
ClocksinW F, 1980“Perception of surface slant and edge labels from optical flow: A computational approach”Perception9253–269.
7.
DavidonW C, 1968“Variance algorithm for minimization”The Computer Journal10406–413.
8.
EdenM, 1962“A three-dimensional optical illusion”MIT Research Laboratory of Electronics Quarterly Progress Report (64) 267–274.
9.
FennemaC LThompsonW B, 1979“Velocity determination in scenes containing several moving objects”Computer Graphics and Image Processing9301–315.
10.
GibsonJ JGibsonE J, 1957“Continuous perspective transformations and the perception of rigid motion”Journal of Experimental Psychology54129–138.
11.
GreenB F, 1961“Figure coherence in the kinetic depth effect”Journal of Experimental Psychology62272–282.
12.
HayC J, 1966“Optical motions and space perception—an extension of Gibson's analysis”Psychological Review73550–565.
13.
HoffmanD DFlinchbaughB E, 1982“The interpretation of biological motion”Biological Cybernetics42195–204.
14.
HornB K PSchunckB G, 1981“Determining optical flow”Artificial Intelligence17185–203.
15.
JanssonGJohanssonG, 1973“Visual perception of bending motion”Perception2321–326.
16.
JohanssonG, 1964“Perception of motion and changing form”Scandinavian Journal of Psychology5181–208.
17.
JohanssonG, 1974“Visual perception of rotary motion as transformation of conic sections—a contribution to the theory of visual space perception”Psychologia17226–237.
JohanssonG, 1978“Visual event perception” in Handbook of Sensory Physiology Eds HeldRLeibowitzH WTeuberH-L, (Berlin: Springer).
20.
JohanssonGJanssonG, 1968“Perceived rotary motion from changes in a straight line”Perception & Psychophysics4165–170.
21.
JuleszB, 1971Foundation of Cyclopean Perception (Chicago: University of Chicago Press).
22.
KoenderinkJ JVan DoornA J, 1975“Invariant properties of the motion parallax field due to the motion of rigid bodies relative to the observer”Optica Acta22773–791.
23.
LappinJ SDonerJ FKottasB L, 1980“Minimal conditions for the visual detection of structure and motion in three dimensions”Science209717–719.
24.
LappinJ SFuquaM A, 1983“Accurate visual measurement of three-dimensional moving patterns”Science221480–482.
25.
LeeD N, 1976“A theory of visual control of braking based on information about time to collision”Perception5437–459.
26.
LeeD N, 1980“The optic flow field: The foundation of vision”Philosophical Transactions of the Royal Society of London, Series B290169–179.
27.
LindsayP HNormanD A, 1972Human Information Processing (New York: Academic Press).
28.
Longuet-HigginsH C, 1982“The role of the vertical dimension in stereoscopic vision”Perception11377–386.
29.
Longuet-HigginsH CPrazdnyK, 1980“The interpretation of a moving retinal image”Proceedings of the Royal Society of London, Series B208385–397.
30.
MilesW R, 1931“Movement interpretations of the silhouette of a revolving fan”American Journal of Psychology43392–405.
31.
PetersikJ T, 1979“Three-dimensional object constancy: Coherence of a simulated rotating sphere in noise”Perception & Psychophysics25328–335.
32.
PetersikJ T, 1980“The effect of spatial and temporal factors on the perception of stroboscopic rotation simulations”Perception9271–283.
33.
ShepardR NCooperL A, 1982Mental Images and Their Transformations (Cambridge, MA: MIT Press).
34.
ShepardR NMetzlerJ, 1971“Mental rotation of three-dimensional objects”Science171701–703.
35.
SperlingGPavelMCohenYLandyM SSchwartzB J, 1983 in Physical and Biological Processing of Images Eds BraddickO JSleighA C, (Berlin: Springer).
36.
TsaiR YHuangT S, 1982“Uniqueness and estimation of three-dimensional motion parameters of rigid objects with curved surfaces”University of Illinois at Urbana - Champaign Coordinated Science Laboratory Report R-921.
37.
UllmanS, 1979aThe Interpretation of Visual Motion (Cambridge, MA: MIT Press).
38.
UllmanS, 1979b“The interpretation of structure from motion”Proceedings of the Royal Society of London, Series B203405–426.
39.
UllmanS, 1979c“Relaxation and constrained optimization by local processes”Computer Graphics and Image Processing9(6) 115–125.
40.
UllmanS, 1983“Recent computational results in the interpretation of structure from motion” in Human and Machine Vision Eds RosenfeldABeckJ, (New York: Academic Press) pp 459–480.
41.
UllmanSHildrethE, 1983“The measurement of visual motion” in Physical and Biological Processing of Images Eds BraddickO JSleighA C, (Berlin: Springer).
42.
WallachHO'ConnellD N, 1953“The kinetic depth effect”Journal of Experimental Psychology45205–217.
43.
WallachHO'ConnellD NNeisserU, 1953“The memory effect of visual perception of 3-D form”Journal of Experimental Psychology45360–368.
44.
WallachHWeiszAAdamsP A, 1956“Circles and derived figures in rotation”American Journal of Psychology6948–59.
45.
WebbJ AAggarwalJ K, 1981“Visually interpreting the motions of objects in space”Computer14(8) 40–49.
46.
WhiteB WMueserG E, 1960“Accuracy in reconstructing the arrangement of elements generating kinetic depth displays”Journal of Experimental Psychology601–11.
