We investigated human perceptual performance allowed by relatively impoverished information conveyed in nighttime natural scenes. We used images of nighttime outdoor scenes rendered in image-intensified low-light visible (i2) sensors, thermal infrared (ir) sensors, and an i2/ir fusion technique with information added. We found that nighttime imagery provides adequate low-level image information for effective perceptual organization on a classification task, but that performance for exemplars within a given object category is dependent on the image type. Overall performance was best with the false-color fused images. This is consistent with the suggestion in the literature that color plays a predominate role in perceptual grouping and segmenting of objects in a scene and supports the suggestion that the addition of color in complex achromatic scenes aids the perceptual organization required for visual search. In the present study, we address the issue of assessment of perceptual performance with alternative night-vision sensors and fusion methods and begin to characterize perceptual organization abilities permitted by the information in relatively impoverished images of complex scenes. Applications of this research include improving night vision, medical, and other devices that use alternative sensors or degraded imagery.
Get full access to this article
View all access options for this article.
References
1.
Barham, P., Oxley, P., & Ayala, B. (1998). Evaluation of the human factors implications of Jaguar's first prototype near-infrared night vision system. In A. G. Gale, I. D. Brown, C. M. Haslegrave, & S. P. Taylor (Eds.), Vision in vehicles 6 (pp. 180–213). Amsterdam: Elsevier.
2.
Beck, J., Prazdny, K., & Rosenfeld, A. (1983). A theory of textural segmentation. In J. Beck, B. Hope, & A. Rosenfeld (Eds.), Human and machine vision (pp. 1–38). New York: Academic.
3.
Berson, E. L. (1976). Night blindness: Some aspects of management. In E. E. Faye (Ed.), Clinical low vision (pp. 42–63). Boston: Little, Brown and Co.
4.
Bravo, M., & Blake, R. (1990). Preattentive processing and perceptual groups. Perception, 19, 515–552.
5.
Cameron, A. A. (1990). The development of the combiner eyepiece night vision goggle. In Proceedings of the SPIE Conference on Helmet-Mounted Displays II (Vol. 1290, pp. 16–29). Bellingham, WA: SPIE -- The International Society for Optical Engineering.
6.
DeFord, J. K., Sinai, M. J., Krebs, W. K., Srinivasan, N., & Essock, E. A. (1997). Perceptual organization of color and non-color nighttime real-world imagery. Investigative Ophthalmology and Visual Science, 38(Suppl.), S641.
7.
Donderi, D. C. (1994). Visual acuity, color vision, and visual search performance at sea. Human Factors, 36, 129–144.
8.
Egeth, H., & Smith, E. (1967). Perceptual selectivity in a visual recognition task. Journal of Experimental Psychology, 74, 543–549.
9.
Essock, E. A. (1992). An essay on texture: The extraction of stimulus structure from the visual image. In B. Burns (Ed.), Percepts, concepts and categories: The representation and processing of visual information (pp. 3–36). Amsterdam: North-Holland.
10.
Essock, E. A., Sinai, M. J., DeFord, J. K., & Srinivasan, N. (1999). Human perceptual performance with nighttime imagery: Region recognition and texture-based segmentation. Manuscript submitted for publication.
11.
Essock, E. A., McCarley, J. S., Sinai, M. J., & Krebs, W. K. (1996). Functional assessment of night-vision enhancement of realworld scenes. Investigative Ophthalmology and Visual Science, 37(Suppl.), S517.
12.
Essock, E. A., Sinai, M. J., Srinivasan, N., DeFord, J. K., & Krebs, W. K. (1997). Texture-based segmentation in real-world nighttime scenes. Investigative Ophthalmology and Visual Science, 38(Suppl.), S639.
13.
Essock, E. A., Williams, R. A., Enoch, J. M., & Raphael, S. (1984). The effects of image degradation by cataract on vernier acuity. Investigative Ophthalmology and Visual Science, 25, 1043–1050.
14.
Friedburg, C., Serey, L., Sharpe, L. T., Trauzettel-Klosinski, S., & Zrenner, E. (1997). Evaluation of the night vision system (NiViS). Investigative Ophthalmology and Visual Science, 38(Suppl), S843.
15.
Grossberg, S. (1988). Neural networks and natural intelligenceCambridge, MA: MIT Press.
16.
Julesz, B. (1984). Toward an axiomatic theory of preattentive vision. In G. M. Edelman, W. E. Gall, & W. M. Cowan (Eds.), Dynamic aspects of neocortical function (pp. 585–612). New York: Wiley.
17.
Krebs, W. K., Scribner, D. A., Schuler, J., Miller, G., & Lobik, D. (1996, June 5). Human factor test and evaluation of a low light sensor fusion device for automobile applications. Paper presented at the Automotive Night Vision/Enhanced Driving Conference, Detroit, MI.
18.
Krebs, W. K., Tinkle, E. C., & Still, D. L. (1994). Ocular adjustment of aviator's night vision imaging system (ANVIS) during different night sky conditions. Proceedings of the Society for Information Display, 25, 303–305.
19.
Li, A., & Lennie, P. (1997). Mechanisms underlying segmentation of colored textures. Vision Research, 37, 83–97.
20.
Luo, R., & Kay, M. (1992). Data fusion and sensor integration: State of the art in the 1990s. In M. Abidi & R. Gonzalez (Eds.), Data fusion in robotics and machine intelligence (pp. 7–136). San Diego: Academic.
21.
Macmillan, N. A., & Creelman, C. D. (1991). Detection theory: A user's guideNew York: Cambridge University Press.
22.
Mollon, J. D. (1989). Tho' she kneel'd in that place where they grew: The uses and origins of primate color vision. Journal of Experimental Biology, 146, 21–38.
23.
Nothdurft, H.-C. (1993). The role of features in preattentive vision: Comparison of orientation, motion and color cues. Vision Research, 33, 1937–1958.
24.
O'Kane, B. L. (1995). Validation of prediction models for target acquisition with electro-optical sensors. In E. Peli (Ed.), Vision models for target detection and recognition (pp. 192–218). London: World Scientific Press.
25.
Pachella, R. G. (1975). The effect of set on the tachistoscopic recognition of pictures. In P. M. A. Rabbitt & S. Dornic (Eds.), Attention and performance V (pp. 136–516). Mahwah, NJ: Erlbaum.
26.
Peli, E., Goldstein, R. B., Young, G. M., Trempe, C. L., & Buzney, S. M. (1991). Images enhancement for the visually impaired: Simulations and experimental results. Investigative Ophthalmology and Visual Science, 32, 2337–2350.
27.
Rabin, J. (1993). Spatial contrast sensitivity through aviator's night vision imaging system. Aviation, Space, and Environmental Medicine, 64, 706–710.
28.
Rabin, J., & Wiley, R. (1994). Switching from forward-looking infrared to night vision goggles: Transitory effects on visual resolution. Aviation, Space, and Environmental Medicine, 65, 327–329.
29.
Ryan, D., & Tinkler, R. (1995). Night pilotage assessment of image fusion. In Proceedings of the SPIE Conference on Helmet- and Head-Mounted Displays and Symbology Design Requirements II (Vol. 2465, pp. 50–67). Bellingham, WA: SPIE -- The International Society for Optical Engineering.
30.
Sampson, M. T., Krebs, W. K., Scribner, D. A., & Essock, E. A. (1996). Visual search in natural (visible, infrared, and fused visible and infrared) stimuli. Investigative Ophthalmology and Visual Science, 37(Suppl.), S296
31.
Schmidt, G. W., Hier, R. G., Benyamin, S., & DeForest, A. E. (1998). Real-time locally adaptive contrast enhancement of medical images by an inexpensive modular image processor. In Proceedings of the SPIE Conference on Medical Imaging II (Vol. 914, pp. 736–741). Bellingham, WA: SPIE -- The International Society for Optical Engineering.
32.
Schneider, W., & Shiffrin, R. M. (1977). Controlled and automatic human information processing: I. Detection, search, and attention. Psychological Review, 84, 1B–66.
33.
Scribner, D., Warren, P., Schuler, J., Satyshur, M., & Kruer, M. (1998, August). Infrared color vision: An approach to senso fusion. Optics and Photonics News, pp. 27–32.
34.
Shiffrin, R. M., & Schneider, W. (1977). Controlled and automatic human information processing: II. Perceptual learning, automatic attending and a general theory. Psychological Review, 84, 127–190.
35.
Steele, P. M., & Perconti, P. (1997). Part task investigation of multispectral image fusion using gray scale and synthetic color night vision sensor imagery for helicopter pilotage. In Proceedings of the SPIE 11th Annual International Symposium on Aerospace/Defense Sensing, Simulation and Controls (pp. 88–100). Bellingham, WA: SPIE -- The International Society for Optical Engineering.
36.
Still, D. L., & Temme, L. A. (1993). The Modulation Transfer Function (MTF) of Night Vision Goggles (NVG). In Proceedings of the Aerospace Medical Association 64th Annual Science Meeting Program (Vol. 64[Suppl.], p. 50).Alexandria, VA: Aerospace Medical Association.
37.
Swift, D. J., Panish, S., & Hippensteele, B. (1997). The use of Vision Works in visual psychophysics research. Spatial Vision, 10, 471–477.
38.
Therrien, C. W., Scrofani, J., & Krebs, W. K. (1997). An adaptive technique for the enhanced fusion of low-light visible with uncooled thermal infrared imagery. In Proceedings of the IEEE International Conference on Image Processing (pp. 405–408). Los Alamitos, CA: Institute of Electrical and Electronics Engineers.
39.
Toet, A., Van Ruyven, L. T., & Valeton, J. M. (1989). Merging thermal and visual images by a contrast pyramid. Optical Engineering, 28, 789–792.
40.
Toet, A., & Walraven, J. (1996). New false color mapping for image fusion. Optical Engineering, 35, 650–658.
41.
Tolhurst, D. J., Tadmor, Y., & Chao, T. (1992). Amplitude spectra of natural images. Ophthalmic and Physiological Optics, 12, 229–232.
42.
Treisman, A., & Gelade, G. (1980). A feature-integration theory of attention. Cognitive Psychology, 12, 97–136.
43.
Treisman, A., & Souther, J. (1985). Search asymmetry: A diagnostic for preattentive processing of separable features. Journal of Experimental Psychology: General, 114, 285–310.
44.
Uttal, W. R., Baruch, T., & Allen, L. (1994). Psychophysical foundations of a model of amplified night vision in target detection tasks. Human Factors, 36, 488–502.
45.
Uttal, W. R., Baruch, T., & Allen, L. (1995a). The effect of combinations of image degradations in a discrimination task. Perception & Psychophysics, 57, 668–681.
46.
Uttal, W. R., Baruch, T., & Allen, L. (1995b). Combining image degradations in a recognition task. Perception & Psychophysics, 57, 682–691.
47.
Vrahimis, G. (1998). Multisensor image fusion -- A neural network based approach. In Proceedings of the International Conference on Neural Information Processing and Intelligent Information Systems (pp. 749–752). New York: Springer-Verlag.
48.
Ward, N. J., Stapleton, L., & Parkes, A. (1994). Behavioral and cognitive impact of night-time driving with HUD contact analogue infrared imaging. Paper presented at the 14th International Technical Conference on Enhanced Safety of Vehicles.
49.
Waxman, A. M., Fay, D. A., Gove, A., Seibert, M., Racamato, J. P., Carrick, J. E., & Savoye, E. D. (1995). Color night vision: Fusion of intensified visible and thermal imagery. In Proceedings of the SPIE Conference on Synthetic Vision for Vehicle Guidance and Control (Vol. 2463, pp. 58–63). Bellingham, WA: SPIE -- The International Society for Optical Engineering.
50.
Waxman, A. M., Gove, A. N., Fay, D. A., Racamato, J. P., Carrick, J. E., Seibert, M. C., & Savoye, E. D. (1997). Color night vision: Opponent processing in the fusion of visible and IR imagery. Neural Networks, 10, 1–6.
51.
Waxman, A. M., Gove, A. N., Seibert, M. C., Fay, D. A., Carrick, J. E., Racamato, J. P., Savoye, E. D., Burke, B. E., Reich, R. K., McGonagle, W. H., & Craig, D. M. (1996). Progress on color night vision: Visible/IR fusion, perception and search, and lowlight CCD imaging. In Proceedings of the SPIE Conference on Enhanced and Synthetic Vision (Vol. 2736, 96–107. Bellingham, WA: SPIE -- The International Society for Optical Engineering.
52.
Werblin, F. S., Roska, T., Chua, L., Jacobs, A., Kozek, T., & Zarandy, A. (1997). Transfer of retinal technology to applications beyond biological vision. Investigative Ophthalmology and Visual Science, 38(Suppl.), S479.
53.
Wilson, H. R. (1991). Model of peripheral and amblyopic hyperacuity. Vision Research, 31, 967–982.
54.
Wolfe, J. M. (1994a). Guided search 2.0: A revised model of visual search. Psychonomics Bulletin Review, 1, 202–238.
55.
Wolfe, J. M. (1994b). The pertinence of research on visual search to radiologic practice. Academic Radiology, 2, 74–78.
56.
Wolfe, J. M. (1994c). Visual search in continuous, naturalistic stimuli. Vision Research, 34, 1187–1195.
