Sage Journals: Discover world-class research

Abstract

Cameras and inertial sensors are each good candidates for autonomous vehicle navigation, modeling from video, and other applications that require six-degrees-of-freedom motion estimation. However, these sensors are also good candidates to be deployed together, since each can be used to resolve the ambiguities in estimated motion that result from using the other modality alone. In this paper, we consider the specific problem of estimating sensor motion and other unknowns from image, gyro, and accelerometer measurements, in environments without known fiducials. This paper targets applications where external positions references such as global positioning are not available, and focuses on the use of small and inexpensive inertial sensors, for applications where weight and cost requirements preclude the use of precision inertial navigation systems.

We present two algorithms for estimating sensor motion from image and inertial measurements. The first algorithm is a batch method, which produces estimates of the sensor motion, scene structure, and other unknowns using measurements from the entire observation sequence simultaneously. The second algorithm recovers sensor motion, scene structure, and other parameters recursively, and is suitable for use with long or “infinite” sequences, in which no feature is always visible.

We evaluate the accuracy of the algorithms and their sensitivity to their estimation parameters using a sequence of four experiments. These experiments focus on cases where estimates from image or inertial measurements alone are poor, on the relative advantage of using inertial measurements and omni directional images, and on long sequences in which the percentage of the image sequence in which individual features are visible is low.

Get full access to this article

View all access options for this article.

References

Baker, S., and Nayar, S.K. 2001. Single viewpoint catadioptric cameras. Panoramic Vision: Sensors, Theory, and Applications. Springer-Verlag, New York , pp. 39-71.

Bar-Shalom, Y., and Li, X.-R. 1995. Multitarget-Multisensor Tracking: Principles and Techniques. YBS Publishing, Storrs, CT .

Brooks, M.J., Chojnacki, W., Gawley, D., and van den Hengel, A. 2001. What value covariance information in estimating vision parameters? Proceedings of the 8th IEEE International Conference on Computer Vision (ICCV 2001), Vancouver, Canada.

Chahl, J.S., and Srinivasan, M.V. 1997. Reflective surfaces for panoramic imaging . Applied Optics 36(31): 8275-8285 .

Chai, L., Hoff, W.A., and Vincent, T. 2002. Three-dimensional motion and structure estimation using inertial sensors and computer vision for augmented reality . Presence 11(5): 474-491 .

Chong, K.S., and Kleeman, L. 1999. Feature-based mapping in real, large scale environments using an ultrasonic array . International Journal of Robotics Research 18(1): 3-19 .

Craig, J.J. 1989. Introduction to Robotics: Mechanics and Control. Addison-Wesley, Reading, MA .

Deans, M.C. 2002. Bearings-Only Localization and Mapping. PhD thesis, Carnegie Mellon University, Pittsburgh, PA.

Deans, M., and Hebert, M. 2001. Experimental comparison of techniques for localization and mapping using a bearing-only sensor. Experimental Robotics VII, D. Rus and S. Singh, editors. Springer-Verlag, Berlin , pp. 395-404.

10.

Foxlin, E.M. 2002. Generalized architecture for simultaneous localization, auto-calibration, and map-building . Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2002), EPFL, Lausanne, Switzerland, September 30-October 4.

11.

Foxlin, E., and Naimark, L. 2003. VIS-Tracker: a wearable vision-inertial self-tracker . IEEE Virtual Reality Conference (VR 2003), Los Angeles, CA, March.

12.

Gelb, A., editor. 1974. Applied Optimal Estimation. MIT Press, Cambridge, MA .

13.

Guivant, J., and Nebot, E. 2001. Compressed filter for real time implementation of simultaneous localization and mapping . International Conference on Field and Service Robotics (FSR 2001), Otaniemi, Finland, June, Vol. 1, pp. 309-314 .

14.

Heikkilä, J., and Silvén, O. 1997. A four-step camra calibration procedure with implicit image correction . Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR 1997), San Juan, Puerto Rico, pp. 1106-1112 .

15.

Horn, B.K.P. 1987. Closed-form solution of absolute orientation using unit quaternions . Journal of the Optical Society of America A 4(4): 629-642 .

16.

Huster, A., and Rock, S.M. 2001a. Relative position estimation for intervention-capable AUVs by fusing vision and inertial measurements . Proceedings of the 12th International Symposium on Unmanned Untethered Submersible Technology, Durham, NH, August.

17.

Huster, A., and Rock, S.M. 2001b. Relative position estimation for manipulation tasks by fusing vision and inertial measurements . Oceans 2001 Conference, Honolulu, HI, November, Vol. 2, pp. 1025-1031 .

18.

Huster, A., and Rock, S.M. 2003. Relative position sensing by fusing monocular vision and inertial rate sensors . Proceedings of the 11th International Conference on Advanced Robotics (ICAR 2003), Coimbra, Portugal, July, Vol. 3, pp. 1562-1567 .

19.

Huster, A., Frew, E.W., and Rock, S.M. 2002. Relative position estimation for AUVs by fusing bearing and inertial rate sensor measurements . Oceans 2002 Conference, Biloxi, MS, October, pp. 1857-1864 .

20.

Jung, S.-H., and Taylor, C.J. 2001. Camera trajectory estimation using inertial sensor measurements and structure from motion results . Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2001), Kauai, HI, December, Vol. 2, pp. 732-737 .

21.

Kanazawa, Y., and Kanatani, K. 2001. Do we really have to consider covariance matrices for image features? Proceedings of the 8th IEEE International Conference on Computer Vision (ICCV 2001), Vancouver, Canada, July.

22.

Lowe, D.G. 1999. Object recognition and local scale-invariant features . Proceedings of the 7th International Conference on Computer Vision (ICCV 1999), Corfu, Greece, September, pp. 1150-1157 .

23.

Lucas, B.D., and Kanade, T. 1981. An iterative image registration technique with an application to stereo vision . Proceedings of the 7th International Joint Conference on Artificial Intelligence, Vancouver, Canada, August, Vol. 2, pp. 674-679 .

24.

McLauchlan, P.F. 1999. The variable state dimension filter applied to surface-based structure from motion. Technical Report VSSP-TR-4/99, University of Surrey, Guildford, UK .

25.

Montemerlo, M., and Thrun, S. 2003. Simultaneous localization and mapping with unknown data association using Fast SLAM . Proceedings of the IEEE International Conference on Robotics and Automation (ICRA 2003), Taipei, Taiwan.

26.

Mukai, T., and Ohnishi, N. 1999. The recovery of object shape and camera motion using a sensing system with a video camera and a gyro sensor . Proceedings of the 7th IEEE International Conference on Computer Vision (ICCV 1999), Corfu, Greece, September, pp. 411-417 .

27.

Nayar, S.K. 1997. Catadioptric omnidirectional camera . Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR 1997), San Juan, Puerto Rico, June, pp. 482-488 .

28.

Ollis, M., Herman, H., and Singh, S. 1999. Analysis and design of panoramic stereo vision using equi-angular pixel cameras. Technical Report CMU-RI-TR-99-04, Carnegie Mellon University, Pittsburgh, PA .

29.

Poelman, C.J. 1995. The Para perspective and Projective Factorization Methods for Recovering Shape and Motion. PhD thesis, Carnegie Mellon University, Pittsburgh, PA.

30.

Press, W.H., Teukolsky, S.A., Vetterling, W.T., and Flannery, B.P. 1992. Numerical Recipes in C: The Art of Scientific Computing. Cambridge University Press, Cambridge .

31.

Qian, G., and Chellappa, R. 2001. Structure from motion using sequential Monte Carlo methods . Proceedings of the 8th IEEE International Conference on Computer Vision (ICCV 2001), Vancouver, Canada, July, pp. 614-621 .

32.

Qian, G., Chellappa, R., and Zhang, Q. 2001. Robust structure from motion estimation using inertial data . Journal of the Optical Society of America A 18(12): 2982-2997 .

33.

Rasmussen, C., and Hager, G.D. 2001. Probabilistic data association method for tracking complex visual objects . IEEE Transactions on Pattern Analysis and Machine Intelligence 23(6): 560-576 .

34.

Rehbinder, H., and Ghosh, B.K. 2001. Rigid body state estimation using dynamic vision and inertial sensors . Proceedings of the 40th IEEE Conference on Decision and Control (CDC 2001), Orlando, FL, December, pp. 2398-2403 .

35.

Smith, R., Self, M., and Cheeseman, P. 1990. Estimating uncertain spatial relationships in robotics. Autonomous Robot Vehicles, I.J. Cox and G.T. Wilfong, editors. Springer-Verlag, New York , pp. 167-193.

36.

Strelow, D., Mishler, J., Singh, S., and Herman, H. 2001a. Extending shape-from-motion to non-central omnidirectional cameras . Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2001), Wailea, HI, October.

37.

Strelow, D., Mishler, J., Koes, D., and Singh, S. 2001b. Precise omnidirectional camera calibration . Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2001), Kauai, HI, December, Vol. 1, pp. 689-694 .

38.

Szeliski, R., and Kang, S.B. 1994. Recovering 3D shape and motion from image streams using nonlinear least squares . Journal of Visual Communication and Image Representation 5(1): 10-28 .

39.

Tomasi, C., and Kanade, T. 1992. Shape and motion from image streams under orthography: a factorization method . International Journal of Computer Vision 9(2): 137-154 .

40.

Weng, J., Cui, Y., and Ahuja, N. 1997. Transitory image sequences, asymptotic properties, and estimation of motion and structure . IEEE Transactions on Image Analysis and Machine Intelligence 19(5): 451-464 .

41.

Wolf, P.R. 1983. Elements of Photogrammetry. McGraw-Hill, New York .

42.

You, S., and Neumann, U. 2001. Fusion of vision and gyro tracking for robust augmented reality registration . Proceedings of the IEEE Virtual Reality Conference (VR 2001), Yokohama, Japan, March, pp. 71-78 .

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

Motion Estimation from Image and Inertial Measurements

Abstract

Get full access to this article

References

Supplementary Material