Tensor-voting-based navigation for robotic inspection of 3D surfaces using lidar point clouds

Abstract

This paper describes a solution to robot navigation on curved 3D surfaces. The navigation system is composed of three successive subparts: a perception and representation, a path planning, and a control subsystem. The environment structure is modeled from noisy lidar point clouds using a tool known as tensor voting. Tensor voting propagates structural information from points within a point cloud in order to estimate the saliency and orientation of surfaces or curves found in the environment. A specialized graph-based planner establishes connectivities between robot states iteratively, while considering robot kinematics as well as structural constraints inferred by tensor voting. The resulting sparse graph structure eliminates the need to generate an explicit surface mesh, yet allows for efficient planning of paths along the surface, while remaining feasible and safe for the robot to traverse. The control scheme eventually transforms the path from 3D space into 2D space by projecting movements into local surface planes, allowing for 2D trajectory tracking. All three subparts of our navigation system are evaluated on simulated as well as real data. The methods are further implemented on the MagneBike climbing robot, and validated in several physical experiments related to the scenario of industrial inspection for power plants.

Keywords

robotic inspection 3D perception environment modeling path planning autonomous climbing

Get full access to this article

View all access options for this article.

References

Carsten

Ferguson

Stentz

(2006) 3D field D*: Improved path planning and replanning in three dimensions. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 3381–3386.

Englot

Hover

(2011) Planning complex inspection tasks using redundant roadmaps. In Proceedings of the 15th International Symposium of Robotics Research (ISRR).

Ferguson

Stentz

(2006) Using interpolation to improve path planning: The field D* algorithm. Journal of Field Robotics 23: 79–101.

Furgale

Barfoot

(2010) Visual path following on a manifold in unstructured three-dimensional terrain. In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), pp. 534–539.

Gingras

Lamarche

Bedwani

J-L

Dupuis

(2010) Rough terrain reconstruction for rover motion planning. In Proceedings of the Canadian Conference on Computer and Robot Vision (CRV), pp. 191–198.

Hart

Nilsson

Raphael

(1968) A formal basis for the heuristic determination of minimum cost paths. IEEE Transactions on Systems Science and Cybernetics 4: 100–107.

Hebert

Caillas

Krotkov

Kweon

Kanade

(1989) Terrain mapping for a roving planetary explorer. In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), pp. 997–1002.

Howard

Kelly

(2007) Optimal rough terrain trajectory generation for wheeled mobile robots. The International Journal of Robotics Research 26: 141–166.

Kazhdan

Bolitho

Hoppe

(2006) Poisson surface reconstruction. In Proceedings of the Fourth Eurographics Symposium on Geometry processing, pp. 61–70.

10.

Kimmel

Sethian

(1998) Computing geodesic paths on manifolds. Proceedings of the National Academy of Sciences of the USA 95: 8431–8435.

11.

King

(2008) Range Data Analysis by Free-space Modeling and Tensor Voting. Ph.D. thesis, Rensselaer Polytechnic Institute.

12.

Kneip

Tâche

Caprari

Siegwart

(2009) Characterization of the compact Hokuyo URG-04LX 2D laser range scanner. In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), pp. 1447–1454.

13.

Koenig

Likhachev

(2002) Improved fast replanning for robot navigation in unknown terrain. In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), pp. 968–975.

14.

LaValle

(2006) Planning Algorithms. Cambridge: Cambridge University Press.

15.

Marton

Rusu

Beetz

(2009) On fast surface reconstruction methods for large and noisy datasets. In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), pp. 3218–3223.

16.

Medioni

Lee

M-S

Tang

C-K

(2000) A Computational Framework for Segmentation and Grouping. Amsterdam: Elsevier Science B.V.

17.

Medioni

Mordohai

(2004) The tensor voting framework. In Medioni

Kang

(eds), Emerging Topics in Computer Vision. Englewood Cliffs, NJ: Prentice-Hall, pp. 191–253.

18.

Mordohai

Medioni

(2005) Dimensionality Estimation and Manifold Learning using Tensor Voting. Technical report, Institute for Robotics and Intelligent Systems, University of Southern California.

19.

Nash

Koenig

Tovey

(2010) Lazy theta*: Any-angle path planning and path length analysis in 3D. In Proceedings of the AAAI Conference on Artificial Intelligence (AAAI).

20.

Pauly

Gross

Kobbelt

(2002) Efficient simplification of point-sampled surfaces. In Proceedings of the Conference on Visualization (VIS), pp. 163–170.

21.

Pivtoraiko

Kelly

(2005) Efficient constrained path planning via search in state lattices. In Proceedings of the 8th International Symposium on Artificial Intelligence, Robotics and Automation in Space.

22.

Pomerleau

Breitenmoser

Liu

Colas

Siegwart

(2012) Noise characterization of depth sensors for surface inspections. In Proceedings of the International Conference on Applied Robotics for Power Industry (CARPI).

23.

Quigley

Conley

Gerkey

. (2009) ROS: an open-source robot operating system. In ICRA Workshop on Open Source Software.

24.

Samson

Ait-Abderrahim

(1991) Feedback control of a nonholonomic wheeled cart in cartesian space. In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), pp. 1136–1141.

25.

Schnabel

Wahl

Klein

(2007) Efficient RANSAC for point-cloud shape detection. Computer Graphics Forum 26: 214–226.

26.

Singh

Kelly

(1996) Robot planning in the space of feasible actions: Two examples. In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), pp. 3309–3316.

27.

Smith

Posner

Newman

(2010) Efficient non-parametric surface representations using active sampling for push broom laser data. In Proceedings of Robotics: Science and Systems.

28.

Surazhsky

Kirsanov

Gortler

Hoppe

(2005) Fast exact and approximate geodesics on meshes. In ACM SIGGRAPH, pp. 553–560.

29.

Tâche

Fischer

Caprari

Siegwart

Moser

Mondada

(2009) Magnebike: A magnetic wheeled robot with high mobility for inspecting complex-shaped structures. Journal of Field Robotics 26: 453–476.

30.

Tâche

Pomerleau

Caprari

Siegwart

Bosse

Moser

(2011) Three-dimensional localization for the MagneBike inspection robot. Journal of Field Robotics 28: 180–203.

31.

Tavakoli

Faria

Marques

de Almeida

(2011) Autonomous mapping for inspection of 3D structures. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 4277–4283.

32.

Thrun

Martin

Liu

. (2004 a) A real-time expectation-maximization algorithm for acquiring multiplanar maps of indoor environments with mobile robots. IEEE Transactions on Robotics and Automation 20: 433–443.

33.

Thrun

Thayer

Whittaker

. (2004 b) Autonomous exploration and mapping of abandoned mines. IEEE Robotics and Automation Magazine 11(4): 79–91.

34.

Triebel

Pfaff

Burgard

(2006) Multi-level surface maps for outdoor terrain mapping and loop closing. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 2276–2282.

35.

Vandapel

Huber

Kapuria

Hebert

(2004) Natural terrain classification using 3-D ladar data. In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), pp. 5117–5122.

36.

Wettergreen

Moreland

Skonieczny

Jonak

Kohanbash

Teza

(2010) Design and field experimentation of a prototype lunar prospector. The International Journal of Robotics Research 29: 1550–1564.

37.

Wong

Morris

Lea

. (2011) Comparative evaluation of range sensing technologies for underground void modeling. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 3816–3823.

38.

Wurm

Hornung

Bennewitz

Stachniss

Burgard

(2010) OctoMap: A probabilistic, flexible, and compact 3D map representation for robotic systems. In Proceedings of the ICRA 2010 Workshop on Best Practice in 3D Perception and Modeling for Mobile Manipulation.

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB