We propose AstroSLAM, a standalone vision-based solution for autonomous online navigation around an unknown celestial target small body. AstroSLAM is predicated on the formulation of the SLAM problem as an incrementally growing factor graph, facilitated by the use of the GTSAM library and the iSAM2 engine. By combining sensor fusion with orbital motion priors, we achieve improved performance over a baseline SLAM solution and outperform state-of-the-art methods predicated on pre-integrated inertial measurement unit factors. We incorporate orbital motion constraints into the factor graph by devising a novel relative dynamics—RelDyn—factor, which links the relative pose of the spacecraft to the problem of predicting trajectories stemming from the motion of the spacecraft in the vicinity of the small body. We demonstrate AstroSLAM’s performance and compare against the state-of-the-art methods using both real legacy mission imagery and trajectory data courtesy of NASA’s Planetary Data System, as well as real in-lab imagery data produced on a 3 degree-of-freedom spacecraft simulator test-bed.
AndersonSBarfootTD (2015) Full steam ahead: exactly sparse Gaussian process regression for batch continuous-time trajectory estimation on SE(3). In 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Hamburg, Germany, 157–164.
2.
AndersonSBarfootTDTongCH, et al. (2015) Batch nonlinear continuous-time trajectory estimation as exactly sparse Gaussian process regression. Autonomous Robots39(3): 221–238.
3.
AndrleMSCrassidisJL (2013) Geometric integration of quaternions. Journal of Guidance, Control, and Dynamics36(6): 1762–1767.
4.
AntreasianPAdamCLeonardJ, et al. (2022) OSIRIS-REx proximity operations and navigation performance at Bennu. In The 32nd AIAA/AAS Space Flight Mechanics Meeting. San Diego, CA: AIAA.
5.
BaldiniFHarvardAChungS, et al. (2018) Autonomous small body mapping and spacecraft navigation via real-time SPC-SLAM. In: 69th IAF International Astronautical Congress (IAC), Bremen, Germany, October 2018. IAF.
6.
BarnouinODalyMPalmerE, et al. (2020) Digital terrain mapping by the OSIRIS-REx mission. Planetary and Space Science180: 104764.
7.
BayHTuytelaarsTVan GoolL (2006) SURF: Speeded up robust features. In: European Conference on Computer Vision. Graz, Austria: Springer, 404–417.
8.
BercoviciBMcMahonJW (2019) Inertia parameter statistics of an uncertain small body shape. Icarus328: 32–44.
9.
BercoviciBMcMahonJW (2019) Robust autonomous small-body shape reconstruction and relative navigation using range images. Journal of Guidance, Control, and Dynamics42(7): 1473–1488.
10.
BerryKGetzandannerKMoreauM, et al. (2022) Contact with Bennu! Flight performance versus prediction of OSIRIS-REx TAG sample collection. In: The 32nd AIAA/AAS Space Flight Mechanics Meeting. San Diego, CA: AIAA.
11.
BhaskaranSKennedyB (2014) Closed loop terminal guidance navigation for a kinetic impactor spacecraft. Acta Astronautica103: 322–332.
12.
BhaskaranSNandiSBroschartS, et al. (2011) Small body landings using autonomous onboard optical navigation. Journal of the Astronautical Sciences58(3): 409–427.
13.
ChirikjianG (2011) Stochastic Models, Information Theory, and Lie Groups, Volume 2: Analytic Methods and Modern Applications, volume 2. New York, NY: Springer Science & Business Media.
14.
ChoDMJungDTsiotrasP (2009) A 5-DOF experimental platform for spacecraft rendezvous and docking. In: AIAA Infotech@ Aerospace Conference and AIAA Unmanned…Unlimited Conference, Seattle, WA: AIAA, p. 1869.
15.
ChristianJLightseyG (2012) Onboard image-processing algorithm for a spacecraft optical navigation sensor system. Journal of Spacecraft and Rockets49(2): 337–352.
16.
ChurchEBourbeauTCurridenJ, et al. (2020) Flash LIDAR on-orbit performance at asteroid Bennu. In: 43rd Annual AAS Guidance and Control Conference. Breckenridge, CO: AIAA. AAS, 20–148.
17.
CocaudCKubotaT (2010) SURF-based SLAM scheme using octree occupancy grid for autonomous landing on asteroids. In: Proceedings of the 10th International Symposium on Artificial Intelligence, Robotics and Automation in Space (i-SAIRAS), Sapporo, Japan: ESA, Vol. volume 29.
18.
CocaudCKubotaT (2012) Autonomous navigation near asteroids based on visual SLAM. In: Proceedings of the 23rd International Symposium on Space Flight Dynamics, Pasadena, CA, October 2012.
19.
DellaertF (2021) Factor graphs: exploiting structure in robotics. Annual Review of Control, Robotics, and Autonomous Systems4: 141–166.
20.
DellaertFKaessM (2017) Factor graphs for robot perception. Foundations and Trends in Robotics6(1-2): 1–139.
21.
DelpechMBissonnetteVRastelL (2015) Vision-based navigation for proximity operations around asteroid 99942 Apophis. In: Proceedings of 25th International Symposium on Space Flight Dynamics. Munich, Germany.
22.
DongJMukadamMDellaertF, et al. (2016) Motion planning as probabilistic inference using Gaussian processes and factor graphs. In: Robotics: Science and Systems (RSS).IEEE. Ann Arbor, MI, volume 12.
23.
DorMSkinnerKADriverT, et al. (2021) Visual SLAM for asteroid relative navigation. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Virtual, June 2021. IEEE, 2066–2075.
24.
DriverTDorMSkinnerK, et al. (2020) Space carving in space: a visual-SLAM approach to 3D shape reconstruction of a small celestial body. In: AAS/AIAA Astrodynamics Specialist Conference. Virtual,August 2020.
25.
ForsterCCarloneLDellaertF, et al. (2016) On-manifold preintegration for real-time visual–inertial odometry. IEEE Transactions on Robotics33(1): 1–21.
26.
FourieDEspinozaATKaessM, et al. (2021) Characterizing marginalization and incremental operations on the bayes tree. In: Algorithmic Foundations of Robotics XIV: Proceedings of the Fourteenth Workshop on the Algorithmic Foundations of Robotics 14.Oulu, Finland, June2021. Springer, 227–242.
27.
FraserDC (1967) A new technique for the optimal smoothing of data. PhD Thesis. Massachusetts Institute of Technology.
28.
Galvez-LópezDTardosJD (2012) Bags of binary words for fast place recognition in image sequences. IEEE Transactions on Robotics28(5): 1188–1197.
29.
GaskellRBarnouin-JhaOScheeresD, et al. (2008) Characterizing and navigating small bodies with imaging data. Meteoritics & Planetary Science43(6): 1049–1061.
30.
GelbAKasperJNashR, et al. (1974) Applied Optimal Estimation. Cambridge, MA: MIT Press.
31.
GetzandannerKMBerryKEAntreasianPG, et al. (2022) Small-body proximity operations & TAG: navigation experiences & lessons learned from the OSIRIS-REx mission. The 32nd AIAA/AAS Space Flight Mechanics Meeting. San Diego, CA: AIAA.
32.
GoelAUl IslamAAnsariA, et al. (2021) An introduction to inertial navigation from the perspective of state estimation [focus on education]. IEEE Control Systems41(5): 104–128.
33.
GoossensSRowlandsDDMazaricoE, et al. (2021) Mass and shape determination of (101955) Bennu using differenced data from multiple OSIRIS-REx mission phases. The Planetary Science Journal2(6): 219.
34.
HartleyRZissermanA (2004) Multiple View Geometry in Computer Vision. 2nd edition. Cambridge, UK: Cambridge University Press.
35.
KaessMJohannssonHRobertsR, et al. (2012) iSAM2: incremental smoothing and mapping using the Bayes tree. The International Journal of Robotics Research31(2): 216–235.
36.
KonoplivAAsmarSParkR, et al. (2014) The Vesta gravity field, spin pole and rotation period, landmark positions, and ephemeris from the dawn tracking and optical data. Icarus240: 103–117.
37.
LaurettaD (2021) The OSIRIS-REx touch-and-go sample acquisition event and implications for the nature of the returned sample. In: 52nd Lunar and Planetary Science Conference. Virtual, March2021.
38.
LeonardJMGeeraertJLPageBR, et al. (2020) OSIRIS-REx shape model performance during the navigation campaign. In: 43rd Annual AAS Guidance and Control Conference.Breckenridge, CO, February 2020.
39.
LeonardJMoreauMAntreasianP, et al. (2022) Cross-calibration of GNC and OLA LIDAR systems onboard OSIRIS-REx. In: 44th Annual AAS Guidance and Control Conference. Breckenridge, CO.
40.
LeonardJMGeeraertJLPelgriftJY, et al. (2022) Navigation prediction performance during OSIRIS-REx proximity operations at (101955) Bennu. In: The 32nd AIAA/AAS Space Flight Mechanics Meeting. San Diego, CA: AIAA.
41.
LepetitVMoreno-NoguerFFuaP (2009) Epnp: an accurate O(n) solution to the pnp problem. International Journal of Computer Vision81(2): 155–166.
42.
LoweD (2004) Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision60(2): 91–110.
43.
MatsuzakiTKamedaHTsujimichiS, et al. (2000) Maneuvering target tracking using constant velocity and constant angular velocity model. In: IEEE International Conference on Systems, Man and Cybernetics, volume 5. Nashville, TN, pp. 3230–3234.
44.
MillerJK (2002) Determination of shape, gravity and rotation state of asteroid 433 Eros. Icarus155(1): 3–17.
45.
MillerJ (2019) Measurements and calibrations. In: Planetary Spacecraft Navigation. Cham: Springer International Publishing, 255–292.
46.
MillerJRourkeK (1977) The application of differential VLBI to planetary approach orbit determination. The Deep Space Network Progress Report42: 40.
47.
NakathDClemensJSchillK (2018) Multi-sensor fusion and active perception for autonomous deep space navigation. In: 21st International Conference on Information Fusion (FUSION). Cambridge, UK: IEEE, 2596–2605.
48.
NakathDClemensJRachuyC (2020) Active asteroid-slam. Journal of Intelligent and Robotic Systems99(2): 303–333.
49.
NathuesASierksHGutierrez-MarquesP, et al. (2011) DAWN FC2 calibrated Vesta images v1.0: NASA Planetary Data System.
50.
NesnasIADHockmanBJBandopadhyayS, et al. (2021) Autonomous exploration of small bodies toward greater autonomy for deep space missions. Frontiers in Robotics and AI8: 1–26.
51.
OestreichCEspinozaATToddJ, et al. (2021) On-orbit inspection of an unknown, tumbling target using nasa’s astrobee robotic free-flyers. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2039–2047.
52.
PreuskerFScholtenFMatzK, et al. (2016) DAWN FC2 Derived Vesta DTM SPG V1. 0: NASA Planetary Data System.
53.
ProckterLMurchieSChengA, et al. (2002) The near shoemaker mission to asteroid 433 Eros. Acta Astronautica51(1): 491–500.
54.
RathinamADempsterA (2017) Monocular vision based simultaneous localization and mapping for close proximity navigation near an asteroid. In: 68th IAF International Astronautical Congress. Adelaide, Australia: IAF.
55.
RubleeERabaudVKonoligeK, et al. (2011) ORB: an efficient alternative to SIFT and SURF. In: IEEE International Conference on Computer Vision, Barcelona, Spain, 2564–2571.
56.
RussellCRaymondC (2012) The Dawn Mission to Minor Planets 4 Vesta and 1 Ceres. New York, NY: Springer Science & Business Media.
57.
SageAPMelsaJL (1971) Estimation theory with applications to communications and control. McGraw-Hill Series in Systems Science. New York, NY: McGraw-Hill.
58.
SchaubHJunkinsJL (2003) Analytical Mechanics of Space Systems. Aiaa.
59.
ScheeresD (2016) Orbital Motion in Strongly Perturbed Environments: Applications to Asteroid, Comet and Planetary Satellite Orbiters. Springer Berlin Heidelberg: Springer Praxis Books. URL https://books.google.com/books?id=kAuPDAAAQBAJ
60.
SetterfieldTP (2017) On-orbit inspection of a rotating object using a moving observer. PhD Thesis. Cambridge, MA: Massachusetts Institute of Technology.
61.
SetterfieldTPMillerDLeonardJJ, et al. (2017) Smoothing-based estimation of an inspector satellite trajectory relative to a passive object. In: 2017 IEEE Aerospace Conference, March2017. pp. 1–11.
62.
SetterfieldTPMillerDWLeonardJJ, et al. (2018) Mapping and determining the center of mass of a rotating object using a moving observer. The International Journal of Robotics Research37(1): 83–103.
63.
SetterfieldTPMillerDWSaenz-OteroA, et al. (2018) Inertial properties estimation of a passive on-orbit object using polhode analysis. Journal of Guidance, Control, and Dynamics41(10): 2214–2231.
64.
SpeyerJLChungWH (2008) Stochastic Processes, Estimation, and Control. Philadelphia, PA: SIAM.
65.
StarekJAAçıkmeşeBNesnasIA, et al. (2016) Spacecraft Autonomy Challenges for Next-Generation Space Missions. Berlin, Heidelberg: Springer Berlin Heidelberg, 1–48.
66.
TakeishiNYairiTTsudaY, et al. (2015) Simultaneous estimation of shape and motion of an asteroid for automatic navigation. In: IEEE International Conference on Robotics and Automation (ICRA),Seattle, WA, MAy 2015. 2861–2866.
67.
Terán EspinozaA (2021) Versatile inference algorithms using the bayes tree for robot navigation. PhD Thesis. Cambridge, MA: Massachusetts Institute of Technology.
68.
TeruiFOgawaNOnoG, et al. (2020) Guidance, navigation, and control of Hayabusa 2 touchdown operations. Astrodynamics4(4): 393–409.
69.
ThomasPCBinzelRPGaffeyMJ, et al. (1997) Vesta: spin pole, size, and shape from HST images. Icarus128(1): 88–94.
70.
TweddleBE (2013) Computer vision based navigation for spacecraft proximity operations. PhD Thesis. Cambridge, MA: Massachusetts Institute of Technology.
71.
Van LoanC (1978) Computing integrals involving the matrix exponential. IEEE Transactions on Automatic Control23(3): 395–404.
72.
VillaJMcmahonJHockmanB, et al. (2022) Autonomous navigation and dense shape reconstruction using stereophotogrammetry at small celestial bodies. In: 44th Annual AAS Guidance, Navigation, and Control Conference. Breckenridge, Colorado, February 2022: AIAA.
73.
WangYChirikjianGS (2008) Nonparametric second-order theory of error propagation on motion groups. The International Journal of Robotics Research27(11-12): 1258–1273.
74.
WilliamsB (2002) Technical challenges and results for navigation of NEAR Shoemaker. Johns Hopkins APL Techincal Digest23(1): 34–45.
75.
WilliamsRLLawrenceDA (2007) Linear State-Space Control Systems. Hoboken, NJ: John Wiley & Sons.
76.
XieMEscontrelaADellaertF (2020) A Factor-Graph Approach for Optimization Problems with Dynamics Constraints. arXiv preprint arXiv:2011.06194.
77.
YanXIndelmanVBootsB (2017) Incremental sparse GP regression for continuous-time trajectory estimation and mapping. Robotics and Autonomous Systems87: 120–132.
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
