Modern militaries rely upon remote image sensors for real-time intelligence. A typical remote system consists of an unmanned aerial vehicle, or UAV, with an attached camera. A video stream is sent from the UAV, through a bandwidth-constrained satellite connection, to an intelligence processing unit. In this research, an upgrade to this remote-video-stream method of collection is proposed. A set of synthetic images of a scene captured by an UAV in a virtual environment is sent to a pipeline of computer vision algorithms, collectively known as Structure from Motion. The output of Structure from Motion, a three-dimensional (3D) model, is then assessed in a 3D virtual world as a possible replacement for the images from which it was created. This study shows Structure from Motion results from a modifiable spiral flight path and compares the geoaccuracy of each result. A flattening of height is observed, and an automated compensation for this flattening is proposed and performed. Each reconstruction is also compressed, and the size of the compression is compared with the compressed size of the images from which it was created. A reduction of 49–60% of required space, or bandwidth, is shown. A corresponding video demonstrating this technique is available online.
NexFRemondinoF.UAV for 3D mapping applications: a review. Appl Geomat2013; 6: 1–15.
2.
TurnerDLucieerAWatsonC.An automated technique for generating georectified mosaics from ultra-high resolution Unmanned Aerial Vehicle (UAV) imagery, based on Structure from Motion (SFM) point clouds. Remote Sens2012; 4: 1392–1410.
3.
FonstadMADietrichJTCourvilleBC, et al. Topographic Structure from Motion: a new development in photogrammetric measurement. Earth Surf Proc Landform2013; 38: 421–430.
4.
JavernickLBrasingtonJCarusoB.Modeling the topography of shallow braided rivers using Structure-from-Motion photogrammetry. Geomorphology2014; 213: 166–182.
5.
WestobyMJBrasingtonJGlasserNF, et al. ‘Structure from-Motion’ photogrammetry: a low-cost, effective tool for geoscience applications. Geomorphology2012; 179: 300–314.
6.
KoutsoudisAVidmarBIoannakisG, et al. Multi-image 3D reconstruction data evaluation. J Cultur Heritage2014; 15: 73–79.
7.
KimHGuillemautJYTakaiT, et al. Outdoor dynamic 3D scene reconstruction. IEEE Trans Circ Syst Video Technol2012; 22: 1611–1622.
8.
NilosekDWalvoordDJSalvaggioC.Assessing geoaccuracy of structure from motion point clouds from long-range image collections. Opt Eng2014; 53: 113112.
9.
AlixD.Error characterization of flight trajectories reconstructed using structure from motion. Master’s Thesis, Air Force Institute of Technology, USA, 2015.
10.
EkholmJ.3-D scene reconstruction from aerial imagery. Master’s Thesis, Air Force Institute of Technology, USA, 2012.
11.
ColsonK.Toward automated aerial refueling: relative navigation with structure from motion. Master’s Thesis, Air Force Institute of Technology, USA, 2016.
12.
ParsonsCNyklS. Real-Time Automated Aerial Refueling Using Stereo Vision. In: Proceedings of Advances in Visual Computing: 12th International Symposium, ISVC 2016, Part II, Lecture Notes in Computer Science, Vol. 10073, December 2016, pp. 605–615. Berlin: Springer.
13.
NießnerMZollhöferMIzadiS, et al. Real-time 3D reconstruction at scale using voxel hashing. ACM Trans Graph2013; 32: 169:1–169:11.
WuC. Towards Linear-Time Incremental Structure from Motion. In: 2013 International Conference on 3D Vision - 3DV, 29 June–1 July 2013. Seattle, WA: IEEE.
16.
WuCAgarwalSCurlessB, et al. Multicore bundle adjustment. In: IEEE conference on computer vision and pattern recognition (CVPR), Providence, RI, 20–25 June 2011, 1, pp.3057–3064. Piscataway, NJ: IEEE.
17.
FurukawaYPonceJ.Accurate, dense, and robust multiview stereopsis. IEEE Trans Pattern Anal Mach Intell2010; 32: 1362–1376.
18.
SnavelyNSeitzSSzeliskiR.Photo tourism: exploring photo collections in 3D. In: SIGGRAPH conference proceedings, Boston, MA, 30 July–3 August 2006, pp.835–846.
19.
SnavelyNSeitzSMSzeliskiR.Modeling the world from Internet photo collections. Int J Comput Vis2008; 80: 189–210.
20.
FuhrmannSLangguthFGoeseleM.MVE-a multi-view reconstruction environment. In: Eurographics Workshops on Graphics and Cultural Heritage, Darmstadt, 6–8 October 2014, pp.11–18. Geneve: Eurographics Association.
21.
WaechterMMoehrleNGoeseleM. Let there be color! large-scale texturing of 3d reconstructions. In: European conference on computer vision, Zurich, 6–12 September 2014, pp.836–850. Berlin: Springer.
22.
KazhdanMHoppeH.Screened Poisson surface reconstruction. ACM Trans Graph2013; 32: 1–13.
23.
CignoniPCallieriMCorsiniM, et al. Meshlab: an open-source mesh processing tool. In: eurographics Italian chapter conference, vol. 2008, Selerno, pp.129–136.
24.
MoulonPMonassePPerrotR, et al. Openmvg: open multiple view geometry. In: international workshop on reproducible research in pattern recognition, Cancun, 4 December 2016, pp.60–74. Berlin: Springer.
25.
SweeneyCHöllererTTurkM.Theia: a fast and scalable structure-from-motion library. In: proceedings of the 2015 ACM multimedia conference (MM 2015), Brisbane, 26–30 October 2015, pp.693–696. New York: ACM.
26.
SchönbergerJLFrahmJM. Structure-from-motion revisited. In: proceedings of the IEEE conference on computer vision and pattern recognition, Las Vegas, NV, 26 June–1 July 2016, pp.4104–4113.
27.
SchönbergerJLZhengEFrahmJM, et al. Pixelwise view selection for unstructured multi-view stereo. In: European conference on computer vision, Amsterdam, 8–16 October 2016, pp.501–518. Berlin: Springer.
28.
BradskiG.The opencv library. Dr Dobb J2000; 25: 120–123.
29.
RoeberJNyklSGrahamS. Structure from Motion (SfM) for reconnaissance augmentation and bandwidth usage reduction, https://www.youtube.com/watch?v=ZUltZoaAODA. (accessed 29 October 2018).
30.
NyklSMourningCLeitchMChelbergDFranklinTLiuC. An overview of the STEAMiE Educational game Engine. In: 2008 38th Annual Frontiers in Education Conference, Saratoga Springs, NY, 2008, pp. F3B-21-F3B-25.
31.
AlliezPCohen-SteinerDTongY, et al. Voronoi-based variational reconstruction of unoriented point sets. In: proceedings of the fifth eurographics symposium on geometry processing, Barcelona, 4–6 July, 2007, pp. 39–48. Aire-la-Ville Eurographics Assoc.
32.
MansonJPetrovaGSchaeferS.Streaming surface reconstruction using wavelets. Comput Graph Forum2008; 27: 1411–1420.
