A cascaded method to detect aircraft in video imagery

Abstract

Unmanned Aerial Vehicles (UAVs) have played vital roles recently in both military and non-military applications. One of the reasons UAVs today are unable to routinely fly in US National Airspace (NAS) is because they lack the sense and ability to avoid other aircraft. Although certificates of authorization can be obtained for short-term use, it entails significant delays and bureaucratic hurdles. Therefore, there is a great need to develop a sensing system that is equivalent to or has greater performance than a human pilot operating under Visual Flight Rules (VFR). This is challenging because of the need to detect aircraft out to at least 3 statute miles, while doing so on field-of-regard as large as 30°( vertical) × 220°( horizontal) and within the payload constraints of a medium-sized UAV. In this paper we report on recent progress towards the development of a field deployable sense-and-avoid system and concentrate on the detection and tracking aspect of the system. We tested a number of approaches and chose a cascaded approach that resulted in 100% detection rate (over about 40 approaches) and 98% tracking rate out to 5 statute miles and a false positive rate of 1 every 50 frames. Within a range of 3.75 miles we can achieve nearly 100% tracking rate.

Keywords

Sense-and-avoid UAV field robotics perception

Get full access to this article

View all access options for this article.

References

Arnold

Pasternack

(1990) Detection and tracking of low-observable targets through dynamic programming. Proceedings of SPIE 1305: 207.

ASTM International (2004) Standard specification for design and performance of an airborne sense-and-avoid system, F2411-04. West Conshohocken, PA: ASTM International.

Bernier

Bissonnette

Poitevin

(2005) DSA radar: development report. In Proceedings of UAVSI 2005.

Carnie

Walker

Corke

(2006) Image processing algorithms for UAV ‘sense and avoid’. In Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006, pp. 2848–2853.

Cristianini

Shawe-Taylor

(2000) An Introduction to Support Vector Machines and Other Kernel-based Learning Methods. Cambridge: Cambridge University Press.

Federal Aviation Administration (2006). Special Operations Order 7610.4. Available at: http://www.faa.gov/regulations_policies/orders_notices/index.cfm/go/document.information/documentID/99640.

Fernandez

Aridgides

Bray

(1990) Detecting and tracking low-observable targets using IR. Proceedings of SPIE 1305: 193.

Gandhi

Yang

M-T

Kasturi

Camps

Coraor

McCandless

(2000) Detection of obstacles in the flight path of an aircraft. In Proceedings of CVPR. Los Alamitos, CA: IEEE Computer Society Press, pp. 2304–2311.

Geyer

Dey

Singh

(2009) Prototype Sense-and-Avoid System for UAVs. Technical Report CMU-RI-TR-09-09, Robotics Institute, Carnegie Mellon University.

10.

Kolawole

(2002) Radar Systems, Peak Detection and Tracking. Amsterdam: Elsevier.

11.

McCalmont

Utt

Deschenes

(2002) Detect and avoid technology demonstration. In Proceedings of the American Institute of Aeronautics and Astronautics Infotech.

12.

McCandless

(1999) Detection of aircraft in video sequences using a predictive optical flow algorithm. Optical Engineering 38: 523.

13.

Nayar

Narasimhan

(1999) Vision in bad weather. In The Proceedings of the Seventh IEEE International Conference on Computer Vision, 1999, Vol. 2.

14.

Office of the Secretary of Defense (2004). Airspace Integration Plan for Unmanned Aviation. Available at: http://www.dtic.mil/cgi-bin/GetTRDoc?Location=U2&doc=GetTRDoc.pdf&AD=ADA431348.

15.

Papadimitriou

Steiglitz

(1998) Combinatorial Optimization: Algorithms and Complexity. Courier Dover Publications.

16.

Petridis

Geyer

Singh

(2008) Learning to detect aircraft at low resolutions. In Gasteratos

Vincze

Tsotsos

(eds), Proceedings of ICVS (Lecture Notes in Computer Science, Vol. 5008). Berlin: Springer, pp. 474–483.

17.

Radio Technical Commission for Aeronautics (2010) Special Committee (SC) 203. Minimum Performance Standards for Unmanned Aircraft Systems. RTCA Paper No. 065-10/PMC-790, Radio Technical Commission for Aeronautics, Inc.

18.

19.

Shafique

Shah

(2005) A noniterative greedy algorithm for multiframe point correspondence. IEEE Transactions on Pattern Analysis and Machine Intelligence 27: 51–65.

20.

Utt

McCalmont

Deschenes

(2005) Development of a sense and avoid system. In AIAA Infotech at Aerospace.

21.

Yilmaz

Javed

Shah

(2006) Object tracking: a survey. ACM Computing Surveys 38: 13.

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB