Detecting School Zones on Florida’s Public Roadways Using Aerial Images and Artificial Intelligence (AI2)

Abstract

Collecting up-to-date roadway geometry data is essential for transportation agencies so they can undertake planning, maintenance, design, and rehabilitation of roadways. Collection methods can be categorized into two distinct groups: land-based methods (e.g., field inventories, mobile mapping, and image logging); and aerial-based methods (e.g., satellite imagery, drones, and laser scanning). Because using land-based methods for thousands of miles of highways is tedious, costly, and risky for crew members, there is a need to develop better methodologies to collect these data faster, and more safely and cheaply. The increasing availability of high-resolution images and recent advances in computer vision and object detection techniques have enabled the automated extraction of roadway geometry features. This novel study proposes a computer vision-based methodology to detect school zone pavement markings from high-resolution aerial images and determine school zones on Florida’s public roadways. This is critical information for transportation agencies, and they use it for a variety of different purposes: identifying those markings that are old and invisible; comparing the school zone locations with other geometric features such as crosswalks; and analyzing crashes that occur around the zones. Compared with the ground truth data obtained for Leon County, Florida, 94% accuracy was observed at the 90% confidence level. The model was then used to detect school zones in Orange County, Florida, and approximately 500 school zone markings were identified automatically. The road geometry data extracted can be integrated with crash and traffic data to advise policymakers and roadway users.

Keywords

data and data science deep learning machine learning (artificial intelligence)geographic information systems computer vision

Get full access to this article

View all access options for this article.

References

Jalayer

Zhou

Turochy

R. E.

Evaluation of Geo-Tagged Photo and Video Logging Methods to Collect Geospatial Highway Inventory Data. Papers in Applied Geography, Vol. 1, No. 1, 2015, pp. 50–58. https://doi.org/10.1080/23754931.2015.1009301.

Jalayer

Zhou

Gong

Grinter

A Comprehensive Assessment of Highway Inventory Data Collection Methods for Implementing Highway Safety Manual. Journal of the Transportation Research Forum, Vol. 53, No. 2, 2014, pp. 73–92.

Shamayleh

Khattak

Utilization of LiDAR Technology for Highway Inventory. Proc., 2003 Mid-Continent Transportation Research Symposium, Ames, Iowa, 2003.

Gong

Zhou

Gordon

Jalayer

Mobile Terrestrial Laser Scanning for Highway Inventory Data Collection. Proc., 2012 ASCE International Conference on Computing in Civil Engineering, Computing in Civil Engineering, Clearwater Beach, FL, 2012, pp. 545–552. https://doi.org/10.1061/9780784412343.0069

Zhou

Jalayer

Gong

Grinter

Investigation of Methods and Approaches for Collecting and Recording Highway Inventory Data. FHWA-ICT-13-022. University of Illinois, Urbana-Champaign, IL, 2013.

Cambridge Systematics. Study of School Zones with Traffic Signals. Final Report. Florida Department of Transportation, Tallahassee, FL, 2009.

Florida Department of Transportation. Statewide School Crossing Assessment. In Support of H.B. 493: Enhanced Safety for School Crossings. FDOT, State Traffic Engineering and Operations Office, Tallahassee, FL, 2017.

Miotto

A. A

Better Image. Civil Engineering, Vol. 70, No. 1, 2000, pp. 42–45.

Campbell

Both

Sun

Detecting and Mapping Traffic Signs from Google Street View Images Using Deep Learning and GIS. Computers, Environment and Urban Systems, Vol. 77, 2019, article 101350. https://doi.org/10.1016/j.compenvurbsys.2019.101350.

10.

Habibi Aghdam

Jahani Heravi

Puig

A Practical Approach for Detection and Classification of Traffic Signs Using Convolutional Neural Networks. Robotics and Autonomous Systems, Vol. 84, 2016, pp. 97–112. https://doi.org/10.1016/j.robot.2016.07.003.

11.

Mei

Prokhorov

Tao

Deep Neural Network for Structural Prediction and Lane Detection in Traffic Scene. IEEE Transactions on Neural Networks and Learning Systems, Vol. 28, No. 3, 2017, pp. 690–703. https://doi.org/10.1109/TNNLS.2016.2522428.

12.

Tong

Gao

Zhang

Recognition, Location, Measurement, and 3D Reconstruction of Concealed Cracks Using Convolutional Neural Networks. Construction and Building Materials, Vol. 146, 2017, pp. 775–787. https://doi.org/10.1016/j.conbuildmat.2017.04.097.

13.

Panboonyuen

Jitkajornwanich

Lawawirojwong

Srestasathiern

Vateekul

Road Segmentation of Remotely-Sensed Images Using Deep Convolutional Neural Networks with Landscape Metrics and Conditional Random Fields. Remote Sensing, Vol. 9, No. 7, 2017, p. 680. https://doi.org/10.3390/rs9070680.

14.

Balali

Ashouri Rad

Golparvar-Fard

Detection, Classification, and Mapping of U.S. Traffic Signs Using Google Street View Images for Roadway Inventory Management. Visualization in Engineering, Vol. 3, No. 1, 2015, pp. 1–18. https://doi.org/10.1186/s40327-015-0027-1.

15.

Uçar

Demir

Güzeliş

Object Recognition and Detection with Deep Learning for Autonomous Driving Applications. Simulation, Vol. 93, No. 9, 2017, pp. 759–769. https://doi.org/10.1177/0037549717709932.

16.

Tang

Zhou

Deng

Zou

Lei

Vehicle Detection in Aerial Images Based on Region Convolutional Neural Networks and Hard Negative Example Mining. Sensors, Vol. 17, No. 2, 2017, p. 336.

17.

Vattapparamban

Güvenç

Yurekli

A. I.

Akkaya

Uluağaç

Drones for Smart Cities: Issues in Cybersecurity, Privacy, and Public Safety. Proc., 2016 International Wireless Communications and Mobile Computing Conference (IWCMC), Paphos, Cyprus. IEEE, New York, 2016, pp. 216–221.

18.

Xie

Yang

Cao

Yang

Zhao

Chen

Liao

Shi

Real-Time Vehicle Detection from UAV Imagery. Proc., 2018 IEEE Fourth International Conference on Multimedia Big Data (BigMM), Xi’an, China. IEEE, New York, 2018, pp. 1–5.

19.

Wang

Car Detection from Low-Altitude UAV Imagery with the Faster R-CNN. Journal of Advanced Transportation, Vol. 2017, article 2823617. https://doi.org/10.1155/2017/2823617.

20.

Girshick

Donahue

Darrell

Malik

Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation. Proc., 2014 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Columbus, Ohio. IEEE, New York, pp. 580–587

21.

Girshick

Fast R-CNN. Proc., IEEE International Conference on Computer Vision (ICCV), [ICCV-2015], Santiago, Chile. IEEE, New York, pp. 1440–1448.

22.

Ren

Girshick

Sun

Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 39, No. 6, 2017, pp. 1137–1149. https://doi.org/10.1109/TPAMI.2016.2577031.

23.

Kim

E.-J.

Park

H.-C.

Ham

S.-W.

Kho

S.-Y.

Kim

D.-K.

Extracting Vehicle Trajectories Using Unmanned Aerial Vehicles in Congested Traffic Conditions. Journal of Advanced Transportation, Vol. 2019, 2019, pp. 1–16.

24.

Sainju

A. M.

Jiang

Mapping Road Safety Features from Streetview Imagery. ACM/IMS Transactions on Data Science, Vol. 1, No. 3, 2020, pp. 1–20. https://doi.org/10.1145/3362069.

25.

Yan

Liu

Tan

Xie

Chen

Scan Line-Based Road Marking Extraction from Mobile LiDAR Point Clouds. Sensors, Vol. 16, No. 6, 2016, p. 903.

26.

Azimi

S. M.

Fischer

Korner

Reinartz

Aerial LaneNet: Lane-Marking Semantic Segmentation in Aerial Imagery Using Wavelet-Enhanced Cost-Sensitive Symmetric Fully Convolutional Neural Networks. IEEE Transactions on Geoscience and Remote Sensing, Vol. 57, No. 5, 2019, pp. 2920–2938. https://doi.org/10.1109/TGRS.2018.2878510.

27.

Wang

Shou

Wang

Chen

Vision-Based Pavement Marking Detection and Condition Assessment—A Case Study. Applied Sciences, Vol. 11, No. 7, 2021, p. 3152. https://doi.org/10.3390/app11073152.

28.

United States Census Bureau. Quick Facts, Orange County, Florida: Population Estimates. https://www.census.gov/quickfacts/orangecountyflorida. Accessed July 28, 2022.

29.

Orange County Public Schools. https://www.ocps.net/. Accessed July 28, 2022.

30.

Ozguven

E. E.

Karaer

Koloushani

Moses

Dulebenets

M. A.

Sando

Feasibility Analysis of Real-Time Intersection Data Collection and Processing Using Drones. Florida Department of Transportation, Tallahassee, FL, 2021.

31.

ArcGIS Pro Help. Mosaic Datasets. https://pro.arcgis.com/en/pro-app/latest/help/data/imagery/mosaic-datasets.htm. Accessed June 25, 2023.

32.

Redmon

Farhadi

YOLOv3: An Incremental Improvement. https://arxiv.org/abs/1804.02767. Accessed June 26, 2023.

33.

Redmon

Divvala

Girshick

Farhadi

You Only Look Once: Unified, Real-Time Object Detection. Proc., IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV. IEEE, New York, 2016, pp. 779–788.

34.

Redmon

Farhadi

YOLO9000: Better, Faster, Stronger. Proc., IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI. IEEE, New York, 2017, pp. 7263–7271.

35.

Bochkovskiy

Wang

C.-Y.

Liao

H.-Y. M.

YOLOv4: Optimal Speed and Accuracy of Object Detection. https://arxiv.org/abs/2004.10934. Accessed June 25, 2023.

36.

Jocher

Nishimura

Mineeva

Vilarino

Yolov5 by Ultralytics. 2020. https://Github.Com/Ultralytics/Yolov5. Accessed July 28, 2022.

37.

Tsang

S. H.

Review: Yolov3—You Only Look Once (Object Detection). 2018. https://towardsdatascience.com/review-yolov3-you-only-look-once-object-detection-eab75d7a1ba6. Accessed June 25, 2023.

38.

Kathuria

What’s New in YOLO v3? 2018. https://towardsdatascience.com/yolo-v3-object-detection-53fb7d3bfe6b. Accessed June 25, 2023.

39.

Wiedemann

Heipke

Mayer

Jamet

Empirical Evaluation of Automatically Extracted Road Axes. Empirical Evaluation Techniques in Computer Vision, Vol. 12, 1998, pp. 172–187.

40.

Wiedemann

Ebner

Automatic Completion and Evaluation of Road Networks. https://www.isprs.org/proceedings/xxxiii/congress/part3/979_XXXIII-part3.pdf.

41.

Sun

Zhang

Roads and Intersections Extraction from High-Resolution Remote Sensing Imagery Based on Tensor Voting under Big Data Environment. Wireless Communications and Mobile Computing, Vol. 2019, article 6513418. https://doi.org/10.1155/2019/6513418.

42.

Dai

Wang

Zuo

Automatic Method for Extraction of Complex Road Intersection Points from High-Resolution Remote Sensing Images Based on Fuzzy Inference. IEEE Access, Vol. 8, 2020, pp. 39212–39224. https://doi.org/10.1109/ACCESS.2020.2974974.