This paper explores the cloud- versus server-based deployment scenarios of an enhanced computer vision platform for potential deployment on low-resolution 511 traffic video streams. An existing computer vision algorithm based on a spatial–temporal map and designed for high-angle traffic video like that of NGSIM (Next Generation SIMulation) is enhanced for roadside CCTV traffic camera angles. Because of the lower visual angle, determining the directions, splitting vehicles from occlusions, and identifying lane changes become difficult. A motion-flow-based direction determination method, a bisection occlusion detection and splitting algorithm, and a lane-change tracking method are proposed. The model evaluation is conducted by using videos from multiple cameras from the New Jersey Department of Transportation’s 511 traffic video surveillance system. The results show promising performance in both accuracy and computational efficiency for potential large-scale cloud deployment. The cost analysis reveals that at the current pricing model of cloud computing, the cloud-based deployment is more convenient and cost-effective for an on-demand network assessment. In contrast, the dedicated-server-based deployment is more economical for long-term traffic detection deployment.
Get full access to this article
View all access options for this article.
References
1.
MichalopoulosP. G.Vehicle Detection Video through Image Processing: The Autoscope System. IEEE Transactions on Vehicular Technology, Vol. 40, No. 1, 1991, pp. 21–29.
2.
SongK. T.TaiJ. C.Dynamic Calibration of Pan–Tilt–Zoom Cameras for Traffic Monitoring. IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), Vol. 36, No. 5, 2006, pp. 1091–103.
3.
BirchfieldS. T.SarasuaW. A.KanhereN. K.Computer Vision Traffic Sensor for Fixed and Pan-Tilt-Zoom Cameras. NCHRP-IDEA Program Project Final Report. Transportation Research Board, Washington, D.C., 2010.
4.
ZhangT.JinP. J.A Longitudinal Scanline Based Vehicle Trajectory Reconstruction Method for High-Angle Traffic Video. Transportation Research Part C: Emerging Technologies, Vol. 103, 2019, pp. 104–128.
5.
SobelI.FeldmanG.A 3x3 Isotropic Gradient Operator for Image Processing. A Talk at the Stanford Artificial Project, 1968, pp. 271–272.
6.
CannyJ.A Computational Approach to Edge Detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 6, 1986, pp. 679–698.
7.
BeymerD.McLauchlanP.CoifmanB.MalikJ.A Real-Time Computer Vision System for Measuring Traffic Parameters. Proc., IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Juan, PR, 1997.
8.
CoifmanB.BeymerD.McLauchlanP.MalikJ.A Real-Time Computer Vision System for Vehicle Tracking and Traffic Surveillance. Transportation Research Part C: Emerging Technologies, Vol. 6, No. 4, 1998, pp. 271–288.
9.
CucchiaraR.PiccardiM.MelloP.Image Analysis and Rule-Based Reasoning for a Traffic Monitoring System. IEEE Transactions on Intelligent Transportation Systems, Vol. 1, No. 2, 2000, pp. 119–130.
10.
ZhuZ.XuG.YangB.ShiD.LinX.VISATRAM: A Real-Time Vision System for Automatic Traffic Monitoring. Image and Vision Computing, Vol. 18, No. 10, 2000, pp. 781–794.
11.
MalinovskiyY.WuY. J.WangY.Video-Based Vehicle Detection and Tracking Using Spatiotemporal Maps. Transportation Research Record: Journal of the Transportation Research Board, 2009. 2121: 81–89.
12.
PangC. C.LamW. W.YungN. H.A Method for Vehicle Count in the Presence of Multiple-Vehicle Occlusions in Traffic Images. IEEE Transactions on Intelligent Transportation Systems, Vol. 8, No. 3, 2007, pp. 441–459.
13.
HsiehJ. W.YuS. H.ChenY. S.HuW. F.Automatic Traffic Surveillance System for Vehicle Tracking and Classification. IEEE Transactions on Intelligent Transportation Systems, Vol. 7, No. 2, 2006, pp. 175–187.
14.
ZhangG.AveryR. P.WangY.Video-Based Vehicle Detection and Classification System for Real-Time Traffic Data Collection Using Uncalibrated Video Cameras. Transportation Research Record: Journal of the Transportation Research Board, 2007. 1993: 138–147.
15.
ChengH. D.DuH.HuL.GlazierC.Vehicle Detection and Classification Using Model-Based and Fuzzy Logic Approaches. Transportation Research Record: Journal of the Transportation Research Board, 2005. 1935: 154–162.
16.
DongZ.WuY.PeiM.JiaY.Vehicle Type Classification Using a Semisupervised Convolutional Neural Network. IEEE Transactions on Intelligent Transportation Systems, Vol. 16, No. 4, 2015, pp. 2247–2256.
17.
MithunN. C.RashidN. U.RahmanS. M.Detection and Classification of Vehicles from Video Using Multiple Time-Spatial Images. IEEE Transactions on Intelligent Transportation Systems, Vol. 13, No. 3, 2012, pp. 1215–1225.
18.
ZhangB.Reliable Classification of Vehicle Types Based on Cascade Classifier Ensembles. IEEE Transactions on Intelligent Transportation Systems, Vol. 14, No. 1, 2012, pp. 322–332.
19.
BasE.TekalpA. M.SalmanF. S.Automatic Vehicle Counting from Video for Traffic Flow Analysis. Proc., 2007 IEEE Intelligent Vehicles Symposium, Istanbul, Turkey, 2007, pp. 392–397.
20.
KanhereN. K.BirchfieldS. T.Real-Time Incremental Segmentation and Tracking of Vehicles at Low Camera Angles Using Stable Features. IEEE Transactions on Intelligent Transportation Systems, Vol. 9, No. 1, 2008, pp. 148–160.
21.
KanhereN. K.BirchfieldS. T.SarasuaW. A.WhitneyT. C.Real-Time Detection and Tracking of Vehicle Base Fronts for Measuring Traffic Counts and Speeds on Highways. Transportation Research Record: Journal of the Transportation Research Board, 2007. 1993: 155–164.
22.
ChenY. L.WuB. F.HuangH. Y.FanC. J.A Real-Time Vision System for Nighttime Vehicle Detection and Traffic Surveillance. IEEE Transactions on Industrial Electronics, Vol. 58, No. 5, 2010, pp. 2030–2044.
23.
TaiJ. C.TsengS. T.LinC. P.SongK. T.Real-Time Image Tracking for Automatic Traffic Monitoring and Enforcement Applications. Image and Vision Computing, Vol. 22, No. 6, 2004, pp. 485–501.
24.
ZhaoR.WangX.Counting Vehicles from Semantic Regions. IEEE Transactions on Intelligent Transportation Systems, Vol. 14, No. 2, 2013, pp. 1016–1022.
25.
IshakS. S.CodjoeJ.MousaS.JenkinsS.BonnetteJ.Traffic Counting Using Existing Video Detection Cameras. National Center for Intermodal Transportation for Economic Competitiveness, Mississippi State University, 2016.
26.
GirshickR.DonahueJ.DarrellT.MalikJ.Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation. Proc., IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, 2014, pp. 580–587.
27.
RenS.HeK.GirshickR.FasterJ.R-CNN: Towards Real-Time Object Detection with Region Proposal Networks. In Advances in Neural Information Processing Systems2015, pp. 91–99.
28.
HeK.GkioxariG.DollárP.GirshickR.Mask R-CNN. Proc., IEEE International Conference on Computer Vision, Venice, Italy, 2017.
29.
RedmonJ.DivvalaS.GirshickR.FarhadiA.You Only Look Once: Unified, Real-Time Object Detection. Proc., IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, IEEE, 2016, pp. 779–788.
30.
TaniguchiH.NakamuraT.FurusawaH.Methods of Traffic Flow Measurement Using Spatio-Temporal Image. Proc., 1999 International Conference on Image Processing (Cat 99CH36348), Kobe, Japan, IEEE, 2003, Vol. 4, pp. 16–20.
31.
ChoY.RiceJ.Estimating Velocity Fields on a Freeway from Low-Resolution Videos. IEEE Transactions on Intelligent Transportation Systems, Vol. 7, No. 4, 2006, pp. 463–469.
32.
ArdestaniS. M.JinP. J.FeeleyC.Signal Timing Detection Based on Spatial–Temporal Map Generated from CCTV Surveillance Video. Transportation Research Record: Journal of the Transportation Research Board, 2016. 2594: 138–147.
33.
ZhangT.GuoM.JinP. J.GeY.GongJ.Longitudinal-Scanline-Based Arterial Traffic Video Analytics with Coordinate Transformation Assisted by 3D Infrastructure Data. Transportation Research Record: Journal of the Transportation Research Board, 2021. 2675: 338–357.
