Traffic Mosaic: Traffic Data Imputation Method Inspired by Image Super Resolution

Abstract

Missing data is a major problem in data-driven intelligent transportation systems. This study presents an imputation method, called TrafficMosaic, for effective imputation of lost traffic flow data. If we consider traffic data as a image, then the missing data in it can be regarded as a mosaic. The design of TrafficMosaic is inspired by super resolution techniques. First, a deep neural network (DNN) is employed to recover the lost data by a suite of techniques inspired from image super resolution. This DNN method combines the temporal relevance of historical flow with spatial correlation of current fragmented flow data, and uses the imputation result as input for recursive calculation. Second, a data-driven road network matrixing algorithm is proposed to mine location relations from trajectory data and reconstruct a road network flow into matrixes of road network flow pictures. Convolutional local calculation in a convolutional neural network is introduced to extract local spatial features of the road network, thereby reducing the computational complexity and improving the generalization ability. The final step is to extract the local temporal features of the flow data. Traffic flows at adjacent moments have strong temporal characteristics, and we splice several historical road network traffic pictures in chronological order so that our model can capture temporal information from the sequence. The experimental evaluation used a real automatic number plate recognition dataset for experiments, and the results show the effectiveness of TrafficMosaic for lost data imputation.

Keywords

data and data science artificial intelligence and advanced computing applications deep learning statistical methods analysis

Get full access to this article

View all access options for this article.

References

Duan

Kang

Wang

F.-Y.

Traffic Flow Prediction With Big Data: A Deep Learning Approach. IEEE Transactions on Intelligent Transportation Systems, Vol. 16, No. 2, 2015, pp. 865–873.

Chen

Wang

Zhang

The Retrieval of Intra-Day Trend and its Influence on Traffic Prediction. Transportation Research Part C: Emerging Technologies, Vol. 22, No. 5, 2012, pp. 103–118.

Wang

Qin

Tan

Estimation of Missing Values in Heterogeneous Traffic Data: Application of Multimodal Deep Learning Model. Knowledge-Based Systems, Vol. 194, 2020, p. 105592.

Boto-Giralda

Díaz-Pernas

F. J.

González-Ortega

Díez-Higuera

J. F.

Antón-Rodríguez

Martínez-Zarzuela

Torre-Díez

Wavelet-Based Denoising for Traffic Volume Time Series Forecasting With Self-Organizing Neural Networks. Computer-Aided Civil and Infrastructure Engineering, Vol. 25, No. 7, 2010, pp. 530–545.

Zhijie

Methods of Real-Time Data Screening and Reconstruction for Dynamic Traffic Abnormal Data. Proc., 6th International Conference on Intelligent Systems Design and Engineering Applications (ISDEA), Guiyang, China, IEEE, New York, 2015, pp. 500–503.

Chen

Sun

A Bayesian Tensor Decomposition Approach for Spatiotemporal Traffic Data Imputation. Transportation Research Part C: Emerging Technologies, Vol. 98, 2019, pp. 73–84.

Efficient Missing Data Imputing for Traffic Flow by Considering Temporal and Spatial Dependence. Transportation Research Part C: Emerging Technologies, Vol. 34, No. 9, 2013, pp. 108–120.

Yang

Zhang

Tian

Wang

Xue

J.-H.

Liao

Deep Learning for Single Image Super-Resolution: A Brief Review. IEEE Transactions on Multimedia, Vol. 21, No. 12, 2019, pp. 3106–3121.

Arif

Wang

Bhuiyan

M. Z. A.

Wang

Chen

A Survey on Security Attacks in VANETs: Communication, Applications and Challenges. Vehicular Communications, Vol. 19, 2019, p. 100179.

10.

Zhang

Qian

Wang

Yin

A Low Rank Dynamic Mode Decomposition Model for Short-Term Traffic Flow Prediction. IEEE Transactions on Intelligent Transportation Systems, Vol. 22, No. 10, 2020, pp. 6547–6560. https://doi.org/10.1109/TITS.2020.2994910.

11.

Guo

Lin

Chen

Wan

Deep Spatial–Temporal 3D Convolutional Neural Networks for Traffic Data Forecasting. IEEE Transactions on Intelligent Transportation Systems, Vol. 20, No. 10, 2019, pp. 3913–3926.

12.

Al-Mallah

Quintero

Farooq

Prediction of Traffic Flow via Connected Vehicles. IEEE Transactions on Mobile Computing, Vol. 21, No. 1, 2020, pp. 264–277. https://doi.org/10.1109/TMC.2020.3006713.

13.

Zheng

Fan

Wang

Gman: A Graph Multi-Attention Network for Traffic Prediction. Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 34, 2020, pp. 1234–1241.

14.

Peng

Wang

Bhuiyan

M. Z. A.

Liu

Wang

, et al. Spatial Temporal Incidence Dynamic Graph Neural Networks for Traffic Flow Forecasting. Information Sciences, Vol. 521, 2020, pp. 277–290.

15.

Roll

Daily Traffic Count Imputation for Bicycle and Pedestrian Traffic: Comparing Existing Methods With Machine Learning Approaches. Transportation Research Record: Journal of the Transportation Research Board, 2021. 2675: 1428–1440.

16.

Peng

Wang

Bhuiyan

M. Z. A.

Wang

Gong

Liu

Deep Irregular Convolutional Residual LSTM for Urban Traffic Passenger Flows Prediction. IEEE Transactions on Intelligent Transportation Systems, Vol. 21, No. 3, 2019, pp. 972–985.

17.

Bogaerts

Masegosa

A. D.

Angarita-Zapata

J. S.

Onieva

Hellinckx

A Graph CNN-LSTM Neural Network for Short and Long-Term Traffic Forecasting Based on Trajectory Data. Transportation Research Part C: Emerging Technologies, Vol. 112, 2020, pp. 62–77.

18.

Wang

Cao

Deep Learning for Spatio-Temporal Data Mining: A Survey. IEEE Transactions on Knowledge and Data Engineering, Vol. 34, No. 8, 2020, pp. 3681–3700. https://doi.org/10.1109/TKDE.2020.3025580.

19.

Wei

Peng

Xuan

Guo

GE-GAN: A Novel Deep Learning Framework for Road Traffic State Estimation. Transportation Research Part C: Emerging Technologies, Vol. 117, 2020, p. 102635.

20.

Lee

Jeon

Sohn

Predicting Short-Term Traffic Speed Using a Deep Neural Network to Accommodate Citywide Spatio-Temporal Correlations. IEEE Transactions on Intelligent Transportation Systems, Vol. 22, No. 3, 2020, pp. 1435–1448. https://doi.org/10.1109/TITS.2020.2970754.

21.

Henrickson

Zou

Wang

Flexible and Robust Method for Missing Loop Detector Data Imputation. Transportation Research Record: Journal of the Transportation Research Board, 2015. 2527: 29–36.

22.

Leonard

J. D.

Markov Chain Monte Carlo Multiple Imputation Using Bayesian Networks for Incomplete Intelligent Transportation Systems Data. Transportation Research Record: Journal of the Transportation Research Board, 2005. 1935: 57–67.

23.

Zhang

PPCA-Based Missing Data Imputation for Traffic Flow Volume: A Systematical Approach. IEEE Transactions on Intelligent Transportation Systems, Vol. 10, No. 3, 2009, pp. 512–522.

24.

Hofleitner

Herring

Abbeel

Bayen

Learning the Dynamics of Arterial Traffic From Probe Data Using a Dynamic Bayesian Network. IEEE Transactions on Intelligent Transportation Systems, Vol. 13, No. 4, 2012, pp. 1679–1693.

25.

Deb

Liew

A. W.-C.

Missing Value Imputation for the Analysis of Incomplete Traffic Accident Data. Information Sciences, Vol. 339, 2016, pp. 274–289.

26.

Stekhoven

D. J.

Bühlmann

MissForest Non-Parametric Missing Value Imputation for Mixed-Type Data. Bioinformatics, Vol. 28, No. 1, 2012, pp. 112–118.

27.

Gandy

Recht

Yamada

Tensor Completion and Low-n-Rank Tensor Recovery via Convex Optimization. Inverse Problems, Vol. 27, No. 2, 2011, p. 25010.

28.

Zhang

Chen

Zheng

Zhu

Wang

Liu

H. X.

Missing Data Detection and Imputation for Urban ANPR System Using an Iterative Tensor Decomposition Approach. Transportation Research Part C: Emerging Technologies, Vol. 107, 2019, pp. 337–355.

29.

H.-F.

Rao

Dhillon

I. S.

Temporal Regularized Matrix Factorization for High-Dimensional Time Series Prediction. Advances in Neural Information Processing Systems, Vol. 29, 2016, pp. 847–855.

30.

Liu

Musialski

Wonka

Tensor Completion for Estimating Missing Values in Visual Data. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 35, No. 1, 2012, pp. 208–220.

31.

Tan

Feng

Wang

Zhang

Y.-J.

Traffic Volume Data Outlier Recovery via Tensor Model. Mathematical Problems in Engineering, Vol. 2013, 2013, pp. 87–118. https://doi.org/10.1155/2013/164810.

32.

Ran

Tan

Jin

P. J.

Tensor Based Missing Traffic Data Completion With Spatial–Temporal Correlation. Physica A: Statistical Mechanics and its Applications, Vol. 446, No. 8, 2016, pp. 54–63.

33.

W. C.

Jagadeesh

G. R.

Prakash

Srikanthan

A Clustering-Based Approach for Data-Driven Imputation of Missing Traffic Data. Proc., IEEE Forum on Integrated and Sustainable Transportation Systems (FISTS), Beijing, China, IEEE, New York, 2016, pp. 1–6.

34.

Chen

Wang

Missing Traffic Data Imputation and Pattern Discovery With a Bayesian Augmented Tensor Factorization Model. Transportation Research Part C: Emerging Technologies, Vol. 104, 2019, pp. 66–77.

35.

Ghosh

Asif

M. T.

Wynter

Denoising Autoencoders for Fast Real-Time Traffic Estimation on Urban Road Networks. Proc., IEEE 56th Annual Conference on Decision and Control (CDC), Melbourne, VIC, Australia, IEEE, New York, 2017, pp. 6307–6312.

36.

Huang

Song

Hong

Xie

Deep Architecture for Traffic Flow Prediction: Deep Belief Networks With Multitask Learning. IEEE Transactions on Intelligent Transportation Systems, Vol. 15, No. 5, 2014, pp. 2191–2201.

37.

Gong

Yang

Horng

S. J.

Traffic Flow Forecasting Based on Hybrid Deep Learning Framework. Proc., 12th International Conference on Intelligent Systems and Knowledge Engineering (ISKE), Nanjing, China, IEEE, New York, 2017, pp. 1–6.

38.

Luo

Dong

Wang

Short-Term Traffic Flow Prediction Based on CNN-SVR Hybrid Deep Learning Model. Journal of Transportation Systems Engineering and Information Technology, Vol. 17, No. 5, 2017, pp. 68–74.

39.

Xiao

Huang

Diffusion Pixelation: A Game Diffusion Model of Rumor & Anti-Rumor Inspired by Image Restoration. IEEE Transactions on Knowledge and Data Engineering, 2022. https://doi.org/10.1109/TKDE.2022.3144310.

40.

Liu

A Data Grouping CNN Algorithm for Short-Term Traffic Flow Forecasting. Proc., Asia-Pacific Web Conference, Springer, Cham, 2016, pp. 92–103.

41.

Dai

Wang

Learning Traffic as Images: A Deep Convolutional Neural Network for Large-Scale Transportation Network Speed Prediction. Sensors, Vol. 17, No. 4, 2017, p. 818.

42.

Rubin

D. B.

Inference and Missing Data. Biometrika, Vol. 63, No. 3, 1976, pp. 581–592.

43.

Liu

Xiao

Wang

Discovery of Critical Nodes in Road Networks Through Mining From Vehicle Trajectories. IEEE Transactions on Intelligent Transportation Systems, Vol. 20, No. 2, 2019, pp. 583–593.

44.

Van der Maaten

Hinton

Visualizing Data Using t-SNE. Journal of Machine Learning Research, Vol. 9, No. 2605, 2008, pp. 2579–2605.

45.

Fan

Liu

Guo

Wang

Qiu

Anomalous State Recognition of Lane-Changing Behavior Using a Hybrid Autoencoder Architecture. Proc., IEEE 23rd International Conference on Intelligent Transportation Systems (ITSC), Rhodes, Greece, IEEE, New York, 2020, pp. 1–6.

46.

Bengio

Ducharme

Vincent

Jauvin

A Neural Probabilistic Language Model. Journal of Machine Learning Research, Vol. 3, 2013, pp. 1137–1155.

47.

Mikolov

Chen

Corrado

Dean

Efficient Estimation of Word Representations in Vector Space. arXiv Preprint arXiv:1301.3781, 2013.

48.

Boquet

Morell

Serrano

Vicario

J. L.

A Variational Autoencoder Solution for Road Traffic Forecasting Systems: Missing Data Imputation, Dimension Reduction, Model Selection and Anomaly Detection. Transportation Research Part C: Emerging Technologies, Vol. 115, 2020, p. 102622.