In this paper, we extend the discriminant correlation filter (DCF) based deep learning tracker to multi-object tracking. For each object, we use an individual tracker to estimate the position. Two different pre-trained networks are used as feature extractors, respectively. The response peak and oscillation are both considered to validate the tracking. When the object is lost, the discriminative appearance model achieved by DCF is considered as a part of the feature representation between the object and detection for data association. In order to validate our method, we analyze and test our approach on the MOT2D2015 and MOT17 benchmarks for multiple pedestrian tracking. The results show that our approach performs superiorly against several recent state-of-the-art online multi-object trackers.
WuSZhangGZhuMJiangTNeriF. Geometry based three-dimensional image processing method for electronic cluster eye. Integrated Computer-Aided Engineering.2018 Jan; 25(3): 213-228.
2.
KoziarskiMCyganekB. Image recognition with deep neural networks in presence of noise – Dealing with and taking advantage of distortions. Integrated Computer-Aided Engineering.2017 Jan; 24(4): 337-349.
3.
WangPBaiX. Regional parallel structure based CNN for thermal infrared face identification. Integrated Computer-Aided Engineering.2018 Jan; 25(3): 247-260.
4.
Molina-CabelloMALuque-BaenaRMLópez-RubioEThurnhofer-HemsiK. Vehicle type detection by ensembles of convolutional neural networks operating on super resolved images. Integrated Computer-Aided Engineering.2018 Jan; 25(4): 321-333.
5.
TorresJFGaliciaATroncosoAMartínez-álvarezF. A scalable approach based on deep learning for big data time series forecasting. Integrated Computer-Aided Engineering.2018 Jan; 25(4): 335-348.
6.
NabianMAMeidaniH. Deep learning for accelerated seismic reliability analysis of transportation networks. Computer-Aided Civil and Infrastructure Engineering.2018 Jun; 33(6): 443-458.
7.
RafieiMHAdeliH. A novel machine learning-based algorithm to detect damage in high-rise building structures. The Structural Design of Tall and Special Buildings.2017 Dec; 26(18): e1400.
8.
RafieiMHAdeliH. A novel unsupervised deep learning model for global and local health condition assessment of structures. Engineering Structures.2018 Feb; 156: 598-607.
9.
XueYLiY. A fast detection method via region – based fully convolutional neural networks for shield tunnel lining defects. Computer-Aided Civil and Infrastructure Engineering.2018 Aug; 33(8): 638-654.
10.
GaoYMosalamKM. Deep Transfer Learning for Image – Based Structural Damage Recognition Computer-Aided Civil and Infrastructure Engineering. 2018 Sep; 33(9): 748-768.
11.
ZhangAWangKCPFeiYLiuYChenCYangG, et al. Automated Pixel – Level Pavement Crack Detection on 3D Asphalt Surfaces with a Recurrent Neural Network. Computer-Aided Civil and Infrastructure Engineering.2017; 32(10): 805-819.
12.
Ortega-ZamoranoFJerezJMGómezIFrancoL. Layer multiplexing FPGA implementation for deep back-propagation learning. Integrated Computer-Aided Engineering.2017 Jan; 24(2): 171-185.
13.
WuTBîlbîeFDPăunAPanLNeriF. Simplified and yet Turing universal spiking neural P systems with communication on request. International Journal of Neural Systems.2018; p. 1850013.
14.
PanLPăunGZhangGNeriF. Spiking neural P systems with communication on request. International Journal of Neural Systems.2017; 27(8): 1750042.
15.
ZhangGRongHNeriFPérez-JiménezMJ. An optimization spiking neural P system for approximately solving combinatorial optimization problems. International Journal of Neural Systems.2014; 24(5): 1440006.
16.
SimonyanKZissermanA. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv: 14091556; 2014.
Leal-TaixéLMilanAReidIRothSSchindlerK. MOTChallenge 2015: Towards a benchmark for multi-target tracking. arXiv preprint arXiv: 150401942; 2015.
19.
MilanALeal-TaixeLReidIRothSSchindlerK. MOT16: A Benchmark for Multi-Object Tracking. 2016.
20.
BolmeDSBeveridgeJRDraperBALuiYM. Visual object tracking using adaptive correlation filters. In: Computer Vision and Pattern Recognition (CVPR), 2010; IEEE Conference on. IEEE; 2010. p. 2544-2550.
21.
HenriquesJFCaseiroRMartinsPBatistaJ. Exploiting the circulant structure of tracking-by-detection with kernels. In: European conference on computer vision. Springer; 2012; p. 702-715.
22.
HenriquesJFCaseiroRMartinsPBatistaJ. High-speed tracking with kernelized correlation filters. IEEE Transactions on Pattern Analysis and Machine Intelligence.2015; 37(3): 583-596.
23.
GaloogahiHKSimTLuceyS. Correlation filters with limited boundaries. In: Computer Vision and Pattern Recognition (CVPR), 2015; IEEE Conference on. IEEE; 2015. p. 4630-4638.
24.
DanelljanMHagerGShahbaz KhanFFelsbergM. Learning spatially regularized correlation filters for visual tracking. In: Proceedings of the IEEE International Conference on Computer Vision; 2015; p. 4310-4318.
25.
MaCHuangJBYangXYangMH. Hierarchical convolutional features for visual tracking. In: Proceedings of the IEEE International Conference on Computer Vision; 2015; p. 3074-3082.
26.
QiYZhangSQinLYaoHHuangQLimJ, et al. Hedged deep tracking, In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition; 2016. p. 4303-4311.
27.
YangTCappelleCRuichekYEl BagdouriM. Visual Tracking Using Multi-layer CNN Features Based Discriminant Correlation Filters with Foreground Mask. In: MansouriAEl MoatazANouboudFMammassD, editors. Image and Signal Processing Lecture Notes in Computer Science Springer International Publishing, 2018; p. 339-347.
WangXTüretkenEFleuretFFuaP. Tracking interacting objects using intertwined flows. IEEE Transactions on Pattern Analysis and Machine Intelligence.2016; 38(11): 2312-2326.
30.
TangSAndrilukaMAndresBSchieleB. Multiple People Tracking by Lifted Multicut and Person Re-identification. In: Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR); 2017; p. 3701-3710.
31.
KuhnHW. The hungarian method for the assignment problem. In: 50 Years of Integer Programming 1958–2008. Springer; 2010. p. 29-47.
32.
LanLTaoDGongCGuanNLuoZ. Online Multi-Object Tracking by Quadratic Pseudo-Boolean Optimization. In: IJCAI; 2016; p. 3396-3402.
33.
XiangYAlahiASavareseS. Learning to track: Online multi-object tracking by decision making. In: Proceedings of the IEEE International Conference on Computer Vision; 2015; p. 4705-4713.
34.
YangTCappelleCRuichekYEl BagdouriM. Online multi-object tracking combining optical flow and compressive tracking in markov decision process. Journal of Visual Communication and Image Representation,2018.
35.
YangYBilodeauGA. Multiple Object Tracking with Kernelized Correlation Filters in Urban Mixed Traffic. 2016.
36.
RenSHeKGirshickRSunJ. Faster R-CNN: towards real-time object detection with region proposal networks. IEEE Transactions on Pattern Analysis and Machine Intelligence.2017; 39(6): 1137-1149.
37.
WangMLiuYHuangZ. Large margin object tracking with circulant feature maps. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA; 2017; p. 21-26.
38.
KalalZMikolajczykKMatasJ. Tracking-learning-detection. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2012; 34(7): 1409-1422.
39.
BernardinKElbsAStiefelhagenR. Multiple object tracking performance metrics and evaluation in sa smart room environment performance metrics for multiple object tracking. In: EURASIP. vol. 2; 2008. p. 6.
40.
WuYLimJYangMH. Online object tracking: A benchmark. In: Proceedings of the IEEE conference on computer vision and pattern recognition;2013; p. 2411-2418.
41.
WuYLimJYangM. Object Tracking Benchmark. IEEE Transactions on Pattern Analysis and Machine Intelligence.2015 Sep; 37(9): 1834-1848.
42.
BreitensteinMDReichlinFLeibeBKoller-MeierEVan GoolL. Robust tracking-by-detection using a detector confidence particle filter. In: Computer Vision, 2009 IEEE 12th International Conference on. IEEE; 2009. p. 1515-1522.
43.
YoonJHYangMHLimJYoonKJ. Bayesian multi-object tracking using motion context from multiple objects. In: Applications of Computer Vision (WACV), 2015 IEEE Winter Conference on. IEEE; 2015. p. 33-40.
44.
Sanchez-MatillaRPoiesiFCavallaroA. Online multi-target tracking with strong and weak detections. In: European Conference on Computer Vision. Springer; 2016; p. s84-99.
45.
KieritzHBeckerSHübnerWArensM. Online multi-person tracking using Integral Channel Features. In: Advanced Video and Signal Based Surveillance (AVSS), 2016 13th IEEE International Conference on. IEEE; 2016. p. 122-130.
46.
Hong YoonJLeeCRYangMHYoonKJ. Online multi-object tracking via structural constraint event aggregation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition;2016; p. 1392-1400.
47.
GirshickRBFelzenszwalbPFMcAllesterD. Discriminatively trained deformable part models, release 5. 2012.
48.
ChenJShengHZhangYXiongZ. Enhancing Detection Model for Multiple Hypothesis Tracking. In: Proc. IEEE Conf. Computer Vision and Pattern Recognition Workshops (CVPRW);2017; p. 2143-2152.
49.
KimCLiFCiptadiARehgJM. Multiple Hypothesis Tracking Revisited. In: Proc. IEEE Int. Conf. Computer Vision (ICCV);2015; p. 4696-4704.
50.
KeuperMTangSZhongjieYAndresBBroxTSchieleB. A multi-cut formulation for joint segmentation and tracking of multiple objects. arXiv preprint arXiv: 160706317; 2016.
51.
HenschelRCremersLLTDRosenhahnB. Fusion of Head and Full-Body Detectors for Multi-Object Tracking. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops;2018; p. 1428-1437.
52.
EiseleinVArpDPätzoldMSikoraT. Real-Time Multi-human Tracking Using a Probability Hypothesis Density Filter and Multiple Detectors. In: Proc. IEEE Ninth Int. Conf. Advanced Video and Signal-Based Surveillance;2012; p. 325-330.
53.
KutschbachTBochinskiEEiseleinVSikoraT. Sequential sensor fusion combining probability hypothesis density and kernelized correlation filters for multi-object tracking in video data. In: Proc. 14th IEEE Int. Conf. Advanced Video and Signal Based Surveillance (AVSS); 2017. p. 1-5.
