Having an autonomous system to alarm for violence or suspicious incidence could greatly strengthen the security system. Such autonomous system could also be useful for other application such as patient monitoring, retail shop, and children surveillance. However, the current technology has not yet reach the level to effectively analyze the video since currently most video surveillance system could not understand the events happen in the video. Complex changes in environment caused by camera motion, dynamic scene such as crowds, changes in lighting intensity, viewing from different angles, wide variation in spatial (e.g. size of interest subject relative to video) and temporal (speed of the subjects in performing actions) make video analysis task a very challenging task. Even with these difficulties, researches in improving video analysis methods are still being actively explored. Some research approaches in violence incidence detection resembling the method used in detecting abnormal incidence. Instead of detecting whether an incidence have occurred, we attempt to build a model to detect the actions related to violence. In this paper, an online detection model is built to detect specific action related to violence actions. The model is built with reference of the image object detection (Faster-Region Convolution Neural Network, Faster-RCNN) and video action detection (Tube-Convolution Neural Network, TCNN).
TranDBourdevLFergusRTorresaniLPaluriM. Learning spatiotemporal features with 3d convolutional networks. Proceedings of The IEEE International Conference on Computer Vision2015.
2.
WangHSchmidC. Action recognition with improved trajectories. Proceedings of The IEEE International Conference on Computer Vision2013.
3.
FeichtenhoferCPinzAZissermanA. Convolutional two-stream network fusion for video action recognition. Proceedings of The IEEE Conference on Computer Vision and Pattern Recognition2016.
4.
GemertJCJainMGatiESnoekCG. APT: Action localization proposals from dense trajectories. BMVC2015.
5.
HouRChenCShahM. Tube convolutional neural network (T-CNN) for action detection in videos. IEEE International Conference on Computer Vision2017.
6.
SoomroKIdreesHShahM. Online localization and prediction of actions and interactions. IEEE Trans Pattern Anal Mach Intell2018.
7.
ChristiansenPNielsenLNSteenKAJørgensenRNKarstoftH. DeepAnomaly: Combining background subtraction and deep learning for detecting obstacles and anomalies in an agricultural field. Sensors2016; 16(11): 1904.
8.
SabokrouMFayyazMFathyMMoayedZKletteR. Deep-anomaly: Fully convolutional neural network for fast anomaly detection in crowded scenes. Comput Vis Image Und2018.
9.
MazaheriAZhangDShahM. Video fill in the blank using lr/rl lstms with spatial-temporal attentions. 2017 IEEE International Conference on Computer Vision (ICCV)2017.
10.
RenSHeKGirshickRSunJ. Faster r-cnn: Towards real-time object detection with region proposal networks. Advances in Neural Information Processing Systems2015.
LaptevIMarszalekMSchmidCRozenfeldB. Learning realistic human actions from movies. IEEE Conference on Computer Vision and Pattern Recognition2008.
13.
WangHKläserASchmidCLiuC-L. Dense trajectories and motion boundary descriptors for action recognition. International Journal of Computer Vision2013; 103(1): 60-79.
14.
WangLQiaoYTangX. Motionlets: Mid-level 3d parts for human motion recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition2013.
15.
SadanandSCorsoJJ. Action bank: A high-level representation of activity in video. IEEE Conference on Computer Vision and Pattern Recognition (CVPR)2012.
16.
LiuASuYNieWKankanhalliMS. Hierarchical clustering multi-task learning for joint human action grouping and recognition. IEEE Trans Pattern Anal Mach Intell2017; 39(1): 102-14.
17.
WangLQiaoYTangX. Action recognition with trajectory-pooled deep-convolutional descriptors. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition2015.
18.
ChengK-WChenY-TFangW-H. Video anomaly detection and localization using hierarchical feature representation and Gaussian process regression. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition2015.
19.
LeeSCNevatiaR. Hierarchical abnormal event detection by real time and semi-real time multi-tasking video surveillance system. Mach Vision Appl2014; 25(1): 133-43.
20.
TripathiVMittalAGangodkarDKanthV. Real time security framework for detecting abnormal events at ATM installations. Journal of Real-Time Image Processing2016; 1-11.
21.
NievasEBSuarezODGarcíaGBSukthankarR. Violence detection in video using computer vision techniques. International Conference on Computer Analysis of Images and Patterns2011; Springer.
22.
FernandoBGavvesEOramasJMGhodratiATuytelaarsT. Modeling video evolution for action recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition2015.
23.
SimonyanKZissermanA. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv: 14091556; 2014.
24.
WangHSchmidC, editors. Action recognition with improved trajectories. Proceedings of the IEEE International Conference on Computer Vision2013.
25.
PengXZouCQiaoYPengQ. Action recognition with stacked fisher vectors. European Conference on Computer Vision2014; Springer.
26.
ZhaoSLiuYHanYHongRHuQTianQ. Pooling the convolutional layers in deep convnets for video action recognition. IEEE Transactions on Circuits and Systems for Video Technology2018; 28(8): 1839-49.
27.
WangPLiuLShenCShenHT. Order-aware convolutional pooling for video based action recognition. arXiv preprint2016.
28.
KarpathyATodericiGShettySLeungTSukthankarRFei-FeiL. Large-scale video classification with convolutional neural networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition2014.
KrizhevskyASutskeverIHintonGE. Imagenet classification with deep convolutional neural networks. Advances in neural Information Processing Systems2012.
31.
KalogeitonVWeinzaepfelPFerrariVSchmidC. Action tubelet detector for spatio-temporal action localization. IEEE International Conference on Computer Vision (ICCV)2017.
32.
WeiS-ERamakrishnaVKanadeTSheikhY. Convolutional pose machines. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition2016.
33.
GirshickR. Fast R-CNN object detection with Caffe. Microsoft Research2015.
34.
SultaniWZhangDShahM. Unsupervised action proposal ranking through proposal recombination. Comput Vis Image Und2017; 161: 42-50.
35.
ChoMKwakSSchmidCPonceJ. Unsupervised object discovery and localization in the wild: Part-based matching with bottom-up region proposals. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition2015.
36.
ReddyKKShahM. Recognizing 50 human action categories of web videos. Mach Vision Appl2013; 24(5): 971-81.
37.
“CAVIAR Test Case Scenarios”, 2003. [Online]. Available: http://homepagesinf.ed.ac.uk/rbf/CAVIARDATA1/. [Accessed: 28-Jul-2017].
38.
KuehneHJhuangHStiefelhagenRSerreT. Hmdb51: A large video database for human motion recognition. High Performance Computing in Science and Engineering ’12: Springer; 2013. p. 571-82.
39.
SoomroKZamirARShahM. UCF101: A dataset of 101 human actions classes from videos in the wild. arXiv preprint arXiv: 12120402; 2012.
40.
Abu-El-HaijaSKothariNLeeJNatsevPTodericiGVaradarajanB, et al. Youtube-8m: A large-scale video classification benchmark. arXiv preprint2016.
41.
SjöbergMIonescuBJiangY-GQuangVLSchedlMDemartyC-H. The MediaEval 2014 Affect Task: Violent Scenes Detection. MediaEval2014.
42.
SzegedyCLiuWJiaYSermanetPReedSAnguelovD, et al. Going deeper with convolutions. Proceedings of the IEEE conference on Computer Vision and Pattern Recognition2015.
43.
GirshickR. Fast R-CNN. Proceedings of the IEEE International Conference on Computer Vision2015; 1440-1448.
44.
EveringhamMVan GoolLWilliamsCKWinnJZissermanA. The pascal visual object classes (voc) challenge. International Journal of Computer Vision2010; 88(2): 303-38.
