Content-based indexing methods need to analyze all frames of a video. Because such a procedure is extremely time consuming the indexing may be limited to the key-frames, i.e. to only one or to a few frames for every shot or for every video scene. The detection of the key-frame of a shot or of a scene requires very effective temporal segmentation methods. Content-based indexing of videos is based on the automatic detection of a video structure. A video shot is the main structural video unit. The temporal aggregation results in grouping of shots into scenes of a given category. Moreover, the determination of the most likely category on the basis of time relations also reduces the analysis time enabling us to apply the adequate method of content-based indexing. The main problem is to select report shots and non-report shots because usually different indexing strategies should be applied. The paper examines the usefulness of the temporal aggregation method and pre-categorization of shots in news videos to reduce processing time taken by a very time-consuming content-based video indexing process.
ChorośK., Temporal aggregation of video shots in TV sports news for detection and categorization of player scenes. In: ICCCI 2013, LNCS 8083, Springer, Heidelberg, 2013, pp. 487–497.
2.
ChorośK. and GonetM., Effectiveness of video segmentation techniques for different categories of videos. In: New Trends in Multimedia and Network Information Systems, IOS Press, Amsterdam, 2008, pp. 34–45.
3.
ChorośK., Automatic categorization of shots in news videos based on the temporal relations. In: ICCCI 2015, LNCS 9330, Springer International Publishing, 2015, pp. 13–23.
4.
ChorośK., Probabilistic approach to content-based indexing and categorization of temporally aggregated shots in news videos. In: Intelligent Information and Database Systems, ACIIDS 2016, LNCS 9621, Springer International Publishing, 2016, pp. 741–750.
5.
SokolovaM.V., Serrano-CuerdaJ., CastilloJ.C. and Fernández-CaballeroA., A fuzzy model for human fall detection in infrared video, Journal of Intelligent & Fuzzy Systems24(2) (2013), 215–228.
6.
MoneyA.G. and AgiusH., Video summarisation: A conceptual framework and survey of the state of the art, J of Visual Communication and Image Representation19 (2008), 121–143.
7.
HuW., XieN., LiL., ZengX. and MaybankS., A survey on visual content-based video indexing and retrieval, IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews41(6) (2011), 797–819.
8.
Del FabroM. and
BöszörmenyiL., State-of-the-art and future challenges in video scene detection: A survey, Multimedia Systems19(5) (2013), 427–454.
9.
VossenG., Big data as the new enabler in business and other intelligence, Vietnam Journal of Computer Science1(1) (2014), 3–14.
10.
KompatsiarisY., MérialdoB. and LianS., (eds.): TV Content Analysis: Techniques and Applications. CRC Press, Boca Raton, 2012.
11.
ValdésV. and MartínezJ.M., On-line video abstract generation of multimedia news, Multimedia Tools and Applications59(3) (2012), 795–832.
12.
DuanL.Y., XuM., TianQ., XuC.S. and JinJ.S., A unified framework for semantic shot classification in sports video, IEEE Transactions on Multimedia7(6) (2005), 1066–1083.
13.
LangC., XuD. and JiangY., Shot type classification in sports video based on visual attention. In: Proc of Int Conf on Computational Intelligence and Natural Computing (CINC’2009), IEEE, Vol. 1, 2009, pp. 336–339.
14.
ChorośK., Automatic detection of headlines in temporally aggregated TV sports news videos. In: Proc of the 8th Int Symp on Image and Signal Processing and Analysis (ISPA’2013), IEEE, 2013, pp. 147–152.
15.
KapelaR., McGuinnessK. and O’ConnorN.E., Real-time field sports scene classification using colour and frequency space decompositions, Journal of Real-Time Image Processing (2014), 1–13.
16.
JiP., CaoL., ZhangX., ZhangL. and WuW., News videos anchor person detection by shot clustering, Neurocomputing123 (2014), 86–99.
17.
ZhengF., LiS., WuH. and FengJ., Anchor shot detection with diverse style backgrounds based on spatial-temporal slice analysis. In: Advances in Multimedia Modeling, Springer, Heidelberg, 2010, pp. 676–682.
18.
BroiloM., BassoA. and DeF.G., Natale, Unsupervised anchorpersons differentiation in news video. In: Proc of the 9th International Workshop on Content-Based Multimedia Indexing (CBMI), 2011, pp. 115–120. IEEE.
19.
LeeH., YuJ., ImY., GilJ.M. and ParkD., A unified scheme of shot boundary detection and anchor shot detection in news video story parsing, Multimedia Tools and Applications51(3) (2011), 1127–1145.
20.
MontagnuoloM., MessinaA. and BorgotalloR., Automatic segmentation, aggregation and indexing of multimodal news information from television and the Internet, Int J of Information Studies1(3) (2010), 200–211.
21.
DongY., QinG., XiaoG., LianS. and ChangX., Advanced news video parsing via visual characteristics of anchorperson scenes, Telecommunication Systems54(3) (2013), 247–263.
22.
ChorośK., Automatic fast detection of anchorperson shots in temporally aggregated TV news videos. In: Intelligent Information and Database Systems, ACIIDS 2015, LNAI 9012, Springer International Publishing, 2015, pp. 339–348.
23.
ColaceF., FoggiaP. and PercannellaG., A probabilistic framework for TV-news stories detection and classification. In: Proc of the IEEE Int Conf on Multimedia and Expo, ICME 2005, 2005, pp. 1350–1353, IEEE.
24.
El KhouryE.,
SénacC. and JolyP., Audiovisual diarization of people in video content, Multimedia Tools and Applications68(3) (2014), 747–775.
25.
QuB., ValletF., CarriveJ. and GravierG., Content-based inference of hierarchical structural grammar for recurrent TV programs using multiple sequence alignment. In: Proc of the IEEE International Conference on Multimedia and Expo, ICME, 2014, pp. 1–6.
26.
ChorośK., Video structure analysis and content-based indexing in the Automatic Video Indexer AVI. In: Advances in Multimedia and Network Information System Technologies, Advances in Intelligent and Soft Computing 80, Springer, Heidelberg, 2010, pp. 79–90.
27.
ChorośK., Video structure analysis for content-based indexing and categorisation of TV sports news, Int J of Intelligent Information and Database Systems6(5) (2012), 451–465.
28.
ChorośK., Automatic detection of headlines in temporally aggregated TV sports news videos. In: Proc of the 8th International Symposium on Image and Signal Processing and Analysis (ISPA), IEEE, 2013, pp. 147–152.
29.
ChorośK., False and miss detections in temporal segmentation of TV sports news videos – causes and remedies. In: New Research in Multimedia and Internet Systems, Advances in Intelligent Systems and Computing 314, Springer, Heidelberg, 2014, pp. 35–46.
30.
LaiJ.L. and YiY., Key-frame extraction based on visual attention model, Journal of Visual Communication and Image Representation23(1) (2012), 114–125.
31.
EjazN., MehmoodI. and BaikS.W., Feature aggregation based visual attention model for video summarization, Computers & Electrical Engineering40(3) (2014), 993–1005.
LuG., ZhouY., LiX. and YanP., Unsupervised, efficient and scalable key-frame selection for automatic summarization of surveillance videos, Multimedia Tools and Applications (2016), 1–23.
