Various content-based methods (e.g., audio-visual feature recognition and dialogs analysis) have been proposed for analyzing, indexing and understanding movies. Our previous approach introduced a method for character indexing based on manual annotation. However, this method has shown several unsatisfactoriness on performing of indexing. For addressing this issue, in this work, we take into account using image processing techniques for semi-automatically character-based indexing. Besides, a movie ontological model is created for connecting character appearances and character’s roles in the movie. Moreover, we propose a system for assist user indexing manually. On the other hand, a searching and browsing tool is also introduced. Using this tool, user can query character-based semantic indexing. Experimental results are shown that our proposed method is able to assist user in consuming index time and providing a method for automatic indexing, searching and browsing based on semantic queries.
BordwellD., The way Hollywood tells it: Story and style in modern movies, Univ of California Press, 2006.
3.
BradskiG. and KaehlerA., Learning OpenCV: Computer vision with the OpenCV library. O’Reilly Media, Inc., 2008.
4.
BagdanovA.D., BertiniM., Del BimboA., SerraG. and TorniaiC., Semantic annotation and retrieval of video events using multimedia ontologies. Proceedings of International Conference on Semantic Computing, 2007, pp. 713–720.
5.
BloehdornS., PetridisK., SaathoffC., SimouN., TzouvarasV., AvrithisY., HandschuhS., KompatsiarisY., StaabS. and StrintzisM.G., Semantic annotation of images and videos for multimedia analysis. Proceedings of International Semantic Web Conference. Springer Berlin Heidelberg, 2005, pp. 592–607.
6.
Del FabroM. and BöszörmenyiL., State-of-the-art and future challenges in video scene detection: A survey, Multimedia Systems19(5) (2013), 427–454.
7.
JungJ.J., Exploiting geotagged resources for spatial clustering on social network services, Concurrency and Computation: Practice and Experience28(4) (2016), 1356–1367.
8.
HanD., KimJ., JuJ., LeeI., ChaJ. and KimJ., Efficient and fast multi-view face detection based on feature transformation. Proceedings of 16th International Conference on Advanced Communication Technology (ICACT), 2014, pp. 682–686.
9.
HuW., XieN., LiL., ZengX. and MaybankS., A survey on visual content-based video indexing and retrieval, IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews41(6) (2011), 797–819.
10.
JaimesA. and SmithJ.R., Semi-automatic, data-driven construction of multimedia ontologies. Proceedings of 2003 International Conference On In Multimedia and Expo, ICME’03, 2003, pp. I–782.
11.
JungJ.J., Semantic business process integration based on ontology alignment, Expert Systems with Applications36(8) (2009), 11013–11020.
12.
JungJ.J., YouE. and ParkS.B., Emotion-based character clustering for managing story-based contents: A cinemetric analysis, Multimedia Tools and Applications65(1) (2013), 29–45.
13.
KatzS.D., Film directing shot by shot: Visualizing from concept to screen, Gulf Professional Publishing, 1991.
14.
LiY., NarayananS. and KuoC.J., Content-based movie analysis and indexing based on audiovisual cues, IEEE Transactions on Circuits and Systems for Video Technology14(8) (2004), 1073–1085.
15.
LinC.Y., TsengB.L. and SmithJ.R., VideoAnnEx: IBM MPEG-7 annotation tool for multimedia indexing and concept learning, Proceedings of IEEE International Conference on Multimedia and Expo (2003), pp. 1–2.
16.
MezarisV., KompatsiarisI., BoulgourisN.V. and StrintzisM.G., Real-time compressed-domain spatiotemporal segmentation and ontologies for video indexing and retrieval, IEEE Transactions on Circuits and Systems for Video Technology14(5) (2004), 606–621.
17.
Bello-OrgazG., JungJ.J. and CamachoD., Social Big Data: Recent achievements and new challenges, Information Fusion28 (2016), 45–59.
18.
PerperisT., GiannakopoulosT., MakrisA., KosmopoulosD.I., TsekeridouS., PerantonisS.J. and TheodoridisS., Multimodal and ontology-based fusion approaches of audio and visual processing for violence detection in movies, Expert Systems with Applications38(11) (2011), 14102–14116.
19.
TsekeridouS. and PitasI., Content-based video parsing and indexing based on audio-visual interaction, IEEE Transactions on Circuits and Systems for Video Technology11(4) (2001), 522–535.
20.
TranQ.D. and JungJ.E., CoCharNet: Extracting social networks using character co-occurrence in movies, Journal of Universal Computer Science21(6) (2015), 796–815.
21.
TranQ.D., HwangD. and JungJ.J., Movie Summarization Using Characters Network Analysis. Proceedings of International Conference on Computational Collective Intelligence, Springer International Publishing, 2015, pp. 390–399.
22.
JungJ.J., Semantic Optimization of Query Transformation in a large-scale peer-to-peer network, Neurocomputing, 88 (2012), 36–41.
23.
SklarR., Film, An international history of the medium (Vol. 2). Thames and Hudson, 1993.
24.
TranQ.D., HwangD., LeeO.J. and JungJ.E., Exploiting character networks for movie summarization, Multimedia Tools and Applications. DOI: 10.1007/s11042-016-3633-6
25.
ViolaP. and JonesM., Rapid object detection using a boosted cascade of simple features. Proceedings of the Conference on IEEE Computer Society, 2001, I–511.
26.
WengC.Y., ChuW.T. and WuJ.L., Rolenet: Movie analysis from the perspective of socia networks, IEEE Transactions on Multimedia11(2) (2009), 256–271.
27.
ZhangH., KankanhalliA. and SmoliarS.W., Automatic partitioning of full-motion video, Multimedia Systems1(1) (1993), 10–28.
28.
ZhangH., LowC.Y., SmoliarS.W. and WuJ.H., Video parsing, retrieval and browsing: An integrated and content-based solution, Proceedings of the third ACM International Conference on Multimedia, 1995, pp. 15–24.
