Thanks to recent developments, actual information technologies offer tools for the access to information about cultural heritage buildings. These tools are aimed to help experts to enrich and share information about historic monuments. This article describes a hybrid process for the semantic annotation of a set of spatially-oriented images (whose positions and orientations in space are automatically estimated). First of all, a large set of images is processed with an automated image based reconstruction method so as to generate 3D information (specifically 3D coordinates). This 3D information is then used in an automated transfer process of annotations through the set of images. At last, new images can be oriented within the set of already-oriented and already-annotated images. Then, annotations can be precisely projected on newly-oriented images. As a consequence, this process provides a simple way to establish a continuity of information inside a set of images.
Get full access to this article
View all access options for this article.
References
1.
ZhouQ.-Y.iMillerS., Stanford University; Vladlen Koltun, Stanford University in Elastic Fragments for Dense Scene Reconstruction, ICCV, 2013.
2.
MakantasisK.DoulamisA. and DoulamisN., A Non-parametric Unsupervised Approach for Content Based Image Retrieval and Clustering, 4th Workshop on Analysis and Retrieval of Tracked Event and Motion in Imagery Streams, ARTEMIS 2013, ACM Multimedia workshops, 2013.
3.
Halaschek-WienerC.JenniferG.AndrewS.MichaelG.BijanP., and JimH., PhotoStuff—An Image Annotation Tool for the Semantic Web, 2005.
4.
PetridisK.AnastasopoulosD.SaathoffC.TimmermannN.KompatsiarisI., and StaabS., M-OntoMat-Annotizer: Image annotation linking ontologies and multimedia low-level features, KES 2006 10th Intnl. conf. on knowledge based, intelligent information and engineering systems, 2006.
5.
ShottonJ.WinnJ.RotherC., and CriminisiA., TextonBoost for Image Understanding: Multi-Class Object Recognition and Segmentation by Jointly Modeling Texture, Layout, and Context, IJCV(81), No. 1, 2009.
6.
AkcayH.G. and AksoyS., Automatic Detection of Geospatial Objects Using Multiple Hierarchical Segmentations, IEEE Transactions on Geoscience and Remote Sensing, 46(7), pp. 2097–2111, 2008.
7.
LiJ. and WangJ.Z., Real-Time Computerized Annotation of Pictures, Proc. ACM Multimedia. pp. 911–920, 2006.
8.
BarratS. and TabboneS., Classification et extension automatique d'annotations d'images en utilisant un réseau Bayesien, 2009.
9.
HunterJ. and YuC.H., Assessing the Value of Semantic Annotation for 3D Museum Artifacts, 2011.
10.
AtteneM.RobbianoF.SpagnuoloM. and FalcidienoB., Part-based Annotation of Virtual 3D Shapes, 2009.
11.
HavemannS.SettgastV.BerndtR.EideO. and FellnerD.W., The Arrigo Showcase Reloaded – Towards a sustainable link between 3D and semantics, 2008.
12.
BilascoI.M.GenselJ.Villanova-OliverM. and MartinH., 3DSEAM: A model for annotating 3D scenes using MPEG-7, 2005.
13.
PittarelloF. and De FaveriA., Semantic Description of 3D Environments: A Proposal Based on Web Standards, 2006.
14.
SnavelyN.SeitzS., and SzeliskiR., Photo Tourism: Exploring Photo Collections in 3D, 2006.
15.
StefaniC.BusayaratC.LombardoJ. and De LucaL., A database of spatialized and semantically-enriched iconographic sources for the documentation of cultural heritage buildings. Proceedings of IEEE VSMM 2012 – 18th International Conference on Virtual Systems and Multimedia.Milan, Italy, 2–5 September 2012.
16.
Pierrot-DeseillignyM.De LucaL.RemondinoF., Automated image-based procedures for accurate artifacts 3D modeling and orthopicture generation, Geoinformatics FCE CTU Journal, vol. 6, pp. 291–299, Prague, Czech Republic., 2011.
17.
Martin-BeaumontN.NonyN.DeshayesB.Pierrot-DeseillignyM., and De LucaL., Photographer-friendly Workflows for Image-Based Modeling of Heritage Artifacts, XXIV International CIPA Symposium 2–6 September 2013, Strasbourg, France, ISPRS Archives – Volume XL-5/W2 p.421–424, 2013.
18.
Pierrot-DeseillignyM. and CleryI., APERO, an open source bundle adjustment software for automatic calibration and orientation of set of images, Int. Archives of Photogrammetry, Remote Sensing and Spatial Information Sciences, 38(5/W16), on CD-ROM. ISPRS Int. Workshop 3D-ARCH 2011, Trento, Italy, 2011.
19.
LoweD.G., Object recognition from local scale-invariant features. Proceedings of the International Conference on Computer Vision, 1999.
20.
VedaldiA., An open implementation of the SIFT detector and descriptor, UCLA CSD Tech. Report 070012, 2006.
21.
Pierrot-DeseillignyM. and PaparoditisN., A multiresolution and optimization-based image matching approach: An application to surface reconstruction from SPOT5-HRS stereo imagery, In: IAPRS, Vol. XXXVI-1/W41 in ISPRS Workshop On Topographic Mapping From Space (With Special Emphasis on Small Satellites), Ankara, Turkey, 2006.
22.
ManuelA.GattetE.De LucaL. and VéronP., An approach for precise 2D/3D semantic annotation of spatially-oriented images for in situ visualization applications, 2013 Digital Heritage International Congress (DigitalHeritage), Vol. 1, pp. 289–296, IEEE, 2013.
