Information retrieval (IR) systems were ongmally devel oped to process, store, search and retrieve narrative informa tion. Structured databases are therefore created to store the items contairung enough information to identify and retneve the onginal documents.
This paper proposes an extension of classification and indexing to pictorial data, specifically to pictorial parts of multimedia documents. This goal is attained by adopting structural techniques for digital image description. The de scriptions of the objects (digital structures) present in the image are proposed as pictorial index terms. Such a generaliza tion has led to a uniform management of the non-homoge neous kinds of data composing the document and has allowed the outlining of a multimedia IR system raised from interdisci plinary experiences.
In the paper the approach to image description is presented and a control structure to index textual and pictorial data is discussed.
Get full access to this article
View all access options for this article.
References
1.
S.K. Chang .Image information systems, Proceedings of the IEEE73 (1985 ) 754-764.
2.
A.F. Cardenas , M. Chock and A. Klinger, Manipulating data structures in pictorial information systems, IEEE Computer14 (1981) 43-50.
S. Christodoulakis and C. Faloutsos, Design and performance considerations for an optical disk-based, multimedia object server, IEEE Computer19 (1986) 45-56.
5.
S.K. Chang.Principles of Pictorial Information System Design (Prentice-Hall, Englewood Cliffs, NJ, 1989).
6.
M. Zaki and R. Salama, Linkage versus integration for binding database and interactive graphics systems , Information Systems12 (1987) 271-280.
7.
D.M. McKeown, Jr.Digital cartography and photo interpretation from a database viewpoint . In: G. Gardarin and E. Gelenbe (Editors), New Applications of Data Bases (Academic Press, New York, 1984) 19-42.
8.
W.I. Grosky, An architecture for integrating images and text in a database environment . In: A.K. Sood and A.H. Qureshi (Editors), Database Machines ( Spnnger, Berlin, 1986) 473-498.
9.
G. Salton and M.J. McGill, Introduction to Modern Information Retrieval ( McGraw-Hill , New York, 1983).
10.
C.J. van Rijsbergen , Information Retrieval ( Butterworths , London, 1980).
11.
S.K. Chang , Q.Y. Shi and C.W. Yan, Iconic indexing by 2-D strings. IEEE Transactions: Pattern Analysis andMachine Intelligence ( 1987) 413-428.
12.
I. Gagliardi , F. Naldi, D. Merelli, P. Mussio, M. Protti and M. Padula, A pictonal and textual IR environment based on image description. In: V. Cantoni , V. Di Gesú and S. Levialdi (Editors), Image Analysis and Processing ( Plenum, London, 1988) 405-413.
13.
P. Mussio, M. Padula and M. Protti, Descnption-based icon design. In: Proceedings of 1987 IEEE Computer Society Workshop on Visual Languages, Linkoping, Sweden, August 1987: 118-129.
14.
U. Cugini, M. Dell'Oca, D. Merelli and P. Mussio, A computer-aided system for interactive definition of digital image interpretation . In: S. Levialdi (Editor), Digital Image Analysis (Pitman, London, 1984) 270-279.
15.
D.E. Knuth , Semantics of context-free languages, Journal of Mathematical Systems and Theory (1968) 127-145.
16.
P. Mussio, M. Padula and M. Protti, Attributed conditional L-systems: a tool for image description. In: Proceedings of 9th International Conference on Pattern Recognition , Rome, November 1988: 607-609.
17.
M. Dell'Oca and P. Mussio, APL iconics, APL Quate Quad14 (1984) 115-121.
18.
E. Carli and M. Padula, Descrizione automatica e ncostruzione grafica di immagini. In: Proceedings of the AICA workshop on "Applicaziont non tradizionalt dell'Information Retrieval," Milan, December 1984: 35-60.
19.
F. Naldi, II sistema IRS-G. In: Proceedings of the CNR workshop "La documentazione automatica al SIAM: strumenti ed applicazioni ," Milan, December 1984: 13-19.
20.
F. Naldi, I. Gagliardi and P. Gallitognotta , Description of an information retrieval system with graphic capabilities. In: G. Valle and G. Bucci (Editors), Proceedings of the Information Computing Symposium 1985 ( North-Holland, Amsterdam, 1985) 141-147.
21.
G. Bordogna , P. Carrara.I. Gagliardi.D. Merelli, F. Naldi and M. Padula, A system architecture for multimedia information retrieval. Accepted for publication in Journal of Information Science.
22.
W.H. Tsai and K.S. Fu .Attributed grammar-A tool for combining syntactic and statistical approaches to pattern recognition, IEEE Transactions: Systems, Man and Cvbernetics10 ( 1980) 873-885.
23.
K.S. Fu , A step towards unification of syntactic and statistical pattern recognition, IEEE Transactions: Pattern Analysis andMachine Intelligence2 ( 1983) 204-210.
24.
K.S. Fu , Syntactic Methods in Pattern Recognition (Academic Press , New York, 1974).
25.
A. Rosenfeld , Picture Languages (Academic Press, New York, 1979).
26.
T. Pavlidis , Structural Pattern Recognition ( Academic Press, New York, 1979).
27.
N.C. Shu, Visual programming languages: a perspective and a dimensional analysis . In: S.K. Chang, T. Ichikawa and P. Ligomenides (Editors), Visual Language (Plenum, London, 1986) 11-34.
28.
S.K. Chang, Visual languages: a tutorial and survey. IEEE Software (1987) 29-39.
29.
G. Bordogna , I. Gagliardi, D. Merelli, P. Mussio, M. Padula and M. Protti, Iconic queries of pictorial data. In: Proceedings of IEEE 1989 Workshop on Visual Languages , Rome. October 1989: 38-42.
30.
A. Accomazzi , G. Bordogna, P. Mussio and A. Rampini, An approach to heuristic exploitation of astronomers' knowledge in automatic interpretation of optical pictures . In: A. Heck and F. Murtagh (Editors), Knowledge-Based Systems in Astronomy (Springer, Berlin, 1989) 191-212.
31.
U. Cugini , G. Ferri, P. Mussio and M. Protti, Pattern-directed restoration and vectorization of digitized engineered drawings, Computers & Graphics8 (1984 ) 337-350.
32.
A.P. Pawlina and P. Mussio, Heuristic description of spatial and temporal behaviour of rain patterns using a simple physical model. In: V. Cantoni.V. Di Gesú and S. Levialdi (Editors). Image Analysis und Processing (Plenum, London, 1988) 433-441.
33.
D. Merelli , P. Mussio and M. Padula, An approach to the definition, description, and extraction of structures in binary digital images, Computer Vision, Graphics, Image Processing31 (1985) 19-49.
34.
D.E. Knuth, The Art of Computer Programming. Vol. 3 (Addison-Wesley, Reading, MA, 1973).
