Web documents are available in various forms, most of which do not carry additional semantics. This paper presents a model for general document metadata extraction. The model, which combines segmentation by keywords and pattern matching techniques, was implemented using PHP, MySQL, JavaScript and HTML. The system was tested with 40 randomly selected PDF documents (mainly theses). An evaluation of the system was done using standard criteria measures namely precision, recall, accuracy and F-measure. The results show that the model is relatively effective for the task of metadata extraction, especially for theses and dissertations. A combination of machine learning with these rule-based methods will be explored in the future for better results.
A. Arasu and H. Garcia-Molina, Extracting structured data from web pages, Proceedings of the 2003 ACM SIGMOD International Conference on Management of Data (SIGMOD) (June 2003) 337-348.
3.
A. Crystal and P. Land, Metadata and search, Global Corporate Circle DCMI 2003 Workshop (2003). Available from http://dublincore.org/groups/corporate/Seattle/
4.
H. Han , C.L. Giles, E. Manavoglu, H. Zha , Z. Zhang and E.A. Fox , Automatic document metadata extraction using support vector machine, Joint Conference on Digital Libraries (JCDL’03) ( Houston, Texas USA, 2003).
5.
B.A. Ojokoh , S.O. Falaki and O.S. Adewale, Automated information extraction system for heterogeneous digital library documents, Proceedings of the ACM/IEEE Joint Conference on Digital Libraries (JCDL 2007) Doctoral Consortium ( Vancouver, British Columbia, Canada, June 18-23, 2007).
6.
A. Kawtrakul and C. Yingsaeree, A Unified Framework for Automatic Metadata Extraction from Electronic Document (2004 ). Available at: http://iadlc.nul.nagoya-u.ac.jp/archives/IADLC2005/kawrtrakul.pdf
7.
E.D. Liddy , S. Sutton, E. Allen, S. Harwell, S. Corieri and O. Yilmazel, Automatic metadata generation and evaluation, Proceedings of the 25th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (Tampere, Finland, 2002) 401-402.
8.
O. Yilmazel , C.M. Finneran and E.D. Liddy, MetaExtract: an NLP system to automatically assign metadata, Proceedings of the 2004 Joint ACM/IEEE Conference on Digital Libraries (Tuscan, AZ , USA, 2004) 241-242.
9.
S. Mao , J.W. Kim and G.R. Thoma, A dynamic feature generation system for automated metadata extraction in preservation of digital materials, Proceedings of the First International Workshop on Document Image Analysis for Libraries ( Palo Alto, CA, USA, 2004) 225-232.
10.
Y. Hu , H. Li , Y. Cao , T. Teng, D. Meyerzon and Q. Zheng, Automatic extraction of titles from general documents, Information Processing and Management42 (2006) 1276-1293.
11.
F. Peng and A. McCallum, Accurate information extraction from research papers using conditional random fields, Proceedings of the Human Language Technology Conference/North American Chapter of the Association for Computational Linguistics Annual Meeting (New York, NY, USA, 2004 ) 329-336.
12.
B.A. Ojokoh , O.S. Adewale and S.O. Falaki, Improving on the smoothing technique for obtaining emission probabilities in hidden Markov models, Oriental Journal of Computer Science and Technology1(1) ( 2008) 15-24.
13.
K. Seymore , A. McCallum and R. Rosenfeld, Learning hidden Markov model structure for information extraction. In: AAAI Workshop on Machine Learning for Information Extraction (1999).
14.
G. Giuffrida , E.C. Shek and J. Yang, Knowledge-based metadata extraction from postscript files, ACM Digital Libraries ( 2000) 77-84.
15.
K. Nakagawa , A. Nomura and M. Suzuki, Extraction of Logical Structure from Articles in Mathematics ( Springer, Berlin, 2004).
16.
M. Krämer , H. Kaprykowsky, D. Keysers and T. Breuel, Bibliographic metadata extraction using probabilistic finite state transducers, Ninth International Conference on Document Analysis and Recognition (2007) 609-613.
17.
E.G. Berkowitz and M.R. Elkhadiri, Creation of a Style Independent Intelligent Autonomous Citation Indexer to Support Academic Research (MAICS 2004)68-73.
