Automatic localization and extraction of tables from handheld mobile-camera captured handwritten document images

Abstract

A table is a compact, effective and structured way of representing information in any document. Automatic localization of tables in scanned handwritten document images, and extracting the information are very critical and challenging task for applications like Optical Character Recognition, handwriting analysis, and auto-evaluation systems. The same task becomes more complex, when the handwritten document images are acquired through handheld mobile-cameras, because the captured images naturally get distorted due to poor illumination, device vibration, camera-angle, camera-orientation, camera-movement, and camera-distance. In this research article, a novel technique of automatic localization and segmentation of tables in handwritten document images which are captured using a handheld mobile-camera is proposed. Generally, ruling lines are used for structuring tables, sketching figures, and scribing scientific equations. In the current research work, tables are detected and extracted based on edge features of the ruling lines subjected to three main stages. Firstly, block– wise mean-computed fuzzy based binarization technique is proposed for analyzing the distortion in the acquired image, and subsequently the background surface that envelops the document area of the image is removed. Secondly, horizontal and vertical granule or strip-based technique is proposed for fast edge-feature extraction from the ruling lines of the table in the binarized image. Finally, entropy quantifiers are employed for segmenting the table in the image. The performance of the proposed technique is evaluated and reported using the proposed composite handwritten benchmark daset. Linear computational benefit 0 (h × w) is observed in the worst-case tolerance.

Keywords

Handwritten document images mobile-cameras block– wise mean-computed fuzzy based binarization fast edge-feature extraction localizing the table

Get full access to this article

View all access options for this article.

References

LNCS 8357, Camera-Based Document Analysis and Recognition (CBDAR 2013), 5th International Workshop, Washington, DC, USA, August 23, 2013. doi: https://doi.org/10.1007/978-3-319-05167-3.

Proceedings of the Second International Workshop on Camera-Based Document Analysis and Recognition, Grand Hotel Rayon, Curitiba, Brazil, 2007.

Nagabhushan and

V.E.

Jathanna , Mosaicing of text contents from consecutive frames in pedestal shot videos, International Journal of Engineering Research & Technology (IJERT) ISSN: 2278-0181 4(7) (2015).

Amarnath and

Nagabhushan , Spotting separator points at line terminals in compressed document images for text-line segmentation, International Journal of Computer Applications 172(4) (2017).

Bansal ,

Harit and

S.D.

Roy , Table Extraction from Document Images using Fixed Point Model ICVGIP ’14, Proceedings of the 2014 Indian Conference on Computer Vision Graphics and Image Processing.

B.B.

Chaudhuri and

Adak , An approach for detecting and cleaning of struck-out handwritten text, Pattern Recognition 61 (2017), 282–294.

Sauvola and

PietikaKinen , Adaptive document image binarization, Pattern Recognition 33 (2000), 225–236.

Hossain ,

S.A.

Kumar and

M.N.

Chaki , A new image binarization method using iterative partitioning, Machine Vision and Applications 24(2) (2013), 337–350. DOI: 10.1007/s00138-011-0402-4.

Chaki

et al., A comprehensive survey on image binarization techniques, Studies in Computational Intelligence 560 (2014). DOI: 10.1007/978-81-322-1907-1_2, © Springer India.

10.

S.M.

Ismail ,

S.N.H.S.

Abdullah and

Fauzi , Statistical binarization techniques for document image analysis, Journal of Computer Science, Science Publications (2018).

11.

Chattopadhyay ,

Bhattacharya and

B.B.

Chaudhuri , On the Enhancement and Binarization of Mobile Captured Vehicle Identification Number for an Embedded Solution, 2012 10th IAPR International Workshop on Document Analysis Systems.

12.

Aja-Fernández ,

HernánCuriale and

Vegas-Sánchez-Ferrero , A local fuzzy thresholding methodology for multiregion image segmentation, Knowledge-Based Systems 83 (2015), 1–12.

13.

Deivalakshmi ,

Chaitanya and

Palanisamy , Detection of Table Structure and Content Extraction From Scanned Documents, International Conference on Communication and Signal Processing, India, 2014.

14.

Roy ,

Shivakumara ,

Jain ,

Khare ,

Dutta ,

Pal and

Lu , Rough-fuzzy based scene categorization for text detection and recognition in video, Pattern Recognition 80 (2018), 64–82.

15.

Alaei ,

Pal ,

Nagabhushan and

Kimura , Painting Based Technique for Skew Estimation of Scanned Documents, International Conference on Document Analysis and Recognition, 2011.

16.

S.D.

Gowda and

Nagabhushan , Entropy Quantifiers Useful for Establishing Equivalence between Text Document Images, International Conference on Computational Intelligence and Multimedia Applications (ICCIMA 2007).

17.

Chamorro-Martínez ,

Sánchez ,

J.M.

Soto-Hidalgo and

Martínez-Jiménez , Histograms for Fuzzy Color Spaces, Part of the Advances in Intelligent and Soft Computing book series (AINSC, volume 107).

18.

Snapp , CS 295: Pattern Recognition, Course Notes, Department of Computer Science, University of Vermont, (http://www.cs.uvm.edu/~snapp/teaching/CS295PR/whatispr.html)

19.

R.O.

Duda ,

P.E.

Hart and

D.G.

Stork , Pattern Classification. (2nd ed.). New York: Wiley-Interscience Publication, 2001.

20.

Gutierrez-Osuna , Intelligent Sensor Systems, Course Notes, Department of Computer Science, Wright State University, (http://research.cs.tamu.edu/prism/lectures/iss/iss\_l9.pdf)

21.

Amarnath

Nagabhushan,

Dr > (Supervision), Indian paper currency bill recognition system for the visually impaired, M.Tech Thesis, Department of Studies in Computer Science, University of Mysore, Manasagangotri. 2013.

22.

Almeida ,

DueireLins ,

Bernardino ,

Jesus and

Lima , A new binarization algorithm for historical documents, Journal of Imaging 4 (2018), 27. doi: 10.3390/jimaging4020027

23.

Mishra ,

Alahari and

C.V.

Jawahar , Unsupervised refinement of color and stroke features for text binarization, International Journal on Document Analysis and Recognition, Springer Verlag 20(2) (2017), 105–121.

24.

UoM-Camera based composite handwritten document dataset: https://sites.google.com/view/amarnath-r

25.

Amarnath ,

Nagabhushan and

Javed , Enabling Text-line Segmentation in Run-Length Encoded Handwritten Document Image using Entropy Driven Incremental Learning, Third International Conference on Computer Vision & Image Processing (CVIP-2018), IIIT Jabalpur, MP, India, 2018. IAPR Endorsed.

26.

Amarnath ,

Nagabhushan and

Javed , Line Detection in Run-Length Encoded Document Images using Monotonically Increasing Graph Model, International Conference on Advances in Computing, Communications and Informatics (ICACCI), Bangalore, 2018.