This paper presents a novel relational database architecture aimed for visual objects classification and retrieval based on the content of images. Most methods search and classify images based on their content use algorithms for generating and comparing keypoint descriptors. We present a new method to quickly compare these visual features, based on fuzzy sets, which is embedded in a real database environment. We also present a full framework as an extension of Microsoft SQL Server database, which allows to search and classify images directly from SQL query command in large data sets of visual objects. The system utilizes standard indexing mechanisms and SQL queries. We tested the method on a state-of-the-art dataset.
AdeliH. and HungS.L., A production system and relational database model for processing knowledge of earthquake-resistant design, Engineering Applications of Artificial Intelligence3(4) (1990), 313-323.
2.
AdeliH. and YuG., An integrated computing environment for solution of complex engineering problems using the object-oriented programming paradigm and a blackboard architecture, Computers and Structures54(2) (1995), 255-265.
3.
AdeliH. and HungS.L., Machine learning - neural networks, genetic algorithms, and fuzzy systems, John Wiley and Sons, New York, 1995.
4.
AhmadlouM. and AdeliH., Fuzzy synchronization likelihood with application to attention-deficit/hyperactivity disorder, Clinical EEG and Neuroscience42(1) (January 2011), 6-13.
5.
AhmadlouM. and AdeliH., Enhanced probabilistic neural network with local decision circles: A robust classifier, Integrated Computer-Aided Engineering17(3) (2010), 197-210.
6.
AhmadlouM., AdeliH. and AdeliA., Fuzzy synchronization likelihood-wavelet methodology for diagnosis of autism spectrum disorder, Journal of Neuroscience Methods211 (2012), 203-209.
7.
Al NacharR., InatyE., BonninP.J. and AlayliY., Towards an automatic image co-registration technique using edge dominant corners primitives, Integrated Computer-Aided Engineering22(1) (2015), 1-19.
8.
AraujoM.R., TrainaA.J. and TrainaC., Jr, Extending SQL to support image content-based retrieval, in: ISDB (2002), 19-24.
9.
BaumgartnerJ., FlesiaA.G., GimenezJ. and PuchetaJ., A new image segmentation framework based on two-dimensional hidden Markov models, Integrated Computer-Aided Engineering23(1) (2015), 1-13.
10.
BayH., EssA., TuytelaarsT. and Van GoolL., Speeded-up robust features (SURF), Comput Vis Image Underst110(3) (2008), 346-359.
11.
DalalN. and TriggsB., Histograms of oriented gradients for human detection, in: Proc IEEE Conf Computer Vision and Pattern Recognition1 (2005), 886-893.
12.
DatarM., ImmorlicaN., IndykP. and MirrokniV.S., Locality-sensitive hashing scheme based on p-stable distributions, in: Proceedings of the Twentieth Annual Symposium on Computational Geometry, SCG '04, New York, NY, USA, ACM (2004), 253-262.
13.
EveringhamM., Van GoolL., WilliamsC.K.I., WinnJ. and ZissermanA., The pascal visual object classes (VOC) challenge, International Journal of Computer Vision88(2) (June 2010), 303-338.
14.
MendozaL.F., VellascoM. and FigueiredoK., Intelligent multiagent coordination based on reinforcement hierarchical neuro-fuzzy models, International Journal of Neural Systems24(8) (2014), 1450031 (20 pages).
15.
FischerP., DosovitskiyA. and BroxmT., Descriptor matching with convolutional neural networks: A comparison to SIFT, arXiv preprint arXiv:1405.5769, 2014.
16.
FreundY. and SchapireR.E., A decision-theoretic generalization of on-line learning and an application to boosting, Journal of Computer and System Sciences55(1) (1997), 119-139.
17.
GraumanK. and DarrellT., Efficient image matching with distributions of local invariant features, in: IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2005 IEEE Press 2 (2005), 627-634.
18.
HsuW.Y., Assembling a multi-feature eeg classifier for left-right motor data using wavelet-based fuzzy approximate entropy for improved accuracy, International Journal of Neural Systems25(8) (2015), 1550037 (13 pages).
19.
JahaniE., MuhannaR.L., ShayanfarM.A. and BarkhordariM.A., Reliability assessment with fuzzy random variables using interval monte carlo simulation, Computer-Aided Civil and Infrastructure Engineering29(3) (2014), 208-220.
20.
KimD., RhoS., JunS., SanghoonE. and HwangE., Classification and indexing scheme of large-scale image repository for spatio-temporal landmark recognition, Integrated Computer-Aided Engineering22(2) (2015), 201-213.
21.
KorytkowskiM., RutkowskiL. and SchererR., Fast image classification by boosting fuzzy classifiers, Information Sciences327 (2016), 175-182.
22.
KrizhevskyA., SutskeverI. and HintonG., Imagenet classification with deep convolutional neural networks, in: Advances in Neural Information Processing Systems, NIPS 25 (2012).
23.
LadislavL. and KrálP., Local binary pattern based face recognition with automatically detected fiducial points, Integrated Computer-Aided Engineering23(2) (2016), 129-139.
24.
LoweD.G., Distinctive image features from scale-invariant keypoints, Int J Comput Vision60(2) (2004), 91-110.
25.
MullerH., GeissbuhlerA. and Marchand-MailletS., Extensions to the multimedia retrieval markup language - a communication protocol for content-based image retrieval, in: European Conference on Content-based Multimedia Indexing (CBMI03) (2003).
26.
NowickiR., SchererR. and RutkowskiL., A method for learning of hierarchical fuzzy systems, in: Intelligent Technologies - Theory and Applications, SincakP. et al., eds, IOS Press, Amsterdam, 2002, pp. 124-129.
27.
OgleV.E. and StonebrakerM., Chabot: Retrieval from a relational database of images, Computer28(9) (1995), 40-48.
Ortega-BinderbergerM., ChakrabartiK. and MehrotraS., Database support for multimedia applications, in: Image Database, Search and Retrieval of Digital Imagery, CastelliV. and BergmanL.D., eds, Wiley, New York, 2002, pp. 861-210.
30.
RubleeE., RabaudV., KonoligeK. and BradskiG., ORB: An efficient alternative to SIFT or SURF, Proceedings of the IEEE International Conference on Computer Vision (ICCV) (2011), 2564-2571.
31.
PeinR., LuJ. and WolfgangR., An extensible query language for content based image retrieval based on Lucene, in: Computer and Information Technology 2008, CIT, 2008 8th IEEE International Conference on, (July 2008), 179-184.
32.
Ponz-TiendaJ.L., PellicerE., Benlloch-MarcoJ. and Andrés-RomanoC., Fuzzy project scheduling problem with minimal generalized relations, Computer-Aided Civil and Infrastructure Engineering30(11) (2015), 1467-8667.
RutkowskiL., Computational intelligence methods and techniques, Springer-Verlag, Berlin Heidelberg, 2008.
35.
SchererR., Designing boosting ensemble of relational fuzzy systems, International Journal of Neural Systems20(5) (2010), 381-388.
36.
SchererR., Multiple fuzzy classification systems, Springer-Verlag Berlin Heidelberg, 2014.
37.
SiddiqueN. and AdeliH., Computational intelligence - synergies of fuzzy logic, neural networks and evolutionary computing, Wiley, West Sussex, United Kingdom, 2013.
38.
SivicJ. and ZissermanA., Video Google: A text retrieval approach to object matching in videos, Proceedings of the Ninth IEEE International Conference on Computer Vision (2013), 1470-1477.
39.
StaszewskiP., WoldanP., KorytkowskiM., SchererR. and WangL., Query-by-example image retrieval in microsoft SQL Server, Artificial Intelligence and Soft Computing, Lecture Notes in Computer Science9693 (2016), 746-754.
40.
TieuK. and ViolaP., Boosting image retrieval, Int J Comput Vision56(1-2) (2004), 17-36.
41.
VagacM. and MelichercikM., Improving image processing performance using database user-defined functions, Artificial Intelligence and Soft Computing, Lecture Notes in Computer Science9119 (2015), 789-799.
42.
ViolaP. and JonesM., Rapid object detection using a boosted cascade of simple features, in: Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2001, IEEE Press 1 (2001), I-511-I-518.
43.
YuG. and AdeliH., Object-oriented finite element analysis using EER model, Journal of Structural Engineering, ASCE119(9) (1993), 2763-2781.
44.
JiangX. and AdeliH., Fuzzy clustering approach for accurate embedding dimension identification in chaotic time series, Integrated Computer-Aided Engineering10(3) (2003), 287-302.
45.
ZengZ., XuJ., WuS. and ShenM., Antithetic method-based particle swarm optimization for a queuing network problem with fuzzy data in concrete transportation systems, Computer-Aided Civil and Infrastructure Engineering29(10) (2014), 771-800.
46.
ZhangW., SunK., LeiC., ZhangY., LiH. and SpencerB.F., Fuzzy analytic hierarchy process synthetic evaluation models for the health monitoring of shield tunnels, Computer-Aided Civil and Infrastructure Engineering29(9) (2014), 676-688.
47.
ZhangW., YuB., ZelinskyG. and SamarasD., Object class recognition using multiple layer boosting with heterogeneous features, Computer Vision and Pattern Recognition, CVPR 2005, IEEE Computer Society Conference on (2005), 323-330.
