As a special case in content-based image retrieval, fabric retrieval has high potential application value in many fields. However, fabric retrieval has higher requirements for results, which makes it difficult for common retrieval methods to be directly applied to fabric retrieval. It is also a challenging issue with several obstacles: variety and complexity of fabric appearance, and high requirements for retrieval accuracy. To address this issue, this paper presents a novel method for fabric image retrieval based on soft similarity and pairwise learning. First, a soft similarity between two fabric images is defined to describe their relationship. Then, a convolutional neural network with compact structure and cross-domain connections is designed to learn the fabric image representation. Finally, listwise learning is introduced to train the convolutional neural network model and hash function. The generated hash codes are used to index the fabric image. The experiments are conducted on a wool fabric dataset. The experimental results show that the newly proposed method has a greater improvement than our previous work.
UnarSWangXZhangC, et al.
Detected text-based image retrieval approach for textual images.IET Image Processing2019;
13: 515–521.
2.
BarriosJMDiaz-EspinozaDBustosB. Text-based and content-based image retrieval on Flickr. In: 2009 Second International Workshop on Similarity Search and Applications. August 29-30, Prague, Czech Republic, 2009, pp. 156–157.
3.
GudivadaVNRaghavanVV.Content based image retrieval systems. Computer1995;
28: 18–22.
4.
WanJWangDHoiSCH, et al. Deep learning for content-based image retrieval: a comprehensive study. In: Proceedings of the 22nd ACM International Conference on Multimedia. November 3-7, Orlando, Florida, USA, 2014, pp. 157–166.
5.
ZhouWLiHTianQ.Recent advance in content-based image retrieval: a literature survey. arXiv preprint arXiv:1706.060642017; 01: 1–22.
6.
TzelepiMTefasA.Deep convolutional learning for content based image retrieval. Neurocomputing2018;
275: 2467–2478.
7.
AhmedKTUmmesafiSIqbalA.Content based image retrieval using image features information fusion. Informat Fusion2019;
51: 76–99.
8.
RadenovićFIscenAToliasG, et al. Revisiting oxford and paris: large-scale image retrieval benchmarking. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. June 18-22, Salt Lake City, Utah, USA, 2018, pp. 5706–5715.
9.
LeiZFuzongLBoZ. A CBIR method based on color-spatial feature. In: Proceedings of IEEE. IEEE Region 10 Conference. TENCON 99. ‘Multimedia Technology for Asia-Pacific Information Infrastructure’ (cat. no. 99CH37030). September 15-17, Cheju Island, South Korea, 1999, pp. 166–169.
10.
ZhangYJinRZhouZ-H.Understanding bag-of-words model: a statistical framework. Int J Machine Learning Cybernet2010;
1: 43–52.
11.
MarsigliCMontaniAPaccangnellaT.A spatial verification method applied to the evaluation of high‐resolution ensemble forecasts. Meteorolog Appl: a journal of forecasting, practical applications, training techniques and modelling2008;
15: 125–143.
12.
JegouHDouzeMSchmidC. Hamming embedding and weak geometric consistency for large scale image search. In: European Conference on Computer Vision. October 12-18, Marseille, France, 2008, pp. 304–317.
13.
EfthimiadisEN.Query expansion. Ann Rev Informat Sci Technol (ARIST)1996;
31: 121–187.
14.
JainAKVailayaA.Image retrieval using color and shape. Pattern Recognit1996;
29: 1233–1244.
15.
HuangZ-CChanPPNgWW, et al. Content-based image retrieval using color moment and Gabor texture feature. In: 2010 International Conference on Machine Learning and Cybernetics. July 11-14, Qingdao, China, 2010, pp. 719–724.
16.
YuanXYuJQinZ, et al. A SIFT-LBP image retrieval model based on bag of features. In: IEEE International Conference on Image Processing. September 11-14, Brussels, Belgium, 2011, pp. 1061–1064.
17.
LiuPGuoJ-MChamnongthaiK, et al.
Fusion of color histogram and LBP-based features for texture image retrieval and classification. Informat Sci2017;
390: 95–111.
18.
LoweDG.Distinctive image features from scale-invariant keypoints. Int J Computer Vision2004;
60: 91–110.
19.
SivicJZissermanA. Video Google: a text retrieval approach to object matching in videos. In: Computer Vision, IEEE International Conference. October 13-16, Nice, France, 2003, pp. 1470–1470.
20.
KrizhevskyASutskeverIHintonGE.Imagenet classification with deep convolutional neural networks.Adv Neural Informat Processing Systems2012;
25: 1097–1105.
21.
WangZJTurkoRShaikhO, et al.
CNN explainer: learning convolutional neural networks with interactive visualization. IEEE Transact Visualiz Computer Graphics2020;
27: 1396–1406.
22.
QinZYuFLiuC, et al.
How convolutional neural network see the world – a survey of convolutional neural network visualization methods. arXiv preprint arXiv:1804.111912018; 01: 1–14.
23.
HänggiMMoserSPfaffhauserE, et al.
Simulation and visualization of CNN dynamics. Int. J Bifurcat Chaos1999;
9: 1237–1261.
24.
SimonyanKZissermanA.Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.15562014; 01: 1–14.
25.
HeKZhangXRenS, et al. Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. June 27-30, Las Vegas, NV, USA, 2016, pp. 770–778.
26.
IoffeSSzegedyC. Batch normalization: accelerating deep network training by reducing internal covariate shift. In: International Conference on Machine Learning. July 6 -11, Lille, France, 2015, pp. 448–456.
27.
LiYvan GemertJ.Deep unsupervised image hashing by maximizing bit entropy.arXiv preprint arXiv:2012.123342020; 01: 1–17.
28.
ZhangZZouQLinY, et al.
Improved deep hashing with soft pairwise similarity for multi-label image retrieval. IEEE Transact Multimedia2019;
22: 540–553.
29.
SidorovGGelbukhAGómez-AdornoH, et al.
Soft similarity and soft cosine measure: similarity of features in vector space model. Computación y Sistemas2014;
18: 491–504.
30.
CaoZQinTLiuT-Y, et al. Learning to rank: from pairwise approach to listwise approach. In: Proceedings of the 24th International Conference on Machine Learning. June 20-24, Corvallis, Oregon, 2007, pp. 129–136.
31.
ShiYLarsonMHanjalicA. List-wise learning to rank with matrix factorization for collaborative filtering. In: Proceedings of the Fourth ACM Conference on Recommender Systems, September 26-30, Barcelona, Spain, 2010, pp. 269–272.
32.
XiangJZhangNPanR, et al.
Fabric image retrieval system using hierarchical search based on deep convolutional neural network. IEEE Access2019; 7: 35405–35417.
33.
XiangJZhangNPanR, et al.
Fabric retrieval based on multi-task learning. IEEE Transact Image Processing2020;
30: 1570–1582.
34.
ZhangNXiangJWangL, et al.
Image retrieval of wool fabric. Part I: Based on low-level texture features. Text Res J2019;
89: 4195–4207.
35.
ZhangNXiangJWangL, et al.
Image retrieval of wool fabric. Part II: Based on low-level color features. Text Res J2020;
90: 797–808.
36.
ZhangNXiangJWangL, et al.
Image retrieval of wool fabric. Part III: Based on aggregated convolutional descriptors and approximate nearest neighbors search. Text Res J2021; 92(3-4): 434–445.
37.
XiangJZhangNPanR, et al.
Patterned fabric image retrieval using relevant feedback via geometric similarity. Text Res J2021; 92(3-4): 409–422.
38.
YuanLWangTZhangX, et al. Central similarity quantization for efficient image and video retrieva. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. June 13-19, Seattle, WA, USA, 2020, pp. 3083–3092.
39.
LiW-JWangSKangW-C.Feature learning based deep supervised hashing with pairwise labels. arXiv preprint arXiv:1511.038552015; 01: 1–19.
40.
DengDWangRWuH, et al.
Learning deep similarity models with focus ranking for fabric image retrieval. ImageVision Computing2018;
70: 11–20.
