Simple, fast and effective fiber identification can help consumers purchase their desired apparel and help the industry conduct large-scale textile testing. This paper presents a transformer architecture incorporating convolutions to recognize fibers in textile surface images, which meets the above requirements. Firstly, a convolution operation is performed on textile images to pick up overlapping patches as tokens and the linear projections in transformer encoders are replaced by depth-wise separable convolutions to extract the fiber representations. Secondly, the multi-head cross-attention module enables each label embedding to be compared with features at each spatial location to locate and pool the corresponding fiber characteristics. Finally, a simplified asymmetric loss is introduced to further purify the extracted fiber features. Experiments demonstrate that the proposed approach provides a significant improvement in fiber identification accuracy over both state-of-the-art multi-label classification frameworks and fiber identification architectures.
RaeveADVasileSCoolsJ.Selected factors influencing wear comfort of clothing: case studies. J Text Eng Fash Technol2018;
4: 66–71.
2.
BibiNMakhdoomMUA.Effect of material and applied finishes on the properties of single jersey knitted fabric. Int J Sci Res Publ2021;
11: 717–726.
3.
WongWLamJKKanC, et al.
Influence of knitted fabric construction on the ultraviolet protection factor of greige and bleached cotton fabrics. Text Res J2013;
83: 683–699.
4.
YuYQianXM.The effect of material performances of knit fabric on clothing comfort. Adv Mater Res2010;
156: 717–723.
5.
HoqueMSHossainMJRahmanMM, et al.
Fiber types and fabric structures influence on weft knitted fabrics. Heliyon2022;
8: e09605.
6.
YoonHNBuckleyA.Improved comfort polyester: part I: transport properties and thermal comfort of polyester/cotton blend fabrics. Text Res J1984;
54: 289–298.
7.
KrithikaSMUPrakashCSampathMB, et al.
Thermal comfort properties of bilayer knitted fabrics. Fibres Text East Eur2020;
28: 50–55.
8.
GoodwayM.Fiber identification in practice. J Am Inst Conserv1987;
26: 27–44.
9.
BojunXBinDYanC.Neural network technique for fiber image recognition. J Ind Text2007;
36: 329–336.
10.
ChiuSHLiawJJ.Fiber recognition of PET/rayon composite yarn cross-sections using voting techniques. Text Res J2005;
75: 442–448.
11.
WangRWWuXYWangSY, et al.
Automatic identification of ramie and cotton fibers using characteristics in longitudinal view, part II: fiber stripes analysis. Text Res J2009;
79: 1547–1556.
12.
LuKLuoJZhongY, et al.
Identification of wool and cashmere SEM images based on surf features. J Eng Fibers Fabr2019;
14: 1–9.
13.
FengZLiangWTaoD, et al.
Cu-net: component unmixing network for textile fiber identification. Int J Comput Vis2019;
127: 1443–1454.
14.
XingWDengNXinB, et al.
Identification of extremely similar animal fibers based on matched filter and hog-svm. IEEE Access2019;
7: 98603–98617.
15.
ZhouCHanGViaBK, et al.
Rapid identification of fibers from different waste fabrics using the near-infrared spectroscopy technique. Text Res J2019;
89: 3610–3616.
16.
KampourisCZafeiriouSGhoshA, et al. Fine-grained material classification using micro-geometry and reflectance. In: eds B Leibe, J Matas, N Sebe, et al., proceedings of the European conference on computer vision, Amsterdam, Netherlands, 11–14 October 2016, paper no. P-1B-27, pp.778–792. Cham: Springer.
17.
OhiAQMridhaMFHamidMA, et al.
Fabricnet: a fiber recognition architecture using ensemble convnets. IEEE Access2021;
9: 13224–13236.
18.
ChenJDingJYuY, et al.
Thfuse: an infrared and visible image fusion network using transformer and hybrid feature extractor. Neurocomputing2023;
527: 71–82.
19.
ChenSFChenYCYehCK, et al.
Order-free RNN with visual attention for multi-label classification. Proc AAAI Conf Artif Intell2018;
32: 6714–6721.
20.
YangYYLinYAChuHM, et al. Deep learning with a rethinking structure for multi-label classification. In: eds WS Lee and T Suzuki. Asian conference on machine learning, Nagoya, Japan, 17-19 November 2019, paper no. paper no. 79, pp.125–140. New York: PMLR.
21.
LiangJXuFYuS.A multi-scale semantic attention representation for multi-label image recognition with graph networks. Neurocomputing2022;
491: 14–23.
22.
KhanNChaudhuriUBanerjeeB, et al.
Graph convolutional network for multi-label VHR remote sensing scene recognition. Neurocomputing2019;
357: 36–46.
23.
YouRGuoZCuiL, et al.
Cross-modality attention with semantic graph embedding for multi-label classification. Proc AAAI Conf Artif Intell2020;
34: 12709–12716.
24.
ZhaoJYanKZhaoY, et al. Transformer-based dual relation graph for multi-label image recognition. In:eds T Hassner, C Pal, Y Sato, et al., Proceedings of the IEEE/CVF international conference on computer vision, Montreal, QC, Canada, 10–17 October 2021, paper no. 2387, pp. 163–172. New York: IEEE.
25.
ZhaoJZhaoYLiJ. M3TR: multi-modal multi-label recognition with transformer. In: eds Y Yang, P Cesar, F Metze, et al., Proceedings of the 29th ACM International conference on multimedia, Chengdu, China, 20–24 October 2021, paper no. 195, p. 469–477. New York: ACM.
26.
ZhangRLuoSPanL, et al.
Strengthened multiple correlation for multi-label few-shot intent detection. Neurocomputing2023;
523: 191–198.
27.
XuSGuJHuaY, et al.
Dktnet: dual-key transformer network for small object detection. Neurocomputing2023;
525: 29–41.
28.
WuHXiaoBCodellaN, et al. CvT: introducing convolutions to vision transformers. In: eds T Hassner, C Pal, Y Sato, et al., proceedings of the IEEE/CVF international conference on computer vision (eds T Hassner, C Pal, Y Sato, et al), Montreal, QC, Canada, 10–17 October 2021, paper no. 2295, pp. 22–31. New York, NY: IEEE.
29.
PengBHeLQiuY, et al. Image-signal correlation network for textile fiber identification. In: eds V Oria, Q Jin, L Toni, et al., Proceedings of the 30th ACM International conference on multimedia, Lisbon, Portugal, 10–14 October 2022, paper no. 2448, pp. 3848–3856. New York: ACM.
CholletF. Xception: Deep learning with depthwise separable convolutions. In: eds J Rehg, Y Liu, Y Wu, et al., proceedings of the IEEE conference on computer vision and pattern recognition, Hawaii, USA, 21–26 July 2017, paper no. 451, pp. 1800–1807. New York: IEEE.
32.
VaswaniAShazeerNParmarN, et al. Attention is all you need. In: In: eds I. Guyon, UV Luxburg, S. Bengio, et al. 31st conference on neural information processing systems, Long Beach, CA, USA, 4-9 December 2017, paper no.124, pp. 5998–6008. New York: ACM.
33.
SuomelaJAVajantoKRäisänenR.Seeking nettle textiles – utilizing a combination of microscopic methods for fibre identification. Stud Conserv2018;
63: 412–422.
34.
MäkeläMRissanenMSixtaH.Identification of cellulose textile fibers. The Analyst2021;
146: 7503–7509.
35.
GuoJHanKWuH, et al. Cmt: convolutional neural networks meet vision transformers. In: eds K. Dana, G Hua, S. Roth, et al., Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, New Orleans, USA, 19-24 June 2022, paper no.151, pp. 12165–12175. New York: IEEE.
36.
YuanKGuoSLiuZ, et al. Incorporating convolution designs into visual transformers. In: eds T Hassner, C Pal, Y Sato, et al., Proceedings of the IEEE/CVF international conference on computer vision, Montreal, QC, Canada, 10–17 October 2021, paper no. 2593, pp. 579–588. New York: IEEE.
37.
RidnikTBenBEZamirN, et al. Asymmetric loss for multi-label classification. In: eds T Hassner, C Pal, Y Sato, et al. Proceedings of the IEEE/CVF international conference on computer vision, Montreal, QC, Canada, 10–17 October 2021, paper no. 7868, pp. 82–91. New York: IEEE.
38.
LiuSLZhangLYangX, et al. Query2label: a simple transformer way to multi-label classification. arXiv preprint arXiv:2107.10834.
39.
KingmaDPBaJL. Adam: a method for stochastic optimization. arXiv preprint arXiv:1412.6980.
40.
ChenZMWeiXSWangP, et al. Multi-label image recognition with graph convolutional networks. In: eds A Gupta, D Hoiem, G Hua, et al., Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, Long Beach, CA, USA, 15-20 June 2019, paper no. 63, pp. 5172–5181. New York: IEEE.
41.
ChenTXuMHuiX, et al. Learning semantic-specific graph representation for multi-label image recognition. In: eds IS Kweon, N Paragios, MH Yang, et al., Proceedings of the IEEE/CVF international conference on computer vision, Seoul, Korea (South), 27 October–3 November 2019, paper no.54, pp. 522–531. New York: IEEE.
42.
AlmetwallyAAMouradMM.Effects of spandex drawing ratio and weave structure on the physical properties of cotton/spandex woven fabrics. J Text Inst2014;
105: 235–245.
43.
HalilATěšinováPAboalasaadARR.Thermal comfort properties of cotton/spandex single jersey knitted fabric. Ind Textila2021;
72: 244–249.
