As prototype-based Few-Shot Learning methods, Prototypical Network generates prototypes for each class in a low-resource state and classify by a metric module. Therefore, the quality of prototypes matters but they are inaccurate from the few support instances, and the domain-specific information of training data are harmful to the generalizability of prototypes. We propose a Conceptual Prototype (CP), which contains both rich instance and concept features. The numerous query data can inspire the few support instances. An interactive network is designed to leverage the interrelation between support set and query-detached set to acquire a rich Instance Prototype which is typical on the whole data. Besides, class labels are introduced to prototype by prompt engineering, which makes it more conceptual. The label-only concept makes prototype immune to domain-specific information in training phase to improve its generalizability. Based on CP, Conceptual Prototypical Contrastive Learning (CPCL) is proposed where PCL brings instances closer to its corresponding prototype and pushes away from other prototypes. “2-way 5-shot” experiments show that CPCL achieves 92.41% accuracy on ARSC dataset, 2.30% higher than other prototype-based models. Meanwhile, the 0-shot performance of CPCL is comparable to Induction Network in the 5-shot way, indicating that our model is adequate for 0-shot tasks.
TianshiC., MarcL., SanjaF. A Theoretical Analysis of the Number of Shots in Few-Shot Learning, in: International Conference on Learning Representations, 2020.
2.
SnellJ., SwerskyK., ZemelR. Prototypical networks for few-shot learning, in: Advances in Neural Information Processing Systems (NIPS), 2017, pp. 4077–4087.
3.
GengR., LiB., LiY., ZhuX., JianP., SunJ. Induction Networks for Few-Shot Text Classification, in: Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), Hong Kong, China, Association for Computational Linguistics, 2019, pp. 3904–3913.
4.
Xu-DarmeR., Qu’enotG., ChihaniZ., RoussetM. Sanity checks and improvements for patch visualisation in prototype-based image classification ArXiv, abs/2302.08508.
5.
QuM., GaoT., XhonneuxL., TangJ. Few-shot relation extraction via bayesian meta-learning on relation graphs in: International Conference on Machine Learning, PMLR, 2020, pp. 7867–7876.
6.
GaoT., HanX., ZhuH., LiuZ., LiP., SunM., ZhouJ. FewRel 2.0: Towards more challenging fewshot relation classification, in: Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), Hong Kong, China, Association for Computational Linguistics, 2019, pp. 6250–6255.
7.
GaoT., HanX., LiuZ. and SunM., Hybrid attention-based prototypical networks for noisy few-shot relation classification, in: AAAI Conference on Artificial Intelligence33 (2019), 6407–6414.
8.
Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clarket al.Learning transferable visual models from natural language supervision, in: International Conference on Machine Learning, PMLR, 2021, pp. 8748–8763.
9.
Kaiyang Zhou, Jingkang Yang, Chen Change Loy, Ziwei Liu Learning to prompt for vision-language models, International Journal of Computer Vision (2022b), 1–12.
10.
Kaiyang Zhou, Jingkang Yang, Chen Change Loy, Ziwei Liu Conditional prompt learning for vision-language models, in: IEEE/CVF Conference on Computer Vision and Pattern Recognition (2022a), 16816–16825.
11.
JosephK.J., KhanS., KhanF.S., BalasubramanianV.N. Towards OpenWorld Object Detection, in: 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA, 2021, pp. 5826–5836, doi: 10.1109/CVPR46437.2021.00577.
12.
RahmanS., KhanS., BarnesN. Transductive Learning for Zero-Shot Object Detection, in: 2019 IEEE/CVF International Conference on Computer Vision (ICCV), Seoul, Korea (South), 2019, pp. 6081–6090, doi: 10.1109/ICCV.2019.00618.
13.
Hanoona Rasheed, Muhammad Maaz, Muhammad Uzair Khattak, Salman Khan, Fahad Shahbaz Khan, Bridging the gap between object and image-level representations for open-vocabulary detection, In Advances in Neural Information Processing Systems, 2022.
14.
KochG., ZemelR., SalakhutdinovR., ICML Deep Learning Workshop2 (2015), 0.
15.
SungF., YangY., ZhangL., XiangT., TorrP.H.S., HospedalesT.M. Learning to Compare: Relation Network for Few-Shot Learning, in: 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA, 2018, pp. 1199–1208, doi: 10.1109/CVPR.2018.00131.
16.
Dawid Rymarczyk, Lukasz Struski, Jacek Tabor, Bartosz Zielinski Protopshare: Prototypical parts sharing for similarity discovery in interpretable image classification, in: Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining, 2021.
17.
Dawid Rymarczyk,, Lukasz Struski, Michal G’orszczak, Koryna Lewandowska,, Jacek Tabor, Bartosz Zieli nski Interpretable image classification with differentiable prototypes assignment, in: European Conference on Computer Vision, 2021.
18.
Jonathan Donnelly, Alina Jade Barnett, Chaofan Chen Deformable protopnet: An interpretable image classifier using deformable prototypes, in: 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 10255–10265, 2022.
19.
Meike Nauta, Ron van Bree, Christin Seifert Neural prototype trees for interpretable fine-grained image recognition in: 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition 709 (CVPR), pages 14928–4938, 2021.
20.
Kahana Jonathan, Cohen Niv, Hoshen Yedid Improving Zero-Shot Models with Label Distribution Priors, 2022, arXiv:2212.00784
21.
DevlinJ., ChangM.-W., LeeK. BERT: Pretraining of deep bidirectional transformers for language understanding, in: Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies,NAACL-HLT2019, Minneapolis, MN, USA, June 2-7, 2019, Volume1(Long and Short Papers).Association for Computational Linguistics, pp. 4171–4186.
22.
Tom BrownB., Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert-Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Aditya Ramesh, Daniel ZieglerM., Jeffrey Wu, Clemens Winter, Christopher Hesse, Mark Chen, Eric Sigler, Mateusz Litwin, Scott Gray, Benjamin Chess, Jack Clark, Christopher Berner, Sam McCandlish, Alec Radford, Ilya Sutskever, Dario Amodei Language models are few-shot learners, in: 34th International Conference on Neural Information Processing Systems (NIPS’20). Curran Associates Inc., Red Hook, NY, USA, Article 159, 2020, pp. 1877–1901.
23.
Mark Chen, Jerry Tworek,, Heewoo Jun,, Qiming Yuan,, Henrique Ponde de Oliveira Pinto,et al. Evaluating large language models trained on code, 2021.
24.
Yoav Goldberg, Some remarks on large language models, 2023, URL https://gist.github.com/yoavg/59d174608e92e845c8994ac2e234c8a9.
25.
Timo Schick, Hinrich Schütze Exploiting cloze questions for few shot text classification and natural language inference, 2020, arXiv preprint arXiv:2001.07676
26.
Jason Wei,, Xuezhi Wang,, Dale Schuurmans, , Maarten Bosma,, Ed Chi,, Quoc Le, Denny Zhou, Chain of thought prompting elicits reasoning in large language models, 2022c, arXiv preprint arXiv:2201.11903.
27.
Ting Chen,, Simon Kornblith,, Mohammad Norouzi, Geoffrey Hinton, A simple framework for contrastive learning of visual representations, in: 37th International Conference on Machine Learning (ICML’20). 2020, JMLR.org, Article 149, 1597–1607.
Kaiming He, Haoqi Fan, Yuxin Wu, Saining Xie, Ross Girshick,Momentum contrast for unsupervised visual representation learning, in: CVPR, 2020.
30.
LiJ., ZhouP., XiongC., HoiS. Prototypical contrastive learning of unsupervised representations, in: International Conference on Learning Representation (ICLR), 2021.
31.
Xie Binhuiet al. SPCL: A New Framework for Domain Adaptive Semantic Segmentation via Semantic Prototypebased Contrastive Learning, 2021, ArXiv abs/2111.12358.
32.
Dejiao Zhang, Feng Nan, Xiaokai Wei, Shang-Wen Li,, Henghui Zhu,, Kathleen McKeown,, Ramesh Nallapati,Andrew ArnoldO.Bing Xiang, Supporting Clustering with Contrastive Learning, in: 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pages 5419–5430, Online. 2021, Association for Computational Linguistics.
33.
BateniP., BarberJ., van WoodJ.-W. Enhancing Few-Shot Image Classification with Unlabelled Examples, in: 2022 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), Waikoloa, HI, USA, 2022, pp. 1597–1606, doi: 10.1109/WACV51458.2022.00166.
34.
Mo Yu, Xiaoxiao Guo, Jinfeng Yi, Shiyu Chang, Saloni Potdar, Yu Cheng, Gerald Tesauro, HaoyuWang, Bowen Zhou Diverse few-shot text classification with multiple metrics, in: 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2018, V olume 1 (Long Papers), pages 1206–1215.
Huang Shaohan, Dong Li, Wang Wenhui, Hao Yaru, Singhal Saksham, Ma Shuming, Lv Tengchao,, Cui Lei, Mohammed Owais, Liu Qiang,, Aggarwal Kriti,, Chi Zewen, Bjorck Johan, Chaudhary Vishrav, Som Subhojit, Song Xia, Wei Furu Language Is Not All You Need: Aligning Perception with Language Models, 2023, 10.48550/arXiv.2302.14045.
37.
HanC., FanZ., ZhangD., QiuM., GaoM., ZhouA. Meta-Learning Adversarial Domain Adaptation Network for Few-Shot Text Classification, in: ACL/IJCNLP, 2021, 1664–1673.
38.
ChenJ., ZhangR., MaoY., XuJ. ContrastNet: A Contrastive Learning Framework for Few-Shot Text Classification, in: AAAI, 2022. 10492–10500.
