Vector mosquito bites can significantly impact quality of life, pose health risks, and even lead to death. Different mosquito species can transmit various diseases, and their blood-sucking behavior varies by sex. Therefore, accurately identifying mosquito species and gender in a given area is crucial for epidemic prevention. This study aimed to develop an image processing and artificial intelligence (AI) system to accurately identify mosquito species and gender using mosquito images. An image dataset consisting of 12,552, 17,152, and 9853 images, captured against white, yellow sticky, and blue sticky paper backgrounds, respectively, and covering eight mosquito species, was employed to develop an advanced identification system. This system integrates image processing methods, YOLO-V3 models for segmenting individual mosquito images, and Inception-V4 models for identifying mosquito species and determining their gender. The proposed models achieved impressive accuracy rates of 0.9806, 0.9888, and 0.9899 for species identification, and 0.8741, 0.9173, and 0.9241 for gender identification, corresponding to the white, yellow sticky, and blue sticky paper backgrounds, respectively. Overall, our system demonstrates a high level of accuracy in identifying both mosquito species and gender.
AliF, KhanS, AbbasAW, et al.A two-tier framework based on googlenet and yolov3 models for tumor detection in MRI. Comput Mater Contin2022;72:73.
2.
AsgariM, SadeghzadehA, IslamMB, et al.Deep learning-based vector mosquitoes classification for preventing infectious diseases transmission. Image Anal Stereol2022;41:203–215.
3.
BeckerN, PetrićD, ZgombaM, et al.2020. Mosquitoes: identification, ecology and control. Springer Nature.
4.
BenalcázarDR, BenítezDS, ZapataS, et al.Geometrical characterization of dipterans’ wings towards automatic mosquito identification. In: 2018 IEEE International Autumn Meeting on Power, Electronics and Computing (ROPEC). IEEE; 2018; pp. 1–6.
5.
BramRA. Contributions to the mosquito fauna of southeast Asia-II. The genus Culex in Thailand (Diptera: Culicidae). Contrib Am Entomol Inst1967;2(1)
6.
BuschbacherK, AhrensD, EspelandM, et al.Image-based species identification of wild bees using convolutional neural networks. Ecol Inform2020;55:101017.
7.
ChanA, ChiangL-P, HapuarachchiHC, et al.DNA barcoding: Complementing morphological identification of mosquito species in Singapore. Parasites Vectors2014;7(1):1–12.
8.
ChenF, WeiJ, XueB, et al.Feature fusion and kernel selective in Inception-v4 network. Appl Soft Comput2022;119:108582.
9.
ChenJ, LuY, YuQ, et al.Transunet: Transformers make strong encoders for medical image segmentation. arXiv Preprint2021; arXiv:2102.04306.
10.
CocheroJ, PattoriL, BalsalobreA, et al.A CONVOLUTIONAL neural network to recognize Chagas disease vectors using mobile phone images. Ecol Inform2022;68:101587.
11.
De NadaiB, MaletzkeA, CorbiJ, et al.The impact of body size on Aedes [Stegomyia] aegypti wingbeat frequency: Implications for mosquito identification. Med Vet Entomol2021;35(4):617–624.
12.
de SouzaA, MultiniLC, MarrelliMT, et al.Wing geometric morphometrics for identification of mosquito species (Diptera: Culicidae) of neglected epidemiological importance. Acta Trop2020;211:105593.
13.
DelfinadoMD. Contributions to the mosquito fauna of Southeast Asia. III. The genus Aedes, subgenus Neomacleaya Theobald in Southeast Asia. Contrib Am Entomol Inst1968;2(4):1–74.
14.
GenoudAP, GaoY, WilliamsGM, et al.A comparison of supervised machine learning algorithms for mosquito identification from backscattered optical signals. Ecol Inform2020;58:101090.
15.
GirshickR. Fast r-cnn. In: Proceedings of the IEEE international conference on computer vision (ICCV). IEEE; 2015; pp. 1440–48.
16.
GirshickR, DonahueJ, DarrellT, et al.Rich feature hierarchies for accurate object detection and semantic segmentation. In: Proceedings of the IEEE conference on computer vision and pattern recognition. IEEE; 2014; pp. 580–87.
17.
GonzalezCR, GuzmanC, AndreoV. Using VHR satellite imagery, OBIA and landscape metrics to improve mosquito surveillance in urban areas. Ecol Inform2023;77:102221.
18.
GoodwinA, PadmanabhanS, HiraS, et al.Mosquito species identification using convolutional neural networks with a multitiered ensemble model for novel species detection. Sci Rep2021;11(1):13656.
19.
HamesseC, AndreoV, GonzalezCR, et al.Ovitrap monitor-online application for counting mosquito eggs and visualisation toolbox in support of health services. Ecol Inform2023;75:102105.
20.
HeK, ZhangX, RenS, et al.Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition. IEEE; 2016; pp. 770–78.
21.
HuangR, GuJ, SunX, et al.A rapid recognition method for electronic components based on the improved YOLO-V3 network. Electronics (Basel)2019;8(8):825.
22.
HuangY-M. Contributions to the mosquito fauna of Southeast Asia. XIV. The subgenus Stegomyia of Aedes in Southeast Asia I-The scutellaris group of species. Contrib Am Entomol Inst1972;9(1)
23.
JoshiA, MillerC. Review of machine learning techniques for mosquito control in urban environments. Ecol Inform2021;61:101241.
24.
KalfasI, De KetelaereB, BunkensK, et al.Towards automatic insect monitoring on witloof chicory fields using sticky plate image analysis. Ecol Inform2023;75:102037.
25.
KangH-C, HanH-N, BaeH-C, et al.HSV color-space-based automated object localization for robot grasping without prior knowledge. Appl Sci2021;11(16):7593.
26.
KhalighifarA, Jiménez-GarcíaD, CampbellLP, et al.Application of deep learning to community-science-based mosquito monitoring and detection of novel species. J Med Entomol2022;59(1):355–362.
27.
KimD, DeBriereTJ, CherukumalliS, et al.Infrared light sensors permit rapid recording of wingbeat frequency and bioacoustic species identification of mosquitoes. Sci Rep2021;11(1):10042.
28.
KirillovA, MintunE, RaviN, et al.Segment anything. In: Proceedings of the IEEE/CVF international conference on computer vision (ICCV). IEEE; 2023; pp. 4015–26.
29.
KittichaiV, PengsakulT, ChumchuenK, et al.Deep learning approaches for challenging species and gender identification of mosquito vectors. Sci Rep2021;11(1):4838.
30.
KnightKL, StoneA. A catalog of the mosquitoes of the world (Diptera: Culicidae). 1977.
31.
KrishnaveniM, SubashiniP, DhivyaprabhaT, et al.Artificial Intelligence–Internet of Things Enabled Mosquito-Based Diseases Identification Trap. In: International conference on Variability of the Sun and sun-like stars: From Asteroseismology to space weather. Springer; 2022; pp. 797–816.
32.
KrizhevskyA, SutskeverI, HintonGE. Imagenet classification with deep convolutional neural networks. Adv Neural Inf Process Syst2012:25.
33.
LeeKY, ChungN, HwangS. Application of an Artificial Neural Network (ANN) model for predicting mosquito abundances in urban areas. Ecol Inform2016;36:172–180.
34.
LeeS, KimH, ChoB-K. Deep learning-based image classification for major mosquito species inhabiting Korea. Insects2023;14(6):526.
35.
LiZ, LiC, DengL, et al.Improved AlexNet with inception-V4 for plant disease diagnosis. Comput Intell Neurosci2022;2022:5862600.
36.
LianR-Q. 2004. Pictorial keys to the mosquitoes of Taiwan. Yi Hsien Publishing Co., Ltd.: Taiwan.
37.
LinT-Y, DollárP, GirshickR, et al.Feature pyramid networks for object detection. In: Proceedings of the IEEE conference on computer vision and pattern recognition. IEEE; 2017; pp. 2117–25.
38.
LiuW, AnguelovD, ErhanD, et al.Ssd: Single shot multibox detector. In: Computer Vision – ECCV 2016. ECCV 2016. Lecture Notes in Computer Science, Vol. 9905. Springer; 2016; pp. 21–37.
39.
MechaiS, BilodeauG, LungO, et al.Mosquito identification from bulk samples using DNA metabarcoding: A protocol to support mosquito-borne disease surveillance in Canada. J Med Entomol2021;58(4):1686–1700.
40.
NanniL, ManfèA, MaguoloG, et al.High performing ensemble of convolutional neural networks for insect pest image detection. Ecol Inform2022;67:101515.
41.
NebbakA, WillcoxAC, BitamI, et al.Standardization of sample homogenization for mosquito identification using an innovative proteomic tool based on protein profiling. Proteomics2016;16(24):3148–3160.
42.
NHRI. Book 2 - National Mosquito-borne Diseases Control Research Center - Collection of Lesson Plans for Dengue Fever Prevention and Control Education Course in Junior High Schools. National Mosquito-borne Diseases Control Research Center, National Health Research Institutes: Taiwan; 2020.
43.
NHRI. Taiwan Common Disease-carrying Mosquito Identification Handbook. National Mosquito-borne Diseases Control Research Center, National Health Research Institutes: Taiwan; 2016.
44.
OngS-Q, AhmadH, NairG, et al.Implementation of a deep learning model for automated classification of Aedes aegypti (Linnaeus) and Aedes albopictus (Skuse) in real time. Sci Rep2021;11(1):9908.
45.
PaimKO, RohwederR, Recamonde-MendozaM, et al.Acoustic identification of Ae. Aegypti mosquitoes using smartphone apps and residual convolutional neural networks. arXiv Preprint2023arXiv:2306.10091.
46.
ParvatiK, Prakasa RaoB, Mariya DasM. Image segmentation using gray‐scale morphology and marker‐ControlledWatershed transformation. Discrete Dyn Nat Soc2008;2008(1):384346.
47.
PotamitisI. Classifying insects on the fly. Ecol Inform2014;21:40–49.
48.
RaharimalalaF, AndrianinarivomananaT, RakotondrasoaA, et al.Usefulness and accuracy of MALDI‐TOF mass spectrometry as a supplementary tool to identify mosquito vector species and to invest in development of international database. Med Vet Entomol2017;31(3):289–298.
49.
RakotonirinaA, PolM, KainiuM, et al.MALDI-TOF MS: Optimization for future uses in entomological surveillance and identification of mosquitoes from New Caledonia. Parasit Vectors2020;13(1):1–12.
50.
RedmonJ, DivvalaS, GirshickR, et al.You only look once: Unified, real-time object detection. In: Proceedings of the IEEE conference on computer vision and pattern recognition. IEEE; 2016; pp. 779–88.
51.
RedmonJ, FarhadiA. Yolov3: An incremental improvement. arXiv Preprint2018arXiv:1804.02767.
52.
RenS, HeK, GirshickR, et al.Faster r-cnn: Towards real-time object detection with region proposal networks. IEEE Trans Pattern Anal Mach Intell2017;39(6):1137–1149.
53.
RuedaLM. Pictorial keys for the identification of mosquitoes (Diptera: Culicidae) associated with dengue virus transmission. Magnolia Press; 2004.
54.
ShowkatS, QureshiS. Efficacy of transfer learning-based ResNet models in chest X-ray image classification for detecting COVID-19 pneumonia. Chemometr Intell Lab Syst2022;224:104534.
55.
SiddiquaR, RahmanS, UddinJ. A deep learning-based dengue mosquito detection method using faster R-CNN and image processing techniques. AETiC2021;5(3):11–23.
56.
SimonyanK, ZissermanA. Very deep convolutional networks for large-scale image recognition. arXiv Preprint2014; arXiv:1409.1556.
SridharV, BreußM. Morphological sampling theorem and its extension to grey-value images. arXiv Preprint2023arXiv:2305.13279.
59.
SultanaF, SufianA, DuttaP. A review of object detection models based on convolutional neural network. In: Advances in Intelligent Systems and Computing. Springer: Singapore; 2020; pp. 1–16.
60.
SzegedyC, IoffeS, VanhouckeV, et al.Inception-v4, inception-resnet and the impact of residual connections on learning. AAAI2017;31(1).
61.
SzegedyC, LiuW, JiaY, et al.Going deeper with convolutions. In: 2015 Proceedings of the IEEE conference on computer vision and pattern recognition. IEEE; 2015; pp. 1–9.
TsaiC-F, HuangC-H, WuF-H, et al.Intelligent image analysis recognizes important orchid viral diseases. Front Plant Sci2022;13:1051348.
64.
TsaiCW, YehT-G, HsiaoY-R. Evaluation of hydrologic and meteorological impacts on dengue fever incidences in southern Taiwan using time-frequency analysis methods. Ecol Inform2018;46:166–178.
65.
WangT, ZhaoL, LiB, et al.Recognition and counting of typical apple pests based on deep learning. Ecol Inform2022;68:101556.
66.
WebbC, DoggettS, RussellR. 2016. A guide to mosquitoes of Australia. Csiro Publishing.
67.
WHO. Pictorial identification key of important disease vectors in the WHO South-East Asia Region. World Health Organization; 2020.
WilkersonRC, LintonY-M. Mosquitoes of the world. Johns Hopkins University Press: Baltimore, Maryland; 2021.
70.
WisaengK. Retinal blood-vessel extraction using weighted kernel fuzzy C-means clustering and dilation-based functions. Diagnostics (Basel)2023;13(3):342.
71.
WuD, YingY, ZhouM, et al.Improved ResNet-50 deep learning algorithm for identifying chicken gender. Comput Electron Agric2023;205:107622.
72.
XiaC, ChonT-S, RenZ, et al.Automatic identification and counting of small size pests in greenhouse conditions with low computational cost. Ecol Inform2015;29:139–146.
73.
YadavK, SarkarP, VeerV. Utility of male mosquito hypopygium in species identification. Int J Mosq Res2014;1:50–54.
74.
YangL, YuX, ZhangS, et al.GoogLeNet based on residual network and attention mechanism identification of rice leaf diseases. Comput Electron Agric2023;204:107543.
75.
YssoufA, ParolaP, LindströmA, et al.Identification of European mosquito species by MALDI-TOF MS. Parasitol Res2014;113(6):2375–2378.
76.
YuanH-Y, WenT-H, KungY-H, et al.Prediction of annual dengue incidence by hydro-climatic extremes for southern Taiwan. Int J Biometeorol2019;63(2):259–268.
77.
ZhaoD-Z, WangX-K, ZhaoT, et al.A swin transformer-based model for mosquito species identification. Sci Rep2022;12(1):18664.
