CycleGAN based confusion model for cross-species plant disease image migration

Abstract

The identification and classification of plant diseases is of great significance to ecological protection and deep learning methods have made a great of progress in the common plant diseases identification for specific plant. While faced with the same plant disease of other plants, due to the insufficient or low quality training data, current deep learning methods will be difficult to identify the diseases effectively and accurately. Inspired by the advantages of GAN in dataset expansion, we propose the CycleGAN based confusion model in this paper. In this paper, GAN framework is improved by adding noise label and learn together during training stage, which migrates the data of common plant diseases to the plants with insufficient or low quality data. In order to evaluate the quality of the migrated training dataset among different GAN approaches, we introduce the quality indicators of the migration images such as MMD, FID, EMD etc. We compare our model with other GANs model, and the experimental results show that the proposed model obtains better results in the migration process, which make it more effective for the identification of cross species plant diseases.

Keywords

Deep learning generative adversarial nets CycleGAN image translation

Get full access to this article

View all access options for this article.

References

Arsenovic

, Karanovic

, Sladojevic

, et al., Solving current limitations of deep learning based approaches for plant disease detection[J], Symmetry 11(7) (2019), 939.

Cap

Q.H.

, Uga

, Kagiwada

, et al., Leafgan: An effective data augmentation method for practical plant disease diagnosis[J], IEEE Transactions onAutomation Science and Engineering, 2020.

Cho

, Van Merriënboer,

, Bahdanau,

, et al., On the properties of neural machine translation: Encoder-decoder approaches[J], arXiv preprint arXiv:1409.1259, 2014.

Ferentinos

K.P.

, Deep learning models for plant disease detection and diagnosis[J], Computers and Electronics in Agriculture 145 (2018), 311–318.

Fang

and Ramasamy

R.P.

, Current and prospective methods for plant disease detection[J], Biosensors 5(3) (2015), 537–561.

Chandrasekaran

, Test Scheduling of Systemon-Chip Using Dragonfly and Ant Lion Optimization Algorithms[J], Journal of Intelligent and Fuzzy Systems 40(3) (2021), pp. 4905–4917. https://doi.org/10.3233/JIFS-201691

Ronneberger

, Fischer

and Brox

, U-net: Convolutional networks for biomedical image segmentation[C].//International Conference on Medical image computing and computerassisted intervention. Springer, Cham, (2015), 234–241.

Srivastava

R.K.

, Greff

and Schmidhuber

, Training very deep networks[J]. arXiv preprint arXiv:1507.06228, 2015.

Antoniou

, Storkey

and Edwards

, Data augmentation generative adversarial networks[J]. arXiv preprint arXiv:1711.04340, 2017.

10.

Goodfellow

I.J.

, Pouget-Abadie

, Mirza

, et al., Generative adversarial networks[J]. arXiv preprint arXiv:1406.2661, 2014.

11.

, Xu

, Zhu

, et al., Triple generative adversarial nets[J]. arXiv preprint arXiv:1703.02291, 2017.

12.

Mirza

and Osindero

, Conditional generative adversarialnets[J]. arXiv preprint arXiv:1411.1784, 2014.

13.

, Zhang

, Tan

, et al., Dualgan: Unsupervised dual learning for image-to-image translation[C].//Proceedings of the IEEE international conference on computer vision (2017), 2849–2857.

14.

Zhu

J.Y.

, Park

, Isola

, et al., Unpaired imagetoimage translation using cycle-consistent adversarial networks[C].// Proceedings of the IEEE international conference on computer vision (2017), 2223–2232.

15.

Almahairi

, Rajeshwar

, Sordoni

, et al., Augmented cyclegan: Learning many-to-many mappings from unpaired data[C].// International Conference on Machine Learning. PMLR (2018), 195–204.

16.

Karras

, Laine

and Aila

, A style-based generator architecture for generative adversarial networks[C].// Proceedings of the IEEE/CVF Conference on Computer Vision Pattern Recognition (2019), 4401–4410.

17.

Sandfort

, Yan

, Pickhardt

P.J.

, et al., Data augmentation using generative adversarial networks (CycleGAN) to improve generalizability in CT segmentation tasks[J], Scientific Reports 9(1) (2019), 1–9.

18.

Hammami

, Friboulet

and Kechichian

, Cycle GANBased Data Augmentation for Multi-Organ Detection in CT Images Via Yolo[C]// 2020 IEEE International Conference on Image Processing (ICIP). IEEE (2020), 390–393.

19.

, Zhang

, Ren

, et al., Deep residual learning for image recognition[C].// Proceedings of the IEEE conference on computer vision and pattern recognition (2016), 770–778.

20.

Srivastava

, Hinton

, Krizhevsky

, et al., Dropout: a simple way to prevent neural networks from overfitting[J], The Journal of Machine Learning Research 15(1) (2014), 1929–1958.

21.

Fang

, Zhang

, Sheng

V.S.

, et al., A method for improving CNN-based image recognition using DCGAN[J], Computers, Materials and Continua 57(1) (2018), 167–178.

22.

Isola

, Zhu

J.Y.

, Zhou

, et al., Image-to-image translation with conditional adversarial networks[C].// Proceedings of the IEEE conference on computer vision and pattern recognition (2017), 1125–1134.

23.

, Wang

, Chen

, et al., Empirical evaluation of rectified activations in convolutional network[J]. arXiv preprint arXiv:1505.00853, 2015.

24.

Barratt

and Sharma

, A note on the inception score[J]. arXiv preprint arXiv:1801.01973, 2018.

25.

Wong

S.C.

, Gatt

, Stamatescu

, et al., Understanding data augmentation for classification: when to warp?[C].//2016 international conference on digital image computing: techniques and applications (DICTA). IEEE (2016), 1–6.

26.

Chandrasekaran

, Periyasamy

and Rajamanickam

K.P.

, Minimization of test time in system on chip using artificial intelligence-based test scheduling techniques[J], Neural Computing and Applications 32 (2020), 5303–5312. https://doi.org/10.1007/s00521-019-04039-6

27.

, Chen

, Huang

, et al., Enhanced pix2pix dehazing network[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (2019), 8160–8168.