Intelligent Diagnosis of Potato Leaf Diseases Using NLSCTAN and GPT-4 Powered Multimodal Framework
DOI:
https://doi.org/10.29284/g3852831Keywords:
Potato Leaf Disease Detection, Multimodal Deep Learning, NLSCTAN, GPT-4 Integration, Precision AgricultureAbstract
To enhance crop production and ensure food security as well as reduce excessive use of chemical pesticides in the modern farming, it is important to detect potato leaf diseases early and precisely. However, environmental changes, the shortcomings of unimodal image based techniques, and visual symptom overlap have posed a hard task in disease recognmethition. The study offers an intelligent multimodal network of potent segmentation and classification of potato leaf diseases. It is constructed on the basis of the Normalized Long-Short Convoluted Temporal Attention Network and implemented thereof with a decision support system powered by GPT-4. This is aimed at addressing these issues. It has three primary divisions namely, the deep visual feature extraction branch (MSC-ResViT), the semantic and textual feature learning branch (MSC-TextCNN), and the color-texture representation branch (CT-CNN). These features are fused and the NLSCTAN classifies them into complex spatial-temporal connections. The outcomes of the experiments on the PlantVillage and Potato Leaf Disease datasets are promising. The proposed model has 98.2 and 95.6% accuracy rate on the PlantVillage and Potato Leaf Disease datasets respectively. The class-wise analysis shows that, the F1-score of the Healthy class is 0.95, the Early Blight class is 0.90, and the Late Blight class is 0.91. Moreover, the connection with GPT-4 enables the PotatoGPT platform to interpret illnesses and give practical treatment guidance in real-time, which can add greater practicality to the platform to be applied to precision agriculture.
References
1. Tuncer, Turker, Sengul Dogan, and Abdulhamit Subasi. "Surface EMG signal classification using ternary pattern and discrete wavelet transform based feature extraction for hand movement recognition." Biomedical signal processing and control 58 (2020): 101872.
2. Rahman, Kazi Naimur, Sajal Chandra Banik, Raihan Islam, and Arafath Al Fahim. "A real time monitoring system for accurate plant leaves disease detection using deep learning." Crop Design 4, no. 1 (2025): 100092.
3. Nyawose, Thandiwe, Rito Clifford Maswanganyi, and Philani Khumalo. "A review on the detection of plant disease using machine learning and deep learning approaches." Journal of Imaging 11, no. 10 (2025): 326.
4. Chen, Yongdong, and Wenfu Liu. "CBSNet: An Effective Method for Potato Leaf Disease Classification." Plants 14, no. 5 (2025): 632.
5. Fu, Jun, Yichen Zhao, and Gang Wu. "Potato leaf disease segmentation method based on improved UNet." Applied Sciences 13, no. 20 (2023): 11179.
6. Sinamenye, Jackson Herbert, Ayan Chatterjee, and Raju Shrestha. "Potato plant disease detection: leveraging hybrid deep learning models." BMC Plant Biology 25, no. 1 (2025): 647.
7. Islam, Md Manowarul, Md Abdul Ahad Adil, Md Alamin Talukder, Md Khabir Uddin Ahamed, Md Ashraf Uddin, Md Kamran Hasan, Selina Sharmin, Md Mahbubur Rahman, and Sumon Kumar Debnath. "DeepCrop: Deep learning-based crop disease prediction with web application." Journal of Agriculture and Food Research 14 (2023): 100764.
8. Singh, Gulbir, and Kuldeep Kumar Yogi. "Comparison of RSNET model with existing models for potato leaf disease detection." Biocatalysis and Agricultural Biotechnology 50 (2023): 102726.
9. Nazir, Tahira, Muhammad Munwar Iqbal, Sohail Jabbar, Ayyaz Hussain, and Mubarak Albathan. "EfficientPNet—an optimized and efficient deep learning approach for classifying disease of potato plant leaves." Agriculture 13, no. 4 (2023): 841.
10. Nazarov, Pavel A., Dmitry N. Baleev, Maria I. Ivanova, Luybov M. Sokolova, and Marina V. Karakozova. "Infectious plant diseases: etiology, current status, problems and prospects in plant protection." Acta naturae 12, no. 3 (2020): 46.
11. Wijesinha-Bettoni, Ramani, and Béatrice Mouillé. "The contribution of potatoes to global food security, nutrition and healthy diets." American Journal of Potato Research 96, no. 2 (2019): 139-149.
12. Shoaib, Muhammad, Babar Shah, Shaker Ei-Sappagh, Akhtar Ali, Asad Ullah, Fayadh Alenezi, Tsanko Gechev, Tariq Hussain, and Farman Ali. "An advanced deep learning models-based plant disease detection: A review of recent research." Frontiers in Plant Science 14 (2023): 1158933.
13. Arshad, Fizzah, Muhammad Mateen, Shaukat Hayat, Maryam Wardah, Zaid Al-Huda, Yeong Hyeon Gu, and Mugahed A. Al-antari. "PLDPNet: End-to-end hybrid deep learning framework for potato leaf disease prediction." Alexandria Engineering Journal 78 (2023): 406-418.
14. Astuti, Tri, Amri Nurkholis Umar, Rizki Wahyudi, and Zanuar Rifai. "Enhancing Potato Leaf Disease Detection: Implementation of Convolutional Vision Transformers with Synthetic Datasets from Stable Diffusion." JOIV: International Journal on Informatics Visualization 8, no. 4 (2024): 2054-2065.
15. Pacal, Ishak. "Enhancing crop productivity and sustainability through disease identification in maize leaves: Exploiting a large dataset with an advanced vision transformer model." Expert Systems with Applications 238 (2024): 122099.
16. Xu, Yanlei, Zhiyuan Gao, Jingli Wang, Yang Zhou, Jian Li, and Xianzhang Meng. "A two-stage approach to the study of potato disease severity classification." Agriculture 14, no. 3 (2024): 386.
17. Gupta, Hemant Kumar, and Hare Ram Shah. "Deep learning-based approach to identify the potato leaf disease and help in mitigation using IOT." SN Computer Science 4, no. 4 (2023): 333.
18. Ali, Safdar, Mehdi Hassan, Jin Young Kim, Muhammad Imran Farid, Muhammad Sanaullah, and Hareem Mufti. "FF-PCA-LDA: intelligent feature fusion based PCA-LDA classification system for plant leaf diseases." Applied Sciences 12, no. 7 (2022): 3514.
19. Mahum, Rabbia, Haris Munir, Zaib-Un-Nisa Mughal, Muhammad Awais, Falak Sher Khan, Muhammad Saqlain, Saipunidzam Mahamad, and Iskander Tlili. "A novel framework for potato leaf disease detection using an efficient deep learning model." Human and Ecological Risk Assessment: An International Journal 29, no. 2 (2023): 303-326.
20. Yeswanth, Pujari Venkata, Rachit Khandelwal, and S. Deivalakshmi. "Super resolution-based leaf disease detection in potato plant using broad deep residual network (BDRN)." SN Computer Science 4, no. 2 (2022): 112.
21. Al-Adhaileh, Mosleh Hmoud, Amit Verma, Theyazn HH Aldhyani, and Deepika Koundal. "Potato blight detection using fine-tuned CNN architecture." Mathematics 11, no. 6 (2023): 1516.
22. Oishi, Yu, Harshana Habaragamuwa, Yu Zhang, Ryo Sugiura, Kenji Asano, Kotaro Akai, Hiroyuki Shibata, and Taketo Fujimoto. "Automated abnormal potato plant detection system using deep learning models and portable video cameras." International Journal of Applied Earth Observation and Geoinformation 104 (2021): 102509.
23. Bajpai, Abhishek, Yogesh Pal, Shalinee Sahu, and Vivek Srivastava. "Enhanced Potato Leaf Disease Detection through Multi-Modal Fusion of Graph Neural Networks and ResNet18." In 2024 IEEE 16th International Conference on Computational Intelligence and Communication Networks (CICN), pp. 1498-1504. IEEE, 2024.
24. BHAVANI, GIRIGULA DURGA, and MUKKOTI MARUTHI VENKATA CHALAPATHI. "A HYBRID DEEP LEARNING FRAMEWORK FOR ACCURATE AND EFFICIENT DETECTION OF POTATO LEAF DISEASES." Journal of Theoretical and Applied Information Technology 103, no. 7 (2025).
25. Abbas, Ahmed, Umair Maqsood, Saif Ur Rehman, Khalid Mahmood, Tahani AlSaedi, and Mahwish Kundi. "An artificial intelligence framework for disease detection in potato plants." Engineering, Technology & Applied Science Research 14, no. 1 (2024): 12628-12635.
26. Ghosh, Mridul, Asifuzzaman Lasker, Poushali Banerjee, Anindita Manna, Sk Md Obaidullah, Teresa Gonçalves, and Kaushik Roy. "Plant disease detection and classification using a deep learning-based framework." In International Conference on Intelligent Data Engineering and Automated Learning, pp. 39-50. Cham: Springer Nature Switzerland, 2023.
27. Kolluri, Johnson, Sandeep Kumar Dash, and Ranjita Das. "Plant disease identification based on multimodal learning." International Journal of Intelligent Systems and Applications in Engineering 12, no. 15s (2024): 634-643.
28. Wu, Xingcai, Jiawei Zhang, Ziang Zou, Chaojie Chen, Ya Yu, Peijia Yu, Yuanyuan Xiao, Qi Wang, W. M. W. W. Kandegama, and Gefei Hao. "PlantIF: Multimodal Semantic Interactive Fusion via Graph Learning for Plant Disease Diagnosis." Plant Phenomics (2025): 100132.
29. Nasir, Nimra, Shabana Ramzan, Basharat Ali, Sohail Jabbar, Ali Raza, Changgyun Kim, Muhammad Syafrudin, and Norma Latif Fitriyani. "Interpretable deep multimodal-based tomato disease diagnosis and severity estimation." Scientific Reports 15, no. 1 (2025): 37919.
30. Alhammad, Sarah M., Doaa Sami Khafaga, Walaa M. El-Hady, Farid M. Samy, and Khalid M. Hosny. "Deep learning and explainable AI for classification of potato leaf diseases." Frontiers in Artificial Intelligence 7 (2025): 1449329.
31. Dame, Tadesse Assefa, Gashaw Bekele Adera, and Dagne Walle Girmaw. "Deep learning-based potato leaf disease classification and severity assessment." Discover Applied Sciences 7, no. 7 (2025): 649.
32. Zhang, Chunhui, Shuai Wang, Chunguang Wang, Haichao Wang, Yingjie Du, and Zheying Zong. "Research on a Potato Leaf Disease Diagnosis System Based on Deep Learning." Agriculture 15, no. 4 (2025): 424.
33. THALOR, MEENAKSHI, MRUNAL PATHAK, RIYAZAHEMED JAMADAR, and SHAHBAZ KHAN. "Potato Leaf Insight: An AI-Driven System for Detection of Potato Leaf Disease." Current Agriculture Research Journal 12, no. 3 (2024).
34. https://www.kaggle.com/datasets/muhammadardiputra/potato-leaf-disease-dataset
35. https://www.kaggle.com/datasets/emmarex/plantdisease
36. Sinamenye, Jackson Herbert, Ayan Chatterjee, and Raju Shrestha. "Potato plant disease detection: leveraging hybrid deep learning models." BMC Plant Biology 25, no. 1 (2025): 647.
37. Singh, Aditi, and Harjeet Kaur. "Potato plant leaves disease detection and classification using machine learning methodologies." In IOP Conference Series: Materials Science and Engineering, vol. 1022, no. 1, p. 012121. IOP Publishing, 2021.
38. Pasalkar, Jayashree, Ganesh Gorde, Chaitanya More, Sanket Memane, and Vaishnavi Gaikwad. "Potato leaf disease detection using machine learning." Current Agriculture Research Journal 11, no. 3 (2023).
Downloads
Published
Issue
Section
License
This work is licensed under a Creative Commons Attribution 4.0 International License.
This work is licensed under a Creative Commons Attribution 4.0 International License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
