Deep Learning for Early Detection of Crop Pathogens: A Multimodal Fusion Framework Leveraging Hyperspectral Imaging and Climate Data in Precision Agriculture
Article Sidebar
Main Article Content
Abstract
This research introduces a multimodal deep learning framework for early detection of plant pathogens to capture pre-symptomatic biochemical changes in plants while simultaneously modeling the environmental drivers of disease development. A hybrid fusion architecture combines 3D convolutional neural networks for spatial-spectral feature extraction from HSI cubes with transformer-primarily based temporal modeling of climate sequences. Cross-modal attention mechanisms dynamically weight discriminative features, which includes chlorophyll degradation bands and humidity thresholds, to permit joint representation learning. The framework achieved 94.5% accuracy in pathogen detection, outperforming unimodal HSI (84.1%) and climate- only (76.5%) baselines by 10-18 percentage points. Moreover, it detected fungal infections 5-7 days before visual symptom onset and had a 12.3% higher F1-rating compared to the current methods. Field simulations showed that precision application resulted in 41% reduction in fungicide use. By connecting proximal sensing with climatic analytics, this research contributes to precision agriculture by providing timely and eco-friendly pest control of diseases. The multimodal fusion framework is introduced to overcome the limitations of unimodal approaches. It integrates the most appropriate data sources, thus allowing the earliest and most accurate detection of plant pathogens.
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
Copyright Transfer Statement
The copyright of this article is transferred to Current Applied Science and Technology journal with effect if and when the article is accepted for publication. The copyright transfer covers the exclusive right to reproduce and distribute the article, including reprints, translations, photographic reproductions, electronic form (offline, online) or any other reproductions of similar nature.
The author warrants that this contribution is original and that he/she has full power to make this grant. The author signs for and accepts responsibility for releasing this material on behalf of any and all co-authors.
Here is the link for download: Copyright transfer form.pdf
References
Ahmad, A., Saraswat, D., & El Gamal, A. (2023). A survey on using deep learning techniques for plant disease diagnosis and recommendations for development of appropriate tools. Smart Agricultural Technology, 3, Article 100083. https://doi.org/10.1016/j.atech.2022.100083
Ali, F., Rehman, A., Hameed, A., Sarfraz, S., Rajput, N. A., & Atiq, M. (2024). Climate change impact on plant pathogen emergence: Artificial intelligence (AI) approach. In K. A. Abd-Elsalam, & S. M. Abdel-Momen (Eds.). Plant quarantine challenges under climate change anxiety (pp. 281-303). Springer. https://doi.org/10.1007/978-3-031-56011-8_9
Al Mamun, A., Ahmedt-Aristizabal, D., Zhang, M., Hossen, M. I., Hayder, Z., & Awrangjeb, M. (2024). Plant disease detection using self-supervised learning: A systematic review. IEEE Access, 12, 171926-171943. https://doi.org/10.1109/ACCESS.2024.3475819
Al-Safi, M. T., & Qasim, M. T. (2023). Study of some genetic and molecular markers for some rheumatoid arthritis patients in Iraq. Bionatura, 8(3), 1-13.
Bertalan, L., Holb, I., Pataki, A., Négyesi, G., Szabó, G., Szalóki, A. K., & Szabó, S. (2022). UAV-based multispectral and thermal cameras to predict soil water content: A machine learning approach. Computers and Electronics in Agriculture, 200, Article 107262. https://doi.org/10.1016/j.compag.2022.107262
Bock, C. H., Chiang, K. S., & Del Ponte, E. M. (2022). Plant disease severity estimated visually: A century of research, best practices, and opportunities for improving methods and practices to maximize accuracy. Tropical Plant Pathology, 47(1), 25-42. https://doi.org/10.1007/s40858-021-00439-z
Carreira, V. D. S., Nuyttens, D., Langenakens, J., Pereira, J. V., & da Silva, R. P. (2023). Smartphone image-based framework for quick, non-invasive measurement of spray characteristics. Smart Agricultural Technology, 3, Article 100120. https://doi.org/10.1016/j.atech.2022.100120
FAO. (2023). The state of food security and nutrition in the world 2023. FAO. https://doi.org/10.4060/cc3017en
Feng, G., Gu, Y., Wang, C., Zhou, Y., Huang, S., & Luo, B. (2024). Wheat Fusarium head blight automatic non-destructive detection based on multi-scale imaging: A technical perspective. Plants, 13(13), Article 1722. https://doi.org/10.3390/plants13131722
Fetch, T. G., Park, R. F., Pretorius, Z. A., & DePauw, R. M. (2021). Stem rust: Its history in Kenya and research to combat a global wheat threat. Canadian Journal of Plant Pathology, 43(Sup. 2), S275-S297. https://doi.org/10.1080/07060661.2021.1902860
Garg, S., Pundir, P., Jindal, H., Saini, H., & Garg, S. (2021). Towards a multimodal system for precision agriculture using IoT and machine learning. In Proceedings of the 12th International Conference on Computing Communication and Networking Technologies (ICCCNT) (pp. 1-7). IEEE. https://doi.org/10.1109/ICCCNT51525.2021.9579646
Ghaffar, A., Rahman, M. H. U., Ahmed, S., Haider, G., Ahmad, I., Khan, M. A., Afzaal, M., Ahmed, S., Fahad, S., Hussain, J., & Ahmed, A. (2022). Adaptations in cropping system and pattern for sustainable crops production under climate change scenarios. In S. Fahad, M. Adnan, & S. Saud (Eds.) Improvement of plant production in the era of climate change (pp. 1-34). CRC Press. https://doi.org/10.1201/9781003286417-1
Grishina, A., Sherstneva, O., Mysyagin, S., Brilkina, A., & Vodeneev, V. (2024). Detecting plant infections: Prospects for chlorophyll fluorescence imaging. Agronomy, 14(11), Article 2600. https://doi.org/10.3390/agronomy14112600
Gullino, M. L., Albajes, R., Al-Jboory, I., Angelotti, F., Chakraborty, S., Garrett, K. A., Hurley, B. P., Juroszek, P., Lopian, R., Makkouk, K., Pan, X., Pugliese, M., & Stephenson, T. (2022). Climate change and pathways used by pests as challenges to plant health in agriculture and forestry. Sustainability, 14(19), Article 12421. https://doi.org/10.3390/su141912421
Li, J., Hong, D., Gao, L., Yao, J., Zheng, K., Zhang, B., & Chanussot, J. (2022). Deep learning in multimodal remote sensing data fusion: A comprehensive review. International Journal of Applied Earth Observation and Geoinformation, 112, Article 102926. https://doi.org/10.1016/j.jag.2022.102926
Li, L., Zhang, S., & Wang, B. (2021). Plant disease detection and classification by deep learning: A review. IEEE Access, 9, 56683-56698. https://doi.org/10.1109/ACCESS.2021.3069646
Lu, Y., Lu, X., Zheng, L., Sun, M., Chen, S., Chen, B., Wang, T., Yang, J., & Lv, C. (2024). Application of multimodal transformer model in intelligent agricultural disease detection and question-answering systems. Plants, 13(7), Article 972. https://doi.org/10.3390/plants13070972
Mittler, R., Zandalinas, S. I., Fichman, Y., & Van Breusegem, F. (2022). Reactive oxygen species signalling in plant stress responses. Nature Reviews Molecular Cell Biology, 23(10), 663-679. https://doi.org/10.1038/s41580-022-00499-2
Nurullah, M. (2024). Advancing explainability in multi-label classification for tomato disease detection using machine learning interpretability techniques. [Master’s thesis, Columbus State University]. CSU ePress. https://csuepress.columbusstate.edu/theses_dissertations/544/
Pan, H., Gao, F., Dong, J., & Du, Q. (2023). Multiscale adaptive fusion network for hyperspectral image denoising. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 16, 3045-3059. https://doi.org/10.1109/JSTARS.2023.3257051
Patel, D., Bhise, S., Kapdi, S. S., & Bhatt, T. (2024). Non-destructive hyperspectral imaging technology to assess the quality and safety of food: A review. Food Production, Processing and Nutrition, 6(1), Article 69. https://doi.org/10.1186/s43014-024-00246-4
Qasim, M. T., & Mohammed, Z. I. (2024a). Investigating treatment response and viral immunity in early rheumatoid arthritis via immune response profiling. Journal of Rare Cardiovascular Diseases, 4(8), 166-173.
Qasim, M. T., & Mohammed, Z. I. (2024b). The association of Helicobacter pylori infection and virulence factors in gastric cancer in Thi-Qar, Iraq. Asian Pacific Journal of Cancer Biology, 9(4), 541-545. https://doi.org/10.31557/APJCB.2024.9.4.541
Qasim, M. T., & Mohammed, Z. I. (2025). The impact of glomerulonephritis on cardiovascular disease: Exploring pathophysiological links and clinical implications. Journal of Cardiovascular Disease, 5(1), 3-8.
Qasim, M. T., Alakkam, E. M. M., Mohammed, M. M., Hachim, S. K., Jabr, H. S., Izzat, S. E., Mohammed, K. A., Hamood, S. A., Ali, M. S., Obaid, F. N., & Al-Dhalemi, D. M. (2022a). Ovine pasteurellosis vaccine: Assessment of the protective antibody titer and recognition of the prevailing serotypes. Archives of Razi Institute, 77(3), 1207-1210. https://doi.org/10.22092/ARI.2022.358759.2303
Qasim, M. T., Fenjan, M. N., & Thijail, H. A. (2022b). Molecular identification of Cystoisospora belli in patients infected with human immunodeficiency virus. International Journal of Drug Delivery Technology, 12(2), 701-704. https://doi.org/10.25258/ijddt.12.2.42
Qasim, M. T., Hameed, L. A., & Mohammed, Z. I. (2025). Exploring the immunological and physiological effects of Zingiber officinale on women with ovarian cancer in Iraq. Asian Pacific Journal of Cancer Biology, 10(2), 261-268. https://doi.org/10.31557/apjcb.2025.10.2.261-268
Ruan, C., Dong, Y., Huang, W., Huang, L., Ye, H., Ma, H., Guo, A., & Ren, Y. (2021). Prediction of wheat stripe rust occurrence with time series Sentinel-2 images. Agriculture, 11(11), Article 1079. https://doi.org/10.3390/agriculture11111079
Sarić, R., Nguyen, V. D., Burge, T., Berkowitz, O., Trtílek, M., Whelan, J., Lewsey, M. G., & Čustović, E. (2022). Applications of hyperspectral imaging in plant phenotyping. Trends in Plant Science, 27(3), 301-315. https://doi.org/10.1016/j.tplants.2021.12.003
Sharma, K., & Shivandu, S. K. (2024). Integrating artificial intelligence and Internet of Things (IoT) for enhanced crop monitoring and management in precision agriculture. Sensors International, 5, Article 100292. https://doi.org/10.1016/j.sintl.2024.100292
Shoaib, M., Shah, B., El-Sappagh, S., Ali, A., Ullah, A., Alenezi, F., Gechev, T., Hussain, T., & Ali, F. (2023). Advanced deep learning models-based plant disease detection: A review of recent research. Frontiers in Plant Science, 14, Article 1158933. https://doi.org/10.3389/fpls.2023.1158933
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., & Wojna, Z. (2016). Rethinking the inception architecture for computer vision. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (pp. 2818-2826). IEEE.
Terentev, A., Badenko, V., Shaydayuk, E., Emelyanov, D., Eremenko, D., Klabukov, D., Fedotov, A., & Dolzhenko, V. (2023). Hyperspectral remote sensing for early detection of wheat leaf rust caused by Puccinia triticina. Agriculture, 13(6), Article 1186. https://doi.org/10.3390/agriculture13061186
United Nations. (2023). Goal 2: End hunger, achieve food security and improved nutrition and promote sustainable agriculture. https://sdgs.un.org/goals/goal2
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017). Attention is all you need. In I. Guyon, U. V. Luxburg, S. Bengio, H. Wallach, R. Fergus, S. V. N. Vishwanathan, & R. Garnett (Eds.) Advances in neural information processing systems 30 (pp. 5999-6009). NIPS.
Wang, D., Zhang, D.-D., Song, J., Li, J.-J., Wang, J., Li, R., Klosterman, S. J., Kong, Z.-Q., Lin, F.-Z., Dai, X.-F., Subbarao, K. V., & Chen, J.-Y. (2022a). Verticillium dahliae CFEM proteins manipulate host immunity and differentially contribute to virulence. BMC Biology, 20(1), Article 55. https://doi.org/10.1186/s12915-022-01254-x
Wang, Y., Albrecht, C. M., Braham, N. A. A., Mou, L., & Zhu, X. X. (2022b). Self-supervised learning in remote sensing: A review. IEEE Geoscience and Remote Sensing Magazine, 10(4), 213-247. https://doi.org/10.1109/MGRS.2022.3198244
Yoseph, B. (2024). Ethiopian coffee leaf disease detection using deep learning. [Master’s thesis, St. Mary’s University]. St. Mary’s University Institutional Repository. http://repository.smuc.edu.et/bitstream/123456789/7873/1/20.%20Biniyam%20Yoseph.pdf
Zhang, Z., Zhao, Y., Duan, J., Liu, Y., Zheng, H., Liang, D., Zhang, Z., & Li, Z.-C. (2024). Pathology-genomic fusion via biologically informed cross-modality graph learning for survival analysis. arXiv. https://doi.org/10.48550/arXiv.2404.08023
Zheng, Q., Huang, W., Xia, Q., Dong, Y., Ye, H., Jiang, H., Chen, S., & Huang, S. (2023). Remote sensing monitoring of rice diseases and pests from different data sources: A review. Agronomy, 13(7), Article 1851. https://doi.org/10.3390/agronomy13071851
Zhou, J., Li, J., Wang, C., Wu, H., Zhao, C., & Teng, G. (2021a). Crop disease identification and interpretation method based on multimodal deep learning. Computers and Electronics in Agriculture, 189, Article 106408. https://doi.org/10.1016/j.compag.2021.106408
Zhou, X.-G., Zhang, D., & Lin, F. (2021b). UAV remote sensing: An innovative tool for detection and management of rice diseases. In D. Kurouski (Ed.). Diagnostics of plant diseases (pp. 1-25). IntechOpen. https://doi.org/10.5772/intechopen.95535
