Submit your papersSubmit Now
For Enquiries: [email protected]
IIARD LogoIIARD

Attention-Guided Residual Learning for Reliable Multi-Class Diabetic Retinopathy Severity Assessment

Confidence Chigozirim Olumba, Miracle Ugomma Anunobi, Precious Mojolaoluwa Ojo, Prisca Chimezie Opara, Benjamin Chiemeka Opara, Richard Iherorochi Nneji, Simon Onuwa Agbonifo, Wisdom Chima Olumba

Abstract

Diabetes is one of the most common metabolic diseases (DM) globally, accompanied by mild to severe secondary complications, including diabetic retinopathy (DR), which can damage the retina and lead to vision loss. DR detection is crucial, as early treatment of DR can effectively prevent vision loss in patients. Image processing systems have been developed for diabetic retinopathy (DR) screening to partially address the growing screening demands associated with the increasing diabetic population worldwide, but the inaccuracy of diabetic retinopathy diagnosis remains a key issue. This project aims to enhance diagnostic accuracy by developing a novel convolutional neural network model based on residual learning combined with self- attention mechanism, leveraging deep learning. The model achieved significant performance of 81% accuracy. These results underscore the effectiveness of the model in classifying the severity of diabetic retinopathy, indicating a major advancement in diagnostic methods.

Keywords

Convolutional Neural NetworkResNet50Deep LearningAttention MechanismDiabetic Retinopathy 1 Introduction Diabetes is a global problem in which the body's cells can't effectively use the insuli

References

Wang, D., Ouyang, J., Zhou, P., Yan, J., Shu, L., & Xu, X. (2021). A novel low-cost wireless footwear system for monitoring diabetic foot patients. IEEE Transactions on Biomedical Circuits and Systems, 15(1). Qiao, L., Zhu, Y., & Zhou, H. (2020). Diabetic retinopathy detection using prognosis of microaneurysm and early diagnosis system for non-proliferative diabetic retinopathy based on deep learning algorithms. IEEE Access, 8, 104292–104302. https://doi.org/10.1109/ACCESS.2020.2993937 Mustafa, H., Ali, S. F., Bilal, M., & Hanif, M. S. (2022). Multi-stream deep neural network for diabetic retinopathy severity classification under a boosting framework. IEEE Access, 10, 113172–113183. https://doi.org/10.1109/ACCESS.2022.3217216 Lim, J. I., et al. (2022). Artificial intelligence detection of diabetic retinopathy. Ophthalmology Science, 3(1), 100228. https://doi.org/10.1016/j.xops.2022.100228 Tufail, A., Rudisill, C., Egan, C., Kapetanakis, V. V., Salas-Vega, S., Owen, C. G., & Rudnicka, A. R. (2017). Automated diabetic retinopathy image assessment software: Diagnostic accuracy and cost-effectiveness compared with human graders. Ophthalmology, 124, 343–351. Meshram, A., Dembla, D., & Ajmera, R. (2021). Analysis and design of deep learning algorithms for retinal image classification for early detection of diabetic retinopathy. Turkish Journal of Computer and Mathematics Education, 12, 2633–2641. Yamashita, R., Nishio, M., Do, R. K. G., & Togashi, K. (2018). Convolutional neural networks: An overview and application in radiology. Insights into Imaging, 9(4). https://doi.org/10.1007/s13244-018-0639-9 Tavakoli, M. R., Sayedi, S. M., & Khaleghi, M. J. (2020). A high throughput hardware CNN accelerator using a novel multi-layer convolution processor. In 2020 28th Iranian Conference on Electrical Engineering (pp. 1–6). https://doi.org/10.1109/ICEE50131.2020.9260785 Devi, N., & Borah, B. (2018). Cascaded pooling for convolutional neural networks. In 2018 Fourteenth International Conference on Information Processing (ICINPRO) (pp. 1–5). https://doi.org/10.1109/ICINPRO43533.2018.9096860 H. Gholamalinezhad and H. Khosravi, 'Pooling Methods in Deep Neural Networks a Review', arXiv preprint, 2020 Sheng, M., Zeng, H., Li, J., & Sun, W. (2021). Pooling and convolution layer strategy on CNN for melanoma detection. In 2021 3rd International Conference on Machine Learning, Big Data and Business Intelligence (pp. 153–161). https://doi.org/10.1109/MLBDBI54094.2021.00038 Schmidhuber, J. (2015). Deep learning in neural networks: An overview. Neural Networks, 61, 85–117. https://doi.org/10.1016/j.neunet.2014.09.003 Xu, J., Li, Z., Du, B., Zhang, M., & Liu, J. (n.d.). Reluplex made more practical: Leaky ReLU. Lin, C.-L., & Wu, K.-C. (2023). Development of revised ResNet-50 for diabetic retinopathy detection. BMC Bioinformatics, 24(1), 157. https://doi.org/10.1186/s12859-023-05293-1 Sharma,V. K. H. (2024). Standard operating procedure : A review. https://doi.org/10.5281/ZENODO.13786656 Mishra, S., Hanchate, S., & Saquib, Z. (2020). Diabetic retinopathy detection using deep learning. In 2020 International Conference on Smart Technologies in Computing, Electrical and Electronics (ICSTCEE) (pp. 515–520). IEEE. Gangwar, A. K., & Ravi, V. (2021). Diabetic retinopathy detection using transfer learning and deep learning. In Evolution in Computational Intelligence (pp. 679–689). Springer. Kaggle. (2025). APTOS 2019 blindness detection.https://kaggle.com/aptos2019-blindness- detection ADCIS. (2025). Messidor. https://www.adcis.net/en/third-party/messidor/ Tymchenko, B., Marchenko, P., & Spodarets, D. (2020). Deep learning approach to diabetic retinopathy detection. arXiv Preprint, arXiv:2003.02261. Bhargavi, B., Madishetty, L., & Kandi, J. (2024). Diabetic retinopathy detection using ensemble of CNN architectures. In Modeling, Simulation and Optimization (pp. 385–396). Springer. https://doi.org/10.1007/978-981-99-6866-4_29 Qiao, L., Zhu, Y., & Zhou, H. (2020). Diabetic retinopathy detection using prognosis of microaneurysm and early diagnosis system for non-proliferative diabetic retinopathy based on deep learning algorithms. IEEE Access, 8, 104292–104302. He, K., Zhang, X., Ren, S., & Sun, J. (2015). Deep residual learning for image recognition. arXiv Preprint, arXiv:1512.03385. https://doi.org/10.48550/arXiv.1512.03385 Morin, A. (2011). Self-awareness part 1: Definition, measures, effects, functions, and antecedents. Social and Personality Psychology Compass, 5(10), 807– 823.https://doi.org/10.1111/j.1751-9004.2011.00387.x Selvaraju, R. R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., & Batra, D. (2020). Grad- CAM: Visual explanations from deep networks via gradient-based localization. International Journal of Computer Vision, 128(2), 336– 359.https://doi.org/10.1007/s11263-019-01228-7 Li, X., Wang, Y., Monday, H. N., & Nneji, G. U. (2025). A novel residual learning of multi- scale feature extraction model for the classification of rice grain varieties. Computers and Electronics in Agriculture, 237, 110491. Monday, H. N., Nneji, G. U., Hossin, M. A., Mark, K. D., Umana, E. S., Mgbejime, G. T., & Li, J. (2025). Enhancing ECG classification in cardiac diagnostics: A novel approach using adaptive focal cross-entropy loss function. IEEE Journal of Biomedical and Health Informatics. Nneji, G. U., Monday, H. N., Pathapati, V. S. R., Nahar, S., Mgbejime, G. T., Umana, E. S., & Hossin, M. A. (2025). FFS-IML: Fusion-based statistical feature selection for machine learning-driven interpretability of chronic kidney disease. International Journal of Machine Learning and Cybernetics, 1–34. Monday, H. N., Li, J., Nneji, G. U., Ukwuoma, C. C., Cai, J., Chikwendu, I., & Oluwasanmi, A. (2022). A wavelet convolutional capsule network with modified super-resolution generative adversarial network for fault diagnosis and classification. Complex & Intelligent Systems, 8(1), 1–15. https://doi.org/10.1007/s40747-022-00733-6 Monday, H. N., Li, J., Nneji, G. U., Hossin, M. A., Nahar, S., Jackson, J., & Chikwendu, I. A. (2022). WMR-DepthwiseNet: A wavelet multi-resolution depthwise separable convolutional neural network for COVID-19 diagnosis. Diagnostics, 12(3), 765.https://doi.org/10.3390/diagnostics12030765 Monday, H. N., Li, J., Nneji, G. U., Hossin, M. A., Nahar, S., Jackson, J., & Ejiyi, C. J. (2022). COVID-19 diagnosis from chest X-ray images using a robust multi-resolution analysis Siamese neural network with super-resolution CNN. Diagnostics, 12(3), 741.https://doi.org/10.3390/diagnostics12030741 Nneji, G. U., Cai, J., Deng, J., Monday, H. N., Hossin, M. A., Nahar, S., & Jackson, J. (2022). Fine-tuned Siamese network with modified enhanced SR-GAN plus for low-quality chest X-ray COVID-19 identification. Diagnostics, 12(3) https://doi.org/10.3390/diagnostics12030717 Nneji, G. U., Deng, J., Cai, J., Monday, H. N., Hossin, M. A., Nahar, S., & Jackson, J. (2022). COVID-19 identification from low-quality CT using a modified enhanced SR-GAN plus and Siamese capsule network. Healthcare, 10(2), 403. https://doi.org/10.3390/healthcare10020403