Explainable Artificial Intelligence (XAI) for Distributed Systems: A Survey

Rizwan Saleem; Nazia Akram; Misbah Aziz Rajput; Imran Mahmood

doi:10.55524/ijircst.2025.13.6.2

Abstract

Black-box artificial intelligence (AI) models and their nature are such that it does not permit end-users to perceive or sometime reliance the outputs created by that type of model. Artificial Intelligence applications, where not only the solutions but also the selection paths that are lead to the solution are also important, like black-box Artificial Intelligence models, are not enough. Explainable Artificial Intelligence delivers that type of job and specifies a bundle of Artificial Intelligence models which are explainable by the end users. Freshly, A number of Explainable Artificial Intelligence models have addressed this issue surrounded by deficiency of explainability and interpret-ability of the black-box models in several application domains like energy, healthcare, and financial areas. The idea of Explainable Artificial Intelligence has increased and is gaining for high attraction. Freshly, its combination into the different Distributed systems is under described and need attention. This paper contains a detailed systematic review of past studies by using Explainable Artificial Intelligence models in the environment of Distributed system domains. We grouped these findings and studies in accordance to their methodological analysis and domains. Our focus is on the problems, challenges plus different issues and provide different future directions to provide guidelines for the researchers and the developers for potential upcoming scenarios and investigations.

Keywords

Explainable Artificial Intelligence (XAI), Distributed Systems, Distributed computing, Explain-ability, Decentralization, Federated Learning

References

Adib Bin Rashid and M. A. K. Kausik, “AI revolutionizing industries worldwide: A comprehensive overview of its diverse applications,” Hybrid Advances, vol. 7, 2024. Available from: https://doi.org/10.1016/j.hybadv.2024.100277
Bokolo Anthony Jnr, “Artificial intelligence of things and distributed technologies as enablers for intelligent mobility services in smart cities—A survey,” Internet of Things, vol. 28, 2024. Available from: https://doi.org/10.1016/j.iot.2024.101399
V. Hassija, V. Chamola, A. Mahapatra, et al., “Interpreting Black-Box Models: A Review on Explainable Artificial Intelligence,” Cognitive Computation, vol. 16, pp. 45–74, 2024. Available from: https://link.springer.com/article/10.1007/s12559-023-10179-8
N. Janbi, I. Katib, and R. Mehmood, “Distributed artificial intelligence: Taxonomy, review, framework, and reference architecture,” Intelligent Systems with Applications, vol. 18, 2023. Available from: https://doi.org/10.1016/j.iswa.2023.200231
J. Olusegun, E. Frank, and I. Adeoye, Building Distributed Systems for Large-Scale AI Applications Using .NET Core, 2024. Available from: https://tinyurl.com/8ebxxb57
V. Rajapakse, I. Karunanayake, and N. Ahmed, “Intelligence at the Extreme Edge: A Survey on Reformable TinyML,” ACM Computing, 2023. Available from: https://doi.org/10.1145/3583683
K. Fatema, S. Dey, M. Anannya, R. Khan, M. Rashid, C. Su, and R. Mazumder, “Federated XAI IDS: An Explainable and Safeguarding Privacy Approach to Detect Intrusion Combining Federated Learning and SHAP,” Future Internet, vol. 17, p. 234, 2025. Available from: https://doi.org/10.3390/fi17060234
Y. Sanjalawe, S. Al-E’mari, S. Fraihat, et al., “AI-driven job scheduling in cloud computing: a comprehensive review,” Artificial Intelligence Review, vol. 58, p. 197, 2025. Available from: https://link.springer.com/article/10.1007/s10462-025-11208-8
M. Saarela and V. Podgorelec, “Recent applications of Explainable AI (XAI): A systematic literature review,” Applied Sciences, vol. 14, no. 19, p. 8884, 2024. Available from: https://doi.org/10.3390/app14198884
M. R. A. Berkani, A. Chouchane, Y. Himeur, A. Ouamane, S. Miniaoui, S. Atalla, W. Mansoor, and H. Al-Ahmad, “Advances in Federated Learning: Applications and Challenges in Smart Building Environments and Beyond,” Computers, 2025. Available from: https://doi.org/10.3390/computers14040124
A. Adadi and M. Berrada, “Peeking inside the black-box: a survey on explainable artificial intelligence (XAI),” IEEE Access, vol. 6, pp. 52138–52160, 2018. Available from: https://ieeexplore.ieee.org/abstract/document/8466590
R. Confalonieri, L. Coba, B. Wagner, and T. R. Besold, “A historical perspective of explainable artificial intelligence,” Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery, vol. 11, no. 1, p. e1391, 2021. Available from: https://doi.org/10.1002/widm.1391
R. Guidotti, A. Monreale, S. Ruggieri, et al., “A survey of methods for explaining black box models,” ACM Computing Surveys, vol. 51, no. 5, pp. 1–42, 2018. Available from: https://doi.org/10.1145/3236009
D. V. Carvalho, E. M. Pereira, and J. S. Cardoso, “Machine Learning Interpretability: A Survey on Methods and Metrics,” Electronics, 2019. Available from: https://doi.org/10.3390/electronics8080832
V. Hassija, V. Chamola, A. Mahapatra, et al., “Interpreting Black-Box Models: A Review on Explainable Artificial Intelligence,” Cognitive Computation, 16, 2023. Available from: https://link.springer.com/article/10.1007/s12559-023-10179-8
J. H. Friedman, “Greedy function approximation: a gradient boosting machine,” Annals of Statistics, pp. 1189–1232, 2001. Available from: https://www.jstor.org/stable/2699986
A. Goldstein, J. Kapelner, J. Bleich, and E. Pitkin, “Visualizing statistical learning with plots of individual conditional expectation,” Journal of Computational and Graphical Statistics, vol. 24, no. 1, pp. 44–65, 2015. Available from: https://doi.org/10.1080/10618600.2014.907095
W. Apley and J. Zhu, “Visualizing the effects of predictor variables in black box supervised learning models,” Journal of the Royal Statistical Society: Series B, vol. 82, no. 4, pp. 1059–1086, 2020. Available from: https://doi.org/10.1111/rssb.12377
M. Ku?ba, E. Baranowska, and P. Biecek, “pyceterisparibus: explaining machine learning models with ceteris paribus profiles in Python,” Journal of Open-Source Software, vol. 4, no. 37, p. 1389, 2019. Available from: https://joss.theoj.org/papers/10.21105/joss.01389.pdf
M. J. Pontiveros, G. A. Solano, C. A. Tee, and M. L. Tee, “Explainable machine learning applied to SNPs for SLE prediction,” in 2020 11th International Conference on Information, Intelligence, Systems and Applications (IISA), pp. 1–8, 2020. Available from: https://ieeexplore.ieee.org/abstract/document/9284372
S. M. Lundberg and S.-I. Lee, “A unified approach to interpreting model predictions,” Advances in Neural Information Processing Systems, vol. 30, 2017. Available from: https://tinyurl.com/3tfmhmjp
O. Ribeiro, L. Gomes, and Z. Vale, “Distributed Systems-based human fall detection system,” Electronics, vol. 11, no. 4, p. 592, 2022.
M. T. Ribeiro, S. Singh, and C. Guestrin, “Anchors: High-precision model-agnostic explanations,” AAAI Conference on Artificial Intelligence, vol. 32, no. 1, 2018. Available from: https://doi.org/10.1609/aaai.v32i1.11491
J. H. Friedman and B. E. Popescu, “Predictive learning via rule ensembles,” Annals of Applied Statistics, vol. 2, no. 3, pp. 916–954, 2008. Available from: https://tinyurl.com/y7tkur3y
A. Galkin, E. Aliper, I. Putin, et al., “Human microbiome aging clocks …,” bioRxiv, p. 507780, 2018. Available from: https://doi.org/10.1101/507780
J. Lei, M. G’Sell, A. Rinaldo, et al., “Distribution-free predictive inference for regression,” JASA, vol. 113, no. 523, pp. 1094–1111, 2018. Available from: https://doi.org/10.1080/01621459.2017.1307116
D. Lewis, Counterfactuals, John Wiley & Sons, 2013. Available from: https://tinyurl.com/mskjukmr
P. Dhurandhar, P.-Y. Chen, R. Luss, et al., “Explanations based on the missing …,” NeurIPS, vol. 31, 2018. Available from: https://tinyurl.com/4nhmhu39
P. Stock and M. Cisse, “ConvNets and ImageNet beyond accuracy …,” ECCV, pp. 498–512, 2018. Available from: https://tinyurl.com/by754kya
J. Chakraborty, K. Peng, and T. Menzies, “Making fair ML software using trustworthy explanation,” in ASE 2020, pp. 1229–1233, 2020. Available from: https://doi.org/10.1145/3324884.3418932
J. Druce, M. Harradon, and J. Tittle, “Explainable AI for trust in DRL-driven autonomous systems,” arXiv:2106.03775, 2021. Available from: https://doi.org/10.48550/arXiv.2106.03775
S. Das and P. Rad, “Opportunities and challenges in explainable artificial intelligence (XAI): A survey,” arXiv:2006.11371, 2020. Available from: https://doi.org/10.48550/arXiv.2006.11371
J. Li, W. Monroe, and D. Jurafsky, “Understanding neural networks through representation erasure,” arXiv:1612.08220, 2016. Available from: https://doi.org/10.48550/arXiv.1612.08220
A. Petsiuk, A. Das, and K. Saenko, “RISE: Randomized input sampling …,” arXiv:1806.07421, 2018. Available from: https://doi.org/10.48550/arXiv.1806.07421
S. Das and P. Rad, “Opportunities and challenges in XAI,” arXiv:2006.11371, 2020. Available from: https://doi.org/10.48550/arXiv.2006.11371
R. C. Fong and A. Vedaldi, “Interpretable explanations …,” ICCV, 2017, pp. 3429–3437. Available from: https://tinyurl.com/2sjzu932
D. Erhan, A. Courville, and Y. Bengio, “Understanding representations learned in deep architectures,” Univ. Montréal Tech. Rep., 2010. Available from: https://tinyurl.com/3u6pvmkv
K. Simonyan, A. Vedaldi, and A. Zisserman, “Deep inside convolutional networks …,” ICLR Workshop, 2014. Available from: https://doi.org/10.48550/arXiv.1312.6034
A. Shrikumar, P. Greenside, and A. Kundaje, “Learning important features …,” ICML, pp. 3145–3153, 2017. Available from: https://proceedings.mlr.press/v70/shrikumar17a
H. Chen, S. Lundberg, and S.-I. Lee, “Explaining models by propagating Shapley values …,” in Explainable AI in Healthcare, Springer, 2021, pp. 261–270. Available from: https://link.springer.com/chapter/10.1007/978-3-030-53352-6_24
M. D. Zeiler and R. Fergus, “Visualizing and understanding convolutional networks,” ECCV, pp. 818–833, 2014. Available from: https://link.springer.com/chapter/10.1007/978-3-319-10590-1_53
J. T. Springenberg, A. Dosovitskiy, T. Brox, and M. Riedmiller, “Striving for simplicity: The all-convolutional net,” arXiv:1412.6806, 2014. Available from: https://doi.org/10.48550/arXiv.1412.6806
B. Zhou, A. Khosla, A. Lapedriza, A. Oliva, and A. Torralba, “Learning deep features for discriminative localization,” CVPR, pp. 2921–2929, 2016. Available from: https://tinyurl.com/3d8ja67v
R. R. Selvaraju et al., “Grad-CAM: Visual explanations from deep networks …,” ICCV, 2017, pp. 618–626. Available from: https://tinyurl.com/56fc4w8x
F. Doshi-Velez and B. Kim, “Towards a rigorous science of interpretable ML,” arXiv:1702.08608, 2017. Available from: https://doi.org/10.48550/arXiv.1702.08608
S. Ahmed, G. Jeon, and F. Piccialli, “From AI to XAI in Industry 4.0,” IEEE Transactions on Industrial Informatics, 2022. Available from: https://ieeexplore.ieee.org/abstract/document/9695219
N. Wang, D. V. Pynadath, and S. G. Hill, “The impact of POMDP-generated explanations …,” AAMAS 2016, pp. 997–1005. Available from: https://tinyurl.com/33zwr4yh
R. Iyer et al., “Transparency and explanation in deep RL neural networks,” AIES 2018, pp. 144–150. Available from: https://doi.org/10.1145/3278721.3278776
T. Kampik, J. C. Nieves, and H. Lindgren, “Explaining sympathetic actions …,” in Explainable Autonomous Agents, Springer, 2019, pp. 59–76. Available from: https://link.springer.com/chapter/10.1007/978-3-030-30391-4_4
W. Guo, “Partially explainable big data-driven DRL for green 5G UAV,” ICC 2020, pp. 1–7. Available from: https://ieeexplore.ieee.org/abstract/document/9149151
H. Danielsson, R. Macrae, and A. Uthemann, “Artificial intelligence and systemic risk,” Journal of Banking & Finance, 2021. Available from: https://doi.org/10.1016/j.jbankfin.2021.106290
N. Bussmann, P. Giudici, D. Marinelli, and J. Papenbrock, “Explainable machine learning in credit risk management,” Computational Economics, vol. 57, no. 1, pp. 203–216, 2021. Available from: https://link.springer.com/article/10.1007/s10614-020-10042-0
S. Sachan et al., “An explainable AI DSS to automate loan underwriting,” Expert Systems with Applications, vol. 144, 2020. Available from: https://doi.org/10.1016/j.eswa.2019.113100
S. Gite et al., “Explainable stock price prediction using sentiment analysis,” PeerJ Computer Science, vol. 7, e340, 2021. Available from: https://peerj.com/articles/cs-340/
M. Gramegna and P. Giudici, “Why buy insurance? An explainable AI approach,” Risks, vol. 8, no. 4, p. 137, 2020. Available from: https://doi.org/10.3390/risks8040137
J.-Y. Kim and S.-B. Cho, “Electric energy consumption prediction …,” Energies, vol. 12, no. 4, p. 739, 2019. Available from: https://doi.org/10.3390/en12040739
S. S. Amiri, S. Mottahedi, E. R. Lee, and S. Hoque, “Explainable ML for household transport energy consumption,” CEUS, vol. 88, p. 101647, 2021. Available from: https://doi.org/10.1016/j.compenvurbsys.2021.101647
B. Sirmacek and M. Riveiro, “Occupancy prediction … smart offices,” Sensors, vol. 20, no. 19, p. 5497, 2020. Available from: https://doi.org/10.3390/s20195497
M. Viana et al., “Explaining use of agricultural land …,” Ecological Indicators, vol. 131, p. 108200, 2021. Available from: https://doi.org/10.1016/j.ecolind.2021.108200
N. L. Tsakiridis et al., “Versatile IoT for agriculture: An XAI approach,” IFIP AI & Innovations, 2020, pp. 180–191. Available from: https://link.springer.com/chapter/10.1007/978-3-030-49186-4_16
M. C. Garrido et al., “Evaporation forecasting through interpretable techniques,” Electronics, vol. 11, no. 4, p. 536, 2022. Available from: https://doi.org/10.3390/electronics11040536
M. Kenny et al., “Bayesian case-exclusion and XAI for sustainable farming,” IJCAI-PRICAI, 2021. Available from: https://tinyurl.com/3r2bf73u
N. Kundu et al., “IoT and interpretable ML for disease prediction in pearl millet,” Sensors, vol. 21, no. 16, p. 5386, 2021. Available from: https://doi.org/10.3390/s21165386
R. Gandhi et al., “An explainable AI approach for agriculture using IoT,” SSRN, 2021. Available from: https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3834259
R. Chittajallu et al., “XAI-CBIR for minimally invasive surgery videos,” ISBI 2019, pp. 66–69. Available from: https://ieeexplore.ieee.org/abstract/document/8759428
M. Hatwell, M. M. Gaber, and R. M. A. Azad, “Ada-whips: explaining Adaboost …,” BMC Medical Informatics, vol. 20, no. 1, 2020. Available from: https://link.springer.com/article/10.1186/s12911-020-01201-2
S. Hossain, G. Muhammad, and N. Guizani, “Explainable AI and mass surveillance healthcare framework,” IEEE Network, vol. 34, no. 4, pp. 126–132, 2020. Available from: https://ieeexplore.ieee.org/abstract/document/9136589
A. Pnevmatikakis et al., “Risk assessment for personalized health insurance,” Risks, vol. 9, no. 3, p. 46, 2021. Available from: https://doi.org/10.3390/risks9030046
L. Gozzi, F. Malandri, F. Mercorio, and A. Pedrocchi, “XAI for myocontrolled prosthesis …,” Knowledge-Based Systems, 2022. Available from: https://doi.org/10.1016/j.knosys.2021.108053
D. Dave et al., “Explainable AI meets healthcare: Heart disease dataset,” arXiv:2011.03195, 2020. Available from: https://doi.org/10.48550/arXiv.2011.03195
W. S. Monroe et al., “HIHO: accelerating AI interpretability …,” Neural Computing and Applications, vol. 33, no. 11, pp. 6027–6038, 2021. Available from: https://link.springer.com/article/10.1007/s00521-020-05379-4
M. Ghassemi, L. Oakden-Rayner, and A. Beam, “The false hope of current XAI in healthcare,” Lancet Digital Health, vol. 3, no. 11, pp. e745–e750, 2021. Available from: https://tinyurl.com/4f9sydhj
D. Watson, “Conceptual challenges for interpretable ML,” SSRN, 2020. Available from: https://link.springer.com/article/10.1007/s11229-022-03485-5
G. Fidel, R. Bitton, and A. Shabtai, “When explainability meets adversarial learning …,” IJCNN 2020, pp. 1–8. Available from: https://ieeexplore.ieee.org/abstract/document/9207637

Cites this article as

R. Saleem, N. Akram, M. A. Rajput, I. Mahmood, "Explainable Artificial Intelligence (XAI) for Distributed Systems: A Survey", International Journal of Innovative Research in Computer Science and Technology (IJIRCST), Vol-13, Issue-6, Page No-8-19, 2025. Available from: https://doi.org/10.55524/ijircst.2025.13.6.2

Corresponding Author

Rizwan Saleem

Department of Computer Science, Superior University, Lahore, Pakistan

Download Full Paper

Download PDF

No. of Downloads: 20 | No. of Views: 281

A Comprehensive Review on Descriptive Answer Script Evaluation Techniques

Pradeep Rao K B, Thyagaraju G S, Sahana Kumari B, Prasad S R.

November 2025 - Vol 13, Issue 6
Eduventure- A Gamified Microlearning Platform

Pradeep G S, Dhavalashree Jain L A, Pushpa B, Shubha Parameshwar Bhat, Soujanya.

November 2025 - Vol 13, Issue 6
Spectral Geometric Regularization: Towards Isometric Invariance for Domain-Generalized Learning

Kalyan Chakravarthy Kodela, Rohith Vangalla.

September 2025 - Vol 13, Issue 5

Explainable Artificial Intelligence (XAI) for Distributed Systems: A Survey

Citations

Download Full Paper PDF

Total View 281

Total Download 20