Skip to main Communities My dashboard Log in Sign up Published April 15, 2026 | Version v8 Preprint Open Documenting AI Systems under the EU AI Act: A UML Architectural Framework with Support for Post-Hoc XAI Authors/Creators Uetanabara, José Júnior (Researcher) Description Artificial Intelligence (AI) has gained prominence in recent years, with widespread adoption raising challenges related to the auditability of AI-based systems. Explainable Artificial Intelligence (XAI) addresses this issue through post-hoc methods that provide interpretation. However, the integration of XAI methods into architectural representations and compliance-oriented documentation remains largely unstructured. At the same time, the European Union's AI Act (Regulation 2024/1689) introduces documentation requirements for high-risk AI systems without prescribing a standardized format, making compliance material complex to produce, maintain, and align with system implementations. To address this gap, this work proposes a UML architectural framework for AI systems incorporating post-hoc XAI, focusing on the structural representation of compliance-relevant items required by Annex IV. The framework defines a minimal architectural contract that integrates system structure, post-hoc XAI methods, and traceability relationships, supporting the generation of auditable, traceable, and partially regenerable technical documentation. In addition, this work introduces UMLOOModeler, a supporting tool that derives UML class diagrams directly from object-oriented (OO) Python implementations using a conservative extraction strategy, ensuring consistency between the implementation and its architectural representation. The framework is illustrated through heterogeneous AI configurations and a partial example of technical documentation, illustrating how it supports traceability, auditability, and documentation consistency. Files Documenting AI Systems under the EU AI Act - A UML Architectural Framework with Support for Post-Hoc XAI - v6.pdf Files (722.7 kB) Name Size Download all Documenting AI Systems under the EU AI Act - A UML Architectural Framework with Support for Post-Hoc XAI - v6.pdf md5:f8ea1669ce72d40a969129bf2bb527d7 722.7 kB Preview Download Additional details Dates Created 2025-08-13 First upload. Updated 2025-09-19 Second upload. Improved the research. Updated 2025-09-26 Third upload. Fixed some inconsistencies. Updated 2025-10-25 4th upload. Improved the research. Updated 2025-11-03 5th upload. Minor changes. Updated 2026-01-28 6th upload. Improved the research. Updated 2026-03-30 7th upload. Improved the research. Updated 2026-04-15 8th upload. Minor changes. Software Repository URL https://github.com/miklotovx/UMLOOModeler Programming language Python Development Status Active References [1] EUROPEAN UNION. Regulation (EU) 2024/1689 of the European Parliament and of the Council of 13 June 2024 laying down harmonised rules on artificial intelligence (AI Act). Official Journal of the European Union, L 1689, 12 July 2024, p. 1–147. Available at: https://eur-lex.europa.eu/legal-content/EN/TXT/?uri=CELEX:32024R1689 [2] MITCHELL, M.; WU, S.; ZALDIVAR, A.; BARNES, P.; VASSERMAN, L.; HUTCHINSON, B.; SPITZER, E.; RAGHU, M.; GEBRU, T. Model Cards for Model Reporting. In: Proceedings of the Conference on Fairness, Accountability, and Transparency (FAT* '19). New York, NY, USA: ACM, 2019. p. 220–229. https://doi.org/10.1145/3287560.3287596 [3] BARREDO ARRIETA, A. et al. Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI. Information Fusion, v. 58, p. 82–115, 2020. https://doi.org/10.1016/j.inffus.2019.12.012 [4] SAARELA, M.; PODGORELEC, V. Recent Applications of Explainable AI (XAI): A Systematic Literature Review. Applied Sciences, 14(19):8884, 2024. https://doi.org/10.3390/app14198884 [5] SCANTAMBURLO, T.; FALCARIN, P.; VENERI, A.; FABRIS, A.; GALLESE, C.; BILLA, V.; ROTOLO, F.; MARCUZZI, F. Software Systems Compliance with the AI Act: Lessons Learned from an International Challenge. In: Proceedings of the 2nd International Workshop on Responsible AI Engineering (RAIE '24). Lisbon, Portugal: ACM, 2024. p. 1–8. https://doi.org/10.1145/3643691.3648589 [6] SELIC, B. A systematic approach to domain-specific language design using UML. In: 10th IEEE International Symposium on Object and Component-Oriented Real-Time Distributed Computing (ISORC), 2007. p. 2–9. https://doi.org/10.1109/ISORC.2007.10 [7] OBJECT MANAGEMENT GROUP (OMG). OMG Unified Modeling Language (UML), Version 2.5. 2015. Available at: https://www.omg.org/spec/UML/2.5 [8] BRAMBILLA, M.; CABOT, J.; WIMMER, M. Model-Driven Software Engineering in Practice. 2nd ed. Morgan & Claypool Publishers, 2017. [9] MOLNAR, C. Interpretable Machine Learning: A Guide for Making Black Box Models Explainable. 2022. Available at: https://christophm.github.io/interpretable-ml-book/ [10] RIBEIRO, M. T.; SINGH, S.; GUESTRIN, C. "Why should I trust you?": Explaining the predictions of any classifier. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, New York, NY, USA, 2016. p. 1135–1144. https://doi.org/10.1145/2939672.2939778 [11] LUNDBERG, S. M.; LEE, S.-I. A Unified Approach to Interpreting Model Predictions. In: Advances in Neural Information Processing Systems (NeurIPS 2017), vol. 30. Available at: https://proceedings.neurips.cc/paper/2017/hash/8a20a8621978632d76c43dfd28b67767-Abstract.html [12] PEDREGOSA, F. et al. Scikit-learn: Machine learning in Python. Journal of Machine Learning Research, 2011. Available at: https://jmlr.org/papers/v12/pedregosa11a.html [13] SPANHOL, F. A.; OLIVEIRA, L. S.; PETITJEAN, C.; HEUTINCK, L. Breast cancer histopathological image classification using convolutional neural networks. In: 2016 International Joint Conference on Neural Networks (IJCNN). IEEE, 2016, p. 2560–2567. https://doi.org/10.1109/IJCNN.2016.7727519 [14] WEINSTEIN, J. N. et al. The Cancer Genome Atlas Pan-Cancer analysis project. Nature Genetics, v. 45, n. 10, p. 1113–1120, 2013. https://doi.org/10.1038/ng.2764 [15] KLUYVER, T. et al. Jupyter Notebooks – a publishing format for reproducible computational workflows. In: Positioning and Power in Academic Publishing: Players, Agents and Agendas. IOS Press, 2016. https://doi.org/10.3233/978-1-61499-649-1-87 [16] HUMMEL, A. et al. The EU AI Act, Stakeholder Needs, and Explainable AI: Aligning Regulatory Compliance in a Clinical Decision Support System. arXiv preprint arXiv:2505.20311v3, 2026. Available at: https://arxiv.org/abs/2505.20311v3 [17] NAVARRO, A.; LAVALLE, A.; MATÉ, A.; TRUJILLO, J. A modeling approach for designing explainable Artificial Intelligence. In: ER2023: Companion Proceedings of the 42nd International Conference on Conceptual Modeling: ER Forum, 7th SCME, CEUR Workshop Proceedings. Available at: https://ceur-ws.org/Vol-3618/forum_paper_24.pdf [18] GONÇALVES, D.; CORREIA, A. XAI-Compliance-by-Design: A Modular Framework for GDPR- and AI Act-Aligned Decision Transparency in High-Risk AI Systems. Journal of Cybersecurity and Privacy, v. 6, 2026, Art. 43. [19] LUCAJ, L.; LOOSLEY, A.; JONSSON, H.; GASSER, U.; VAN DER SMAGT, P. TechOps: Technical documentation Templates for the AI Act. arXiv preprint arXiv:2508.08804, 2025. Available at: https://arxiv.org/abs/2508.08804 [20] CEDERBLADH, J.; CICCHETTI, A.; SURYADEVARA, J. Early Validation and Verification of System Behaviour in Model-based Systems Engineering: A Systematic Literature Review. ACM Transactions on Software Engineering and Methodology (TOSEM), v. 33, n. 3, 2024, p. 1–67. https://doi.org/10.1145/3631976 1K Views 719 Downloads Show more details All versions This version Views Total views 1,186 441 Downloads Total downloads 719 206 Data volume Total data volume 453.2 MB 160.3 MB More info on how stats are collected.... Versions External resources Indexed in OpenAIRE Communities Keywords and subjects Keywords Explainable Artificial Intelligence LIME Software Engineering UML XAI EU AI ACT SHAP Details DOI DOI Badge DOI 10.5281/zenodo.19599421 Markdown [](https://doi.org/10.5281/zenodo.19599421) reStructuredText .. image:: https://zenodo.org/badge/DOI/10.5281/zenodo.19599421.svg :target: https://doi.org/10.5281/zenodo.19599421 HTML <a href="https://doi.org/10.5281/zenodo.19599421"><img src="https://zenodo.org/badge/DOI/10.5281/zenodo.19599421.svg" alt="DOI"></a> Image URL https://zenodo.org/badge/DOI/10.5281/zenodo.19599421.svg Target URL https://doi.org/10.5281/zenodo.19599421 Resource type Preprint Publisher Zenodo Languages English Rights License Creative Commons Attribution 4.0 International The Creative Commons Attribution license allows re-distribution and re-use of a licensed work on the condition that the creator is appropriately credited. Read more Copyright Ueta - 2026 Citation Export Technical metadata Created April 15, 2026 Modified April 18, 2026 Jump up About About Policies Infrastructure Principles Projects Roadmap Contact Blog Blog Support Help FAQ Developers REST API OAI-PMH Contribute GitHub Donate Funded by Powered by CERN Data Centre & InvenioRDM Status Privacy policy Cookie policy Terms of Use This site uses cookies. Find out more on how we use cookies Accept all cookies Accept only essential cookies