Special Issue on Neuro-Symbolic AI and Domain Specific Conceptual Modelling The submitted paper is an extension of a paper presented at the 2nd International Workshop on Hybrid Artificial Intelligence and Enterprise Modeling for Intelligent Information Systems (HybridAIMS). In this paper, the technical aspects of the knowledge graph-based XAI approach are presented in more detail, and further design components are considered in the demonstration and evaluation. A more comprehensive set of evaluation results is also provided.