Andrea Agiollo, Luciano Cavalcante Siebert, Pradeep Kumar Murukannaiah,
Andrea Omicini
Autonomous Agents and Multi-Agent Systems 38, pages 1–33
July 2024
The expressive power and effectiveness of large language models (LLMs) is going to increasingly push intelligent agents towards sub-symbolic models for Natural Language Processing (NLP) tasks in human-agent interaction. However, LLMs are characterised by a performance vs. transparency trade-off that hinders their applicability to such sensitive scenarios. This is the main reason behind many approaches focusing on local post-hoc explanations, recently proposed by the XAI community in the NLP realm. However, to the best of our knowledge, a thorough comparison among available explainability techniques is currently missing, as well as approaches for constructing global post-hoc explanations leveraging the local information. This is why we propose a novel framework for comparing state-of-the-art local post-hoc explanation mechanisms and for extracting logic programs surrogating LLMs. Our experiments - over a wide variety of text classification tasks - show how most local post-hoc explainers are loosely correlated, highlighting substantial discrepancies in their results. By relying on the proposed novel framework, we also show how it is possible to extract faithful and efficient global explanations for the original LLM over multiple tasks, enabling explainable and resource-friendly AI techniques.
keywords
Natural language processing, post-hoc explanations, symbolic knowledge extraction, eXplainable AI, resource-friendly AI
origin event
journal or series
![book](/xwiki/resources/icons/silk/book.png?cache-version=1705487760000)
Autonomous Agents and Multi-Agent Systems
(J.AAMAS)
funding project
FAIR-PE01-SP08 — Future AI Research – Partenariato Esteso sull'Intelligenza Artificiale – Spoke 8 “Pervasive AI”
(01/01/2023–31/12/2025)
EXPECTATION — Personalized Explainable Artificial Intelligence for decentralized agents with heterogeneous knowledge
(01/04/2021–31/03/2024)
ENGINES — ENGineering INtElligent Systems around intelligent agent technologies
(28/09/2023–27/09/2025)