On the Design of PSyKE: A Platform for Symbolic Knowledge Extraction


Federico Sabbatini, Giovanni Ciatto, Roberta Calegari, Andrea Omicini

WOA 2021 – 22nd Workshop “From Objects to Agents”, pages 29–48
CEUR Workshop Proceedings (AI*IA Series) 2963, October 2021
Sun SITE Central Europe, RWTH Aachen University
Roberta Calegari, Giovanni Ciatto, Enrico Denti, Andrea Omicini, Giovanni Sartor (eds.)

A common practice in modern explainable AI is to post-hoc explain black-box machine learning (ML) predictors – such as neural networks – by extracting symbolic knowledge out of them, in the form of either rule lists or decision trees. By acting as a surrogate model, the extracted knowledge aims at revealing the inner working of the black box, thus enabling its inspection, representation, and explanation.
Various knowledge-extraction algorithms have been presented in the literature so far. Unfortunately, running implementations of most of them are currently either proof of concepts or unavailable. In any case, a unified, coherent software framework supporting them all – as well as their interchange, comparison, and exploitation in arbitrary ML workflows – is currently missing.
Accordingly, in this paper we present the design of PSyKE, a platform providing general-purpose support to symbolic knowledge extraction from different sorts of black-box predictors via many extraction algorithms. Notably, PSyKE targets the extraction of symbolic knowledge in logic form, making it possible to extract first-order logic clauses as output. The extracted knowledge is thus both machine- and human- interpretable, and it can be used as a starting point for further symbolic processing—e.g. automated reasoning.

(keywords) explainable AI, knowledge extraction, interpretable prediction, PSyKE
 @inproceedings{psyke-woa2021,
articleno = 3,
author = {Sabbatini, Federico and Ciatto, Giovanni and Calegari, Roberta and Omicini, Andrea},
booktitle = {WOA 2021 -- 22nd Workshop ``From Objects to Agents''},
dblpid = {conf/woa/SabbatiniCCO21},
editor = {Calegari, Roberta and Ciatto, Giovanni and Denti, Enrico and Omicini, Andrea and Sartor, Giovanni},
issn = {1613-0073},
keywords = {explainable AI, knowledge extraction, interpretable prediction, PSyKE},
location = {Bologna, Italy},
month = oct,
note = {22nd Workshop ``From Objects to Agents'' (WOA 2021), Bologna, Italy, 1--3~} # sep # {~2021. Proceedings},
numpages = 20,
pages = {29--48},
publisher = {Sun SITE Central Europe, RWTH Aachen University},
series = {CEUR Workshop Proceedings},
subseries = {AI*IA Series},
title = {On the Design of {PSyKE}: A Platform for Symbolic Knowledge Extraction},
url = {http://ceur-ws.org/Vol-2963/paper14.pdf},
volume = 2963,
year = 2021

Talks

Publications

Events

  • 22nd Workshop “From Objects to Agents” (WOA 2021) — 01/09/2021–03/09/2021

Publication

— authors

Federico Sabbatini, Giovanni Ciatto, Roberta Calegari, Andrea Omicini

— editors

Roberta Calegari, Giovanni Ciatto, Enrico Denti, Andrea Omicini, Giovanni Sartor

— status

published

— sort

paper in proceedings

Venue

— volume

WOA 2021 – 22nd Workshop “From Objects to Agents”

— series

CEUR Workshop Proceedings

— volume

2963

— pages

29–48

— article no.

3

— publication date

October 2021

URLs

original page

Identifiers

— DBLP

conf/woa/SabbatiniCCO21

— IRIS

11585/834364

— print ISSN

1613-0073

BibTeX

— BibTeX ID
psyke-woa2021
— BibTeX category
inproceedings

Partita IVA: 01131710376 - Copyright © 2008-2022 APICe@DISI Research Group - PRIVACY