Finding Interpretable Concept Spaces in Node Embeddings Using Knowledge Bases

Publikation: Beitrag in Buch/Bericht/Sammelwerk/KonferenzbandAufsatz in KonferenzbandForschung

Autoren

  • Maximilian Idahl
  • Megha Khosla
  • Avishek Anand

Organisationseinheiten

Forschungs-netzwerk anzeigen

Details

OriginalspracheEnglisch
Titel des SammelwerksMachine Learning and Knowledge Discovery in Databases - International Workshops of ECML PKDD 2019
Herausgeber/-innenPeggy Cellier, Kurt Driessens
Seiten229-240
Seitenumfang12
Band1
PublikationsstatusVeröffentlicht - 2020
Veranstaltung19th Joint European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, ECML PKDD 2019 - Wurzburg, Deutschland
Dauer: 16 Sept. 201920 Sept. 2019

Publikationsreihe

NameCommunications in Computer and Information Science
Band1167
ISSN (Print)1865-0929
ISSN (elektronisch)1865-0937

Abstract

In this paper we propose and study the novel problem of explaining node embeddings by finding embedded human interpretable subspaces in already trained unsupervised node representation embeddings. We use an external knowledge base that is organized as a taxonomy of human-understandable concepts over entities as a guide to identify subspaces in node embeddings learned from an entity graph derived from Wikipedia. We propose a method that given a concept finds a linear transformation to a subspace where the structure of the concept is retained. Our initial experiments show that we obtain low error in finding fine-grained concepts.

ASJC Scopus Sachgebiete

Zitieren

Finding Interpretable Concept Spaces in Node Embeddings Using Knowledge Bases. / Idahl, Maximilian; Khosla, Megha; Anand, Avishek.
Machine Learning and Knowledge Discovery in Databases - International Workshops of ECML PKDD 2019. Hrsg. / Peggy Cellier; Kurt Driessens. Band 1 2020. S. 229-240 (Communications in Computer and Information Science; Band 1167).

Publikation: Beitrag in Buch/Bericht/Sammelwerk/KonferenzbandAufsatz in KonferenzbandForschung

Idahl, M, Khosla, M & Anand, A 2020, Finding Interpretable Concept Spaces in Node Embeddings Using Knowledge Bases. in P Cellier & K Driessens (Hrsg.), Machine Learning and Knowledge Discovery in Databases - International Workshops of ECML PKDD 2019. Bd. 1, Communications in Computer and Information Science, Bd. 1167, S. 229-240, 19th Joint European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, ECML PKDD 2019, Wurzburg, Deutschland, 16 Sept. 2019. https://doi.org/10.48550/arXiv.1910.05030, https://doi.org/10.1007/978-3-030-43823-4_20
Idahl, M., Khosla, M., & Anand, A. (2020). Finding Interpretable Concept Spaces in Node Embeddings Using Knowledge Bases. In P. Cellier, & K. Driessens (Hrsg.), Machine Learning and Knowledge Discovery in Databases - International Workshops of ECML PKDD 2019 (Band 1, S. 229-240). (Communications in Computer and Information Science; Band 1167). https://doi.org/10.48550/arXiv.1910.05030, https://doi.org/10.1007/978-3-030-43823-4_20
Idahl M, Khosla M, Anand A. Finding Interpretable Concept Spaces in Node Embeddings Using Knowledge Bases. in Cellier P, Driessens K, Hrsg., Machine Learning and Knowledge Discovery in Databases - International Workshops of ECML PKDD 2019. Band 1. 2020. S. 229-240. (Communications in Computer and Information Science). doi: 10.48550/arXiv.1910.05030, 10.1007/978-3-030-43823-4_20
Idahl, Maximilian ; Khosla, Megha ; Anand, Avishek. / Finding Interpretable Concept Spaces in Node Embeddings Using Knowledge Bases. Machine Learning and Knowledge Discovery in Databases - International Workshops of ECML PKDD 2019. Hrsg. / Peggy Cellier ; Kurt Driessens. Band 1 2020. S. 229-240 (Communications in Computer and Information Science).
Download
@inproceedings{68dd4b3ca9b34e43ad1e1f8d00ac9a22,
title = "Finding Interpretable Concept Spaces in Node Embeddings Using Knowledge Bases",
abstract = "In this paper we propose and study the novel problem of explaining node embeddings by finding embedded human interpretable subspaces in already trained unsupervised node representation embeddings. We use an external knowledge base that is organized as a taxonomy of human-understandable concepts over entities as a guide to identify subspaces in node embeddings learned from an entity graph derived from Wikipedia. We propose a method that given a concept finds a linear transformation to a subspace where the structure of the concept is retained. Our initial experiments show that we obtain low error in finding fine-grained concepts.",
keywords = "Conceptual spaces, Interpretability, Node embeddings",
author = "Maximilian Idahl and Megha Khosla and Avishek Anand",
year = "2020",
doi = "10.48550/arXiv.1910.05030",
language = "English",
isbn = "9783030438227",
volume = "1",
series = "Communications in Computer and Information Science",
pages = "229--240",
editor = "Peggy Cellier and Kurt Driessens",
booktitle = "Machine Learning and Knowledge Discovery in Databases - International Workshops of ECML PKDD 2019",
note = "19th Joint European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, ECML PKDD 2019 ; Conference date: 16-09-2019 Through 20-09-2019",

}

Download

TY - GEN

T1 - Finding Interpretable Concept Spaces in Node Embeddings Using Knowledge Bases

AU - Idahl, Maximilian

AU - Khosla, Megha

AU - Anand, Avishek

PY - 2020

Y1 - 2020

N2 - In this paper we propose and study the novel problem of explaining node embeddings by finding embedded human interpretable subspaces in already trained unsupervised node representation embeddings. We use an external knowledge base that is organized as a taxonomy of human-understandable concepts over entities as a guide to identify subspaces in node embeddings learned from an entity graph derived from Wikipedia. We propose a method that given a concept finds a linear transformation to a subspace where the structure of the concept is retained. Our initial experiments show that we obtain low error in finding fine-grained concepts.

AB - In this paper we propose and study the novel problem of explaining node embeddings by finding embedded human interpretable subspaces in already trained unsupervised node representation embeddings. We use an external knowledge base that is organized as a taxonomy of human-understandable concepts over entities as a guide to identify subspaces in node embeddings learned from an entity graph derived from Wikipedia. We propose a method that given a concept finds a linear transformation to a subspace where the structure of the concept is retained. Our initial experiments show that we obtain low error in finding fine-grained concepts.

KW - Conceptual spaces

KW - Interpretability

KW - Node embeddings

UR - http://www.scopus.com/inward/record.url?scp=85083711218&partnerID=8YFLogxK

U2 - 10.48550/arXiv.1910.05030

DO - 10.48550/arXiv.1910.05030

M3 - Conference contribution

AN - SCOPUS:85083711218

SN - 9783030438227

VL - 1

T3 - Communications in Computer and Information Science

SP - 229

EP - 240

BT - Machine Learning and Knowledge Discovery in Databases - International Workshops of ECML PKDD 2019

A2 - Cellier, Peggy

A2 - Driessens, Kurt

T2 - 19th Joint European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, ECML PKDD 2019

Y2 - 16 September 2019 through 20 September 2019

ER -