Searching Silk Fabrics by Images Leveraging on Knowledge Graph and Domain Expert Rules

Research output: Chapter in book/report/conference proceeding › Conference contribution › Research › peer review

Authors

  • Thomas Schleider
  • Raphael Troncy
  • Thibault Ehrhart
  • Mareike Dorozynski
  • Franz Rottensteiner
  • Jorge Sebastián Lozano
  • Georgia Lo Cicero

Research Organisations

External Research Organisations

  • EURECOM - Graduate School and Research Center in Digital Sciences
  • Universitat de Valencia
  • University of Palermo
View graph of relations

Details

Original languageEnglish
Title of host publicationSUMAC 2021 - Proceedings of the 3rd Workshop on Structuring and Understanding of Multimedia heritAge Contents, co-located with ACM MM 2021
Pages41-49
Number of pages9
ISBN (electronic)9781450386685
Publication statusPublished - 20 Oct 2021
Event3rd ACM workshop on Structuring and Understanding of Multimedia heritAge Contents, SUMAC 2021 - Virtual, Online, China
Duration: 20 Oct 2021 → …

Publication series

NameSUMAC 2021 - Proceedings of the 3rd Workshop on Structuring and Understanding of Multimedia heritAge Contents, co-located with ACM MM 2021

Abstract

The production of European silk textile is an endangered intangible cultural heritage. Digital tools can nowadays be developed to help preserving it, or even to make it more accessible for the public and the fashion industry. In this paper, we propose an image-based retrieval tool that leverages on a knowledge graph describing the silk textile production as well as rules formulated by experts of this domain. Out of several possible similarity scenarios, two have proven to work best and have been integrated into an exploratory search engine.

Keywords

    cultural heritage, deep learning, image retrieval, knowledge graph

ASJC Scopus subject areas

Cite this

Searching Silk Fabrics by Images Leveraging on Knowledge Graph and Domain Expert Rules. / Schleider, Thomas; Troncy, Raphael; Ehrhart, Thibault et al.
SUMAC 2021 - Proceedings of the 3rd Workshop on Structuring and Understanding of Multimedia heritAge Contents, co-located with ACM MM 2021. 2021. p. 41-49 (SUMAC 2021 - Proceedings of the 3rd Workshop on Structuring and Understanding of Multimedia heritAge Contents, co-located with ACM MM 2021).

Research output: Chapter in book/report/conference proceeding › Conference contribution › Research › peer review

Schleider, T, Troncy, R, Ehrhart, T, Dorozynski, M, Rottensteiner, F, Sebastián Lozano, J & Lo Cicero, G 2021, Searching Silk Fabrics by Images Leveraging on Knowledge Graph and Domain Expert Rules. in SUMAC 2021 - Proceedings of the 3rd Workshop on Structuring and Understanding of Multimedia heritAge Contents, co-located with ACM MM 2021. SUMAC 2021 - Proceedings of the 3rd Workshop on Structuring and Understanding of Multimedia heritAge Contents, co-located with ACM MM 2021, pp. 41-49, 3rd ACM workshop on Structuring and Understanding of Multimedia heritAge Contents, SUMAC 2021, Virtual, Online, China, 20 Oct 2021. https://doi.org/10.1145/3475720.3484445
Schleider, T., Troncy, R., Ehrhart, T., Dorozynski, M., Rottensteiner, F., Sebastián Lozano, J., & Lo Cicero, G. (2021). Searching Silk Fabrics by Images Leveraging on Knowledge Graph and Domain Expert Rules. In SUMAC 2021 - Proceedings of the 3rd Workshop on Structuring and Understanding of Multimedia heritAge Contents, co-located with ACM MM 2021 (pp. 41-49). (SUMAC 2021 - Proceedings of the 3rd Workshop on Structuring and Understanding of Multimedia heritAge Contents, co-located with ACM MM 2021). https://doi.org/10.1145/3475720.3484445
Schleider T, Troncy R, Ehrhart T, Dorozynski M, Rottensteiner F, Sebastián Lozano J et al. Searching Silk Fabrics by Images Leveraging on Knowledge Graph and Domain Expert Rules. In SUMAC 2021 - Proceedings of the 3rd Workshop on Structuring and Understanding of Multimedia heritAge Contents, co-located with ACM MM 2021. 2021. p. 41-49. (SUMAC 2021 - Proceedings of the 3rd Workshop on Structuring and Understanding of Multimedia heritAge Contents, co-located with ACM MM 2021). doi: 10.1145/3475720.3484445
Schleider, Thomas ; Troncy, Raphael ; Ehrhart, Thibault et al. / Searching Silk Fabrics by Images Leveraging on Knowledge Graph and Domain Expert Rules. SUMAC 2021 - Proceedings of the 3rd Workshop on Structuring and Understanding of Multimedia heritAge Contents, co-located with ACM MM 2021. 2021. pp. 41-49 (SUMAC 2021 - Proceedings of the 3rd Workshop on Structuring and Understanding of Multimedia heritAge Contents, co-located with ACM MM 2021).
Download
@inproceedings{c7ebebd1a6324ea1afc5bc7af8636ebf,
title = "Searching Silk Fabrics by Images Leveraging on Knowledge Graph and Domain Expert Rules",
abstract = "The production of European silk textile is an endangered intangible cultural heritage. Digital tools can nowadays be developed to help preserving it, or even to make it more accessible for the public and the fashion industry. In this paper, we propose an image-based retrieval tool that leverages on a knowledge graph describing the silk textile production as well as rules formulated by experts of this domain. Out of several possible similarity scenarios, two have proven to work best and have been integrated into an exploratory search engine.",
keywords = "cultural heritage, deep learning, image retrieval, knowledge graph",
author = "Thomas Schleider and Raphael Troncy and Thibault Ehrhart and Mareike Dorozynski and Franz Rottensteiner and {Sebasti{\'a}n Lozano}, Jorge and {Lo Cicero}, Georgia",
note = "Funding Information: This work has been partially supported by the European Union{\textquoteright}s Horizon 2020 research and innovation program within the SIL-KNOW (grant agreement No. 769504).; 3rd ACM workshop on Structuring and Understanding of Multimedia heritAge Contents, SUMAC 2021 ; Conference date: 20-10-2021",
year = "2021",
month = oct,
day = "20",
doi = "10.1145/3475720.3484445",
language = "English",
series = "SUMAC 2021 - Proceedings of the 3rd Workshop on Structuring and Understanding of Multimedia heritAge Contents, co-located with ACM MM 2021",
pages = "41--49",
booktitle = "SUMAC 2021 - Proceedings of the 3rd Workshop on Structuring and Understanding of Multimedia heritAge Contents, co-located with ACM MM 2021",

}

Download

TY - GEN

T1 - Searching Silk Fabrics by Images Leveraging on Knowledge Graph and Domain Expert Rules

AU - Schleider, Thomas

AU - Troncy, Raphael

AU - Ehrhart, Thibault

AU - Dorozynski, Mareike

AU - Rottensteiner, Franz

AU - Sebastián Lozano, Jorge

AU - Lo Cicero, Georgia

N1 - Funding Information: This work has been partially supported by the European Union’s Horizon 2020 research and innovation program within the SIL-KNOW (grant agreement No. 769504).

PY - 2021/10/20

Y1 - 2021/10/20

N2 - The production of European silk textile is an endangered intangible cultural heritage. Digital tools can nowadays be developed to help preserving it, or even to make it more accessible for the public and the fashion industry. In this paper, we propose an image-based retrieval tool that leverages on a knowledge graph describing the silk textile production as well as rules formulated by experts of this domain. Out of several possible similarity scenarios, two have proven to work best and have been integrated into an exploratory search engine.

AB - The production of European silk textile is an endangered intangible cultural heritage. Digital tools can nowadays be developed to help preserving it, or even to make it more accessible for the public and the fashion industry. In this paper, we propose an image-based retrieval tool that leverages on a knowledge graph describing the silk textile production as well as rules formulated by experts of this domain. Out of several possible similarity scenarios, two have proven to work best and have been integrated into an exploratory search engine.

KW - cultural heritage

KW - deep learning

KW - image retrieval

KW - knowledge graph

UR - http://www.scopus.com/inward/record.url?scp=85119076458&partnerID=8YFLogxK

U2 - 10.1145/3475720.3484445

DO - 10.1145/3475720.3484445

M3 - Conference contribution

AN - SCOPUS:85119076458

T3 - SUMAC 2021 - Proceedings of the 3rd Workshop on Structuring and Understanding of Multimedia heritAge Contents, co-located with ACM MM 2021

SP - 41

EP - 49

BT - SUMAC 2021 - Proceedings of the 3rd Workshop on Structuring and Understanding of Multimedia heritAge Contents, co-located with ACM MM 2021

T2 - 3rd ACM workshop on Structuring and Understanding of Multimedia heritAge Contents, SUMAC 2021

Y2 - 20 October 2021

ER -