iART: A Search Engine for Art-Historical Images to Support Research in the Humanities

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Authors

  • Matthias Springstein
  • Stefanie Schneider
  • Javad Rahnama
  • Eyke Hüllermeier
  • Hubertus Kohle
  • Ralph Ewerth

Research Organisations

External Research Organisations

  • German National Library of Science and Technology (TIB)
  • Ludwig-Maximilians-Universität München (LMU)
  • Paderborn University
View graph of relations

Details

Original languageEnglish
Title of host publicationMM 2021
Subtitle of host publicationProceedings of the 29th ACM International Conference on Multimedia
Pages2801-2803
Number of pages3
ISBN (electronic)9781450386517
Publication statusPublished - 17 Oct 2021
Event29th ACM International Conference on Multimedia, MM 2021 - Virtual, Online, China
Duration: 20 Oct 202124 Oct 2021

Publication series

NameMM 2021 - Proceedings of the 29th ACM International Conference on Multimedia

Abstract

In this paper, we introduce iART: an open Web platform for art-historical research that facilitates the process of comparative vision. The system integrates various machine learning techniques for keyword- and content-based image retrieval as well as category formation via clustering. An intuitive GUI supports users to define queries and explore results. By using a state-of-the-art cross-modal deep learning approach, it is possible to search for concepts that were not previously detected by trained classification models. Art-historical objects from large, openly licensed collections such as Amsterdam Rijksmuseum and Wikidata are made available to users.

Keywords

    art retrieval, cross-modal retrieval, deep learning, web application

ASJC Scopus subject areas

Cite this

iART: A Search Engine for Art-Historical Images to Support Research in the Humanities. / Springstein, Matthias; Schneider, Stefanie; Rahnama, Javad et al.
MM 2021 : Proceedings of the 29th ACM International Conference on Multimedia. 2021. p. 2801-2803 (MM 2021 - Proceedings of the 29th ACM International Conference on Multimedia).

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Springstein, M, Schneider, S, Rahnama, J, Hüllermeier, E, Kohle, H & Ewerth, R 2021, iART: A Search Engine for Art-Historical Images to Support Research in the Humanities. in MM 2021 : Proceedings of the 29th ACM International Conference on Multimedia. MM 2021 - Proceedings of the 29th ACM International Conference on Multimedia, pp. 2801-2803, 29th ACM International Conference on Multimedia, MM 2021, Virtual, Online, China, 20 Oct 2021. https://doi.org/10.48550/arXiv.2108.01542, https://doi.org/10.1145/3474085.3478564
Springstein, M., Schneider, S., Rahnama, J., Hüllermeier, E., Kohle, H., & Ewerth, R. (2021). iART: A Search Engine for Art-Historical Images to Support Research in the Humanities. In MM 2021 : Proceedings of the 29th ACM International Conference on Multimedia (pp. 2801-2803). (MM 2021 - Proceedings of the 29th ACM International Conference on Multimedia). https://doi.org/10.48550/arXiv.2108.01542, https://doi.org/10.1145/3474085.3478564
Springstein M, Schneider S, Rahnama J, Hüllermeier E, Kohle H, Ewerth R. iART: A Search Engine for Art-Historical Images to Support Research in the Humanities. In MM 2021 : Proceedings of the 29th ACM International Conference on Multimedia. 2021. p. 2801-2803. (MM 2021 - Proceedings of the 29th ACM International Conference on Multimedia). doi: 10.48550/arXiv.2108.01542, 10.1145/3474085.3478564
Springstein, Matthias ; Schneider, Stefanie ; Rahnama, Javad et al. / iART : A Search Engine for Art-Historical Images to Support Research in the Humanities. MM 2021 : Proceedings of the 29th ACM International Conference on Multimedia. 2021. pp. 2801-2803 (MM 2021 - Proceedings of the 29th ACM International Conference on Multimedia).
Download
@inproceedings{2ec6260a006246e8a7a230d5f5856abb,
title = "iART: A Search Engine for Art-Historical Images to Support Research in the Humanities",
abstract = "In this paper, we introduce iART: an open Web platform for art-historical research that facilitates the process of comparative vision. The system integrates various machine learning techniques for keyword- and content-based image retrieval as well as category formation via clustering. An intuitive GUI supports users to define queries and explore results. By using a state-of-the-art cross-modal deep learning approach, it is possible to search for concepts that were not previously detected by trained classification models. Art-historical objects from large, openly licensed collections such as Amsterdam Rijksmuseum and Wikidata are made available to users.",
keywords = "art retrieval, cross-modal retrieval, deep learning, web application",
author = "Matthias Springstein and Stefanie Schneider and Javad Rahnama and Eyke H{\"u}llermeier and Hubertus Kohle and Ralph Ewerth",
year = "2021",
month = oct,
day = "17",
doi = "10.48550/arXiv.2108.01542",
language = "English",
series = "MM 2021 - Proceedings of the 29th ACM International Conference on Multimedia",
pages = "2801--2803",
booktitle = "MM 2021",
note = "29th ACM International Conference on Multimedia, MM 2021 ; Conference date: 20-10-2021 Through 24-10-2021",

}

Download

TY - GEN

T1 - iART

T2 - 29th ACM International Conference on Multimedia, MM 2021

AU - Springstein, Matthias

AU - Schneider, Stefanie

AU - Rahnama, Javad

AU - Hüllermeier, Eyke

AU - Kohle, Hubertus

AU - Ewerth, Ralph

PY - 2021/10/17

Y1 - 2021/10/17

N2 - In this paper, we introduce iART: an open Web platform for art-historical research that facilitates the process of comparative vision. The system integrates various machine learning techniques for keyword- and content-based image retrieval as well as category formation via clustering. An intuitive GUI supports users to define queries and explore results. By using a state-of-the-art cross-modal deep learning approach, it is possible to search for concepts that were not previously detected by trained classification models. Art-historical objects from large, openly licensed collections such as Amsterdam Rijksmuseum and Wikidata are made available to users.

AB - In this paper, we introduce iART: an open Web platform for art-historical research that facilitates the process of comparative vision. The system integrates various machine learning techniques for keyword- and content-based image retrieval as well as category formation via clustering. An intuitive GUI supports users to define queries and explore results. By using a state-of-the-art cross-modal deep learning approach, it is possible to search for concepts that were not previously detected by trained classification models. Art-historical objects from large, openly licensed collections such as Amsterdam Rijksmuseum and Wikidata are made available to users.

KW - art retrieval

KW - cross-modal retrieval

KW - deep learning

KW - web application

UR - http://www.scopus.com/inward/record.url?scp=85119346617&partnerID=8YFLogxK

U2 - 10.48550/arXiv.2108.01542

DO - 10.48550/arXiv.2108.01542

M3 - Conference contribution

AN - SCOPUS:85119346617

T3 - MM 2021 - Proceedings of the 29th ACM International Conference on Multimedia

SP - 2801

EP - 2803

BT - MM 2021

Y2 - 20 October 2021 through 24 October 2021

ER -