MUWS'2023: The 2nd International Workshop on Multimodal Human Understanding for the Web and Social Media

Publikation: Beitrag in Buch/Bericht/Sammelwerk/KonferenzbandAufsatz in KonferenzbandForschungPeer-Review

Autoren

  • Gullal S. Cheema
  • Marc A. Kastner
  • Sherzod Hakimov
  • Noa Garcia

Organisationseinheiten

Externe Organisationen

  • Kyoto University
  • Universität Potsdam
  • Osaka University
Forschungs-netzwerk anzeigen

Details

OriginalspracheEnglisch
Titel des SammelwerksCIKM 2023
UntertitelProceedings of the 32nd ACM International Conference on Information and Knowledge Management
Herausgeber (Verlag)Association for Computing Machinery (ACM)
Seiten5263-5266
Seitenumfang4
ISBN (elektronisch)9798400701245
PublikationsstatusVeröffentlicht - 21 Okt. 2023
Veranstaltung32nd ACM International Conference on Information and Knowledge Management, CIKM 2023 - Birmingham, Großbritannien / Vereinigtes Königreich
Dauer: 21 Okt. 202325 Okt. 2023

Abstract

Multimodal human understanding and analysis is an emerging research area that cuts through several disciplines like Computer Vision (CV), Natural Language Processing (NLP), Speech Processing, Human-Computer Interaction (HCI), and Multimedia. Several multimodal learning techniques have recently shown the benefit of combining multiple modalities in image-text, audio-visual and video representation learning and various downstream multimodal tasks. At the core, these methods focus on modelling the modalities and their complex interactions by using large amounts of data, different loss functions and deep neural network architectures. However, for many Web and Social media applications, there is the need to model the human, including the understanding of human behaviour and perception. For this, it becomes important to consider interdisciplinary approaches, including social sciences, semiotics and psychology. The core is understanding various cross-modal relations, quantifying bias such as social biases, and the applicability of models to real-world problems. Interdisciplinary theories such as semiotics or gestalt psychology can provide additional insights and analysis on perceptual understanding through signs and symbols via multiple modalities. In general, these theories provide a compelling view of multimodality and perception that can further expand computational research and multimedia applications on the Web and Social media. The theme of the MUWS workshop, multimodal human understanding, includes various interdisciplinary challenges related to social bias analyses, multimodal representation learning, detection of human impressions or sentiment, hate speech, sarcasm in multimodal data, multimodal rhetoric and semantics, and related topics. The MUWS workshop will be an interactive event and include keynotes by relevant experts, poster and demo sessions, research presentations and discussion.

ASJC Scopus Sachgebiete

Zitieren

MUWS'2023: The 2nd International Workshop on Multimodal Human Understanding for the Web and Social Media. / Cheema, Gullal S.; Kastner, Marc A.; Hakimov, Sherzod et al.
CIKM 2023 : Proceedings of the 32nd ACM International Conference on Information and Knowledge Management. Association for Computing Machinery (ACM), 2023. S. 5263-5266.

Publikation: Beitrag in Buch/Bericht/Sammelwerk/KonferenzbandAufsatz in KonferenzbandForschungPeer-Review

Cheema, GS, Kastner, MA, Hakimov, S & Garcia, N 2023, MUWS'2023: The 2nd International Workshop on Multimodal Human Understanding for the Web and Social Media. in CIKM 2023 : Proceedings of the 32nd ACM International Conference on Information and Knowledge Management. Association for Computing Machinery (ACM), S. 5263-5266, 32nd ACM International Conference on Information and Knowledge Management, CIKM 2023, Birmingham, Großbritannien / Vereinigtes Königreich, 21 Okt. 2023. https://doi.org/10.1145/3583780.3615310
Cheema, G. S., Kastner, M. A., Hakimov, S., & Garcia, N. (2023). MUWS'2023: The 2nd International Workshop on Multimodal Human Understanding for the Web and Social Media. In CIKM 2023 : Proceedings of the 32nd ACM International Conference on Information and Knowledge Management (S. 5263-5266). Association for Computing Machinery (ACM). https://doi.org/10.1145/3583780.3615310
Cheema GS, Kastner MA, Hakimov S, Garcia N. MUWS'2023: The 2nd International Workshop on Multimodal Human Understanding for the Web and Social Media. in CIKM 2023 : Proceedings of the 32nd ACM International Conference on Information and Knowledge Management. Association for Computing Machinery (ACM). 2023. S. 5263-5266 doi: 10.1145/3583780.3615310
Cheema, Gullal S. ; Kastner, Marc A. ; Hakimov, Sherzod et al. / MUWS'2023 : The 2nd International Workshop on Multimodal Human Understanding for the Web and Social Media. CIKM 2023 : Proceedings of the 32nd ACM International Conference on Information and Knowledge Management. Association for Computing Machinery (ACM), 2023. S. 5263-5266
Download
@inproceedings{12b0095ba31f4029b847b2eb5cd20552,
title = "MUWS'2023: The 2nd International Workshop on Multimodal Human Understanding for the Web and Social Media",
abstract = "Multimodal human understanding and analysis is an emerging research area that cuts through several disciplines like Computer Vision (CV), Natural Language Processing (NLP), Speech Processing, Human-Computer Interaction (HCI), and Multimedia. Several multimodal learning techniques have recently shown the benefit of combining multiple modalities in image-text, audio-visual and video representation learning and various downstream multimodal tasks. At the core, these methods focus on modelling the modalities and their complex interactions by using large amounts of data, different loss functions and deep neural network architectures. However, for many Web and Social media applications, there is the need to model the human, including the understanding of human behaviour and perception. For this, it becomes important to consider interdisciplinary approaches, including social sciences, semiotics and psychology. The core is understanding various cross-modal relations, quantifying bias such as social biases, and the applicability of models to real-world problems. Interdisciplinary theories such as semiotics or gestalt psychology can provide additional insights and analysis on perceptual understanding through signs and symbols via multiple modalities. In general, these theories provide a compelling view of multimodality and perception that can further expand computational research and multimedia applications on the Web and Social media. The theme of the MUWS workshop, multimodal human understanding, includes various interdisciplinary challenges related to social bias analyses, multimodal representation learning, detection of human impressions or sentiment, hate speech, sarcasm in multimodal data, multimodal rhetoric and semantics, and related topics. The MUWS workshop will be an interactive event and include keynotes by relevant experts, poster and demo sessions, research presentations and discussion.",
keywords = "human understanding, image-text relations, machine learning, multimodality, semiotics, social media, web",
author = "Cheema, {Gullal S.} and Kastner, {Marc A.} and Sherzod Hakimov and Noa Garcia",
note = "Funding Information: The MUWS 2023 workshop is co-organised by members who received funding from the German Federal Ministry of Education and Research (BMBF, FakeNarratives project, no. 16KIS1517). ; 32nd ACM International Conference on Information and Knowledge Management, CIKM 2023 ; Conference date: 21-10-2023 Through 25-10-2023",
year = "2023",
month = oct,
day = "21",
doi = "10.1145/3583780.3615310",
language = "English",
pages = "5263--5266",
booktitle = "CIKM 2023",
publisher = "Association for Computing Machinery (ACM)",
address = "United States",

}

Download

TY - GEN

T1 - MUWS'2023

T2 - 32nd ACM International Conference on Information and Knowledge Management, CIKM 2023

AU - Cheema, Gullal S.

AU - Kastner, Marc A.

AU - Hakimov, Sherzod

AU - Garcia, Noa

N1 - Funding Information: The MUWS 2023 workshop is co-organised by members who received funding from the German Federal Ministry of Education and Research (BMBF, FakeNarratives project, no. 16KIS1517).

PY - 2023/10/21

Y1 - 2023/10/21

N2 - Multimodal human understanding and analysis is an emerging research area that cuts through several disciplines like Computer Vision (CV), Natural Language Processing (NLP), Speech Processing, Human-Computer Interaction (HCI), and Multimedia. Several multimodal learning techniques have recently shown the benefit of combining multiple modalities in image-text, audio-visual and video representation learning and various downstream multimodal tasks. At the core, these methods focus on modelling the modalities and their complex interactions by using large amounts of data, different loss functions and deep neural network architectures. However, for many Web and Social media applications, there is the need to model the human, including the understanding of human behaviour and perception. For this, it becomes important to consider interdisciplinary approaches, including social sciences, semiotics and psychology. The core is understanding various cross-modal relations, quantifying bias such as social biases, and the applicability of models to real-world problems. Interdisciplinary theories such as semiotics or gestalt psychology can provide additional insights and analysis on perceptual understanding through signs and symbols via multiple modalities. In general, these theories provide a compelling view of multimodality and perception that can further expand computational research and multimedia applications on the Web and Social media. The theme of the MUWS workshop, multimodal human understanding, includes various interdisciplinary challenges related to social bias analyses, multimodal representation learning, detection of human impressions or sentiment, hate speech, sarcasm in multimodal data, multimodal rhetoric and semantics, and related topics. The MUWS workshop will be an interactive event and include keynotes by relevant experts, poster and demo sessions, research presentations and discussion.

AB - Multimodal human understanding and analysis is an emerging research area that cuts through several disciplines like Computer Vision (CV), Natural Language Processing (NLP), Speech Processing, Human-Computer Interaction (HCI), and Multimedia. Several multimodal learning techniques have recently shown the benefit of combining multiple modalities in image-text, audio-visual and video representation learning and various downstream multimodal tasks. At the core, these methods focus on modelling the modalities and their complex interactions by using large amounts of data, different loss functions and deep neural network architectures. However, for many Web and Social media applications, there is the need to model the human, including the understanding of human behaviour and perception. For this, it becomes important to consider interdisciplinary approaches, including social sciences, semiotics and psychology. The core is understanding various cross-modal relations, quantifying bias such as social biases, and the applicability of models to real-world problems. Interdisciplinary theories such as semiotics or gestalt psychology can provide additional insights and analysis on perceptual understanding through signs and symbols via multiple modalities. In general, these theories provide a compelling view of multimodality and perception that can further expand computational research and multimedia applications on the Web and Social media. The theme of the MUWS workshop, multimodal human understanding, includes various interdisciplinary challenges related to social bias analyses, multimodal representation learning, detection of human impressions or sentiment, hate speech, sarcasm in multimodal data, multimodal rhetoric and semantics, and related topics. The MUWS workshop will be an interactive event and include keynotes by relevant experts, poster and demo sessions, research presentations and discussion.

KW - human understanding

KW - image-text relations

KW - machine learning

KW - multimodality

KW - semiotics

KW - social media

KW - web

UR - http://www.scopus.com/inward/record.url?scp=85178153385&partnerID=8YFLogxK

U2 - 10.1145/3583780.3615310

DO - 10.1145/3583780.3615310

M3 - Conference contribution

AN - SCOPUS:85178153385

SP - 5263

EP - 5266

BT - CIKM 2023

PB - Association for Computing Machinery (ACM)

Y2 - 21 October 2023 through 25 October 2023

ER -