Details
| Originalsprache | Englisch |
|---|---|
| Titel des Sammelwerks | Proceedings of the 17th International Workshop on Semantic Evaluation (SemEval-2023) |
| Herausgeber/-innen | Atul Kr. Ojha, A. Seza Doğruöz, Giovanni Da San Martino, Harish Tayyar Madabushi, Ritesh Kumar, Elisa Sartori |
| Seiten | 2287-2303 |
| Seitenumfang | 17 |
| ISBN (elektronisch) | 9781959429999 |
| Publikationsstatus | Veröffentlicht - Juli 2023 |
| Veranstaltung | 17th International Workshop on Semantic Evaluation - Toronto, Kanada Dauer: 13 Juli 2023 → 14 Juli 2023 |
Abstract
Argumentation is ubiquitous in natural language communication, from politics and media to everyday work and private life. Many arguments derive their persuasive power from human values, such as self-directed thought or tolerance, albeit often implicitly. These values are key to understanding the semantics of arguments, as they are generally accepted as justifications for why a particular option is ethically desirable. Can automated systems uncover the values on which an argument draws? To answer this question, 39 teams submitted runs to ValueEval’23. Using a multi-sourced dataset of over 9K arguments, the systems achieved F 1-scores up to 0.87 (nature) and over 0.70 for three more of 20 universal value categories. However, many challenges remain, as evidenced by the low peak F 1-score of 0.39 for stimulation, hedonism, face, and humility.
ASJC Scopus Sachgebiete
- Mathematik (insg.)
- Theoretische Informatik
- Informatik (insg.)
- Angewandte Informatik
- Informatik (insg.)
- Theoretische Informatik und Mathematik
Zitieren
- Standard
- Harvard
- Apa
- Vancouver
- BibTex
- RIS
Proceedings of the 17th International Workshop on Semantic Evaluation (SemEval-2023). Hrsg. / Atul Kr. Ojha; A. Seza Doğruöz; Giovanni Da San Martino; Harish Tayyar Madabushi; Ritesh Kumar; Elisa Sartori. 2023. S. 2287-2303.
Publikation: Beitrag in Buch/Bericht/Sammelwerk/Konferenzband › Aufsatz in Konferenzband › Forschung › Peer-Review
}
TY - GEN
T1 - SemEval-2023 Task 4: ValueEval
T2 - 17th International Workshop on Semantic Evaluation
AU - Kiesel, Johannes
AU - Alshomary, Milad
AU - Mirzakhmedova, Nailia
AU - Heinrich, Maximilian
AU - Handke, Nicolas
AU - Wachsmuth, Henning
AU - Stein, Benno
PY - 2023/7
Y1 - 2023/7
N2 - Argumentation is ubiquitous in natural language communication, from politics and media to everyday work and private life. Many arguments derive their persuasive power from human values, such as self-directed thought or tolerance, albeit often implicitly. These values are key to understanding the semantics of arguments, as they are generally accepted as justifications for why a particular option is ethically desirable. Can automated systems uncover the values on which an argument draws? To answer this question, 39 teams submitted runs to ValueEval’23. Using a multi-sourced dataset of over 9K arguments, the systems achieved F 1-scores up to 0.87 (nature) and over 0.70 for three more of 20 universal value categories. However, many challenges remain, as evidenced by the low peak F 1-score of 0.39 for stimulation, hedonism, face, and humility.
AB - Argumentation is ubiquitous in natural language communication, from politics and media to everyday work and private life. Many arguments derive their persuasive power from human values, such as self-directed thought or tolerance, albeit often implicitly. These values are key to understanding the semantics of arguments, as they are generally accepted as justifications for why a particular option is ethically desirable. Can automated systems uncover the values on which an argument draws? To answer this question, 39 teams submitted runs to ValueEval’23. Using a multi-sourced dataset of over 9K arguments, the systems achieved F 1-scores up to 0.87 (nature) and over 0.70 for three more of 20 universal value categories. However, many challenges remain, as evidenced by the low peak F 1-score of 0.39 for stimulation, hedonism, face, and humility.
UR - http://www.scopus.com/inward/record.url?scp=85161346703&partnerID=8YFLogxK
U2 - 10.18653/V1/2023.SEMEVAL-1.313
DO - 10.18653/V1/2023.SEMEVAL-1.313
M3 - Conference contribution
SP - 2287
EP - 2303
BT - Proceedings of the 17th International Workshop on Semantic Evaluation (SemEval-2023)
A2 - Ojha, Atul Kr.
A2 - Doğruöz, A. Seza
A2 - Da San Martino, Giovanni
A2 - Madabushi, Harish Tayyar
A2 - Kumar, Ritesh
A2 - Sartori, Elisa
Y2 - 13 July 2023 through 14 July 2023
ER -