Details
| Original language | English |
|---|---|
| Title of host publication | Proceedings of the 17th International Workshop on Semantic Evaluation (SemEval-2023) |
| Editors | Atul Kr. Ojha, A. Seza Doğruöz, Giovanni Da San Martino, Harish Tayyar Madabushi, Ritesh Kumar, Elisa Sartori |
| Pages | 2287-2303 |
| Number of pages | 17 |
| ISBN (electronic) | 9781959429999 |
| Publication status | Published - Jul 2023 |
| Event | 17th International Workshop on Semantic Evaluation - Toronto, Canada Duration: 13 Jul 2023 → 14 Jul 2023 |
Abstract
Argumentation is ubiquitous in natural language communication, from politics and media to everyday work and private life. Many arguments derive their persuasive power from human values, such as self-directed thought or tolerance, albeit often implicitly. These values are key to understanding the semantics of arguments, as they are generally accepted as justifications for why a particular option is ethically desirable. Can automated systems uncover the values on which an argument draws? To answer this question, 39 teams submitted runs to ValueEval’23. Using a multi-sourced dataset of over 9K arguments, the systems achieved F 1-scores up to 0.87 (nature) and over 0.70 for three more of 20 universal value categories. However, many challenges remain, as evidenced by the low peak F 1-score of 0.39 for stimulation, hedonism, face, and humility.
ASJC Scopus subject areas
- Mathematics(all)
- Theoretical Computer Science
- Computer Science(all)
- Computer Science Applications
- Computer Science(all)
- Computational Theory and Mathematics
Cite this
- Standard
- Harvard
- Apa
- Vancouver
- BibTeX
- RIS
Proceedings of the 17th International Workshop on Semantic Evaluation (SemEval-2023). ed. / Atul Kr. Ojha; A. Seza Doğruöz; Giovanni Da San Martino; Harish Tayyar Madabushi; Ritesh Kumar; Elisa Sartori. 2023. p. 2287-2303.
Research output: Chapter in book/report/conference proceeding › Conference contribution › Research › peer review
}
TY - GEN
T1 - SemEval-2023 Task 4: ValueEval
T2 - 17th International Workshop on Semantic Evaluation
AU - Kiesel, Johannes
AU - Alshomary, Milad
AU - Mirzakhmedova, Nailia
AU - Heinrich, Maximilian
AU - Handke, Nicolas
AU - Wachsmuth, Henning
AU - Stein, Benno
PY - 2023/7
Y1 - 2023/7
N2 - Argumentation is ubiquitous in natural language communication, from politics and media to everyday work and private life. Many arguments derive their persuasive power from human values, such as self-directed thought or tolerance, albeit often implicitly. These values are key to understanding the semantics of arguments, as they are generally accepted as justifications for why a particular option is ethically desirable. Can automated systems uncover the values on which an argument draws? To answer this question, 39 teams submitted runs to ValueEval’23. Using a multi-sourced dataset of over 9K arguments, the systems achieved F 1-scores up to 0.87 (nature) and over 0.70 for three more of 20 universal value categories. However, many challenges remain, as evidenced by the low peak F 1-score of 0.39 for stimulation, hedonism, face, and humility.
AB - Argumentation is ubiquitous in natural language communication, from politics and media to everyday work and private life. Many arguments derive their persuasive power from human values, such as self-directed thought or tolerance, albeit often implicitly. These values are key to understanding the semantics of arguments, as they are generally accepted as justifications for why a particular option is ethically desirable. Can automated systems uncover the values on which an argument draws? To answer this question, 39 teams submitted runs to ValueEval’23. Using a multi-sourced dataset of over 9K arguments, the systems achieved F 1-scores up to 0.87 (nature) and over 0.70 for three more of 20 universal value categories. However, many challenges remain, as evidenced by the low peak F 1-score of 0.39 for stimulation, hedonism, face, and humility.
UR - http://www.scopus.com/inward/record.url?scp=85161346703&partnerID=8YFLogxK
U2 - 10.18653/V1/2023.SEMEVAL-1.313
DO - 10.18653/V1/2023.SEMEVAL-1.313
M3 - Conference contribution
SP - 2287
EP - 2303
BT - Proceedings of the 17th International Workshop on Semantic Evaluation (SemEval-2023)
A2 - Ojha, Atul Kr.
A2 - Doğruöz, A. Seza
A2 - Da San Martino, Giovanni
A2 - Madabushi, Harish Tayyar
A2 - Kumar, Ritesh
A2 - Sartori, Elisa
Y2 - 13 July 2023 through 14 July 2023
ER -