Intrinsic Quality Assessment of Arguments

Research output: Chapter in book/report/conference proceedingConference contributionResearch

Authors

External Research Organisations

  • Paderborn University
View graph of relations

Details

Original languageEnglish
Title of host publicationCOLING 2020 - 28th International Conference on Computational Linguistics, Proceedings of the Conference
EditorsDonia Scott, Nuria Bel, Chengqing Zong
Pages6739-6745
Number of pages7
ISBN (electronic)9781952148279
Publication statusPublished - 2020
Externally publishedYes
Event28th International Conference on Computational Linguistics - Barcelona (Online), Spain
Duration: 8 Dec 202013 Dec 2020

Abstract

Several quality dimensions of natural language arguments have been investigated. Some are likely to be reflected in linguistic features (e.g., an argument’s arrangement), whereas others depend on context (e.g., relevance) or topic knowledge (e.g., acceptability). In this paper, we study the intrinsic computational assessment of 15 dimensions, i.e., only learning from an argument’s text. In systematic experiments with eight feature types on an existing corpus, we observe moderate but significant learning success for most dimensions. Rhetorical quality seems hardest to assess, and subjectivity features turn out strong, although length bias in the corpus impedes full validity. We also find that human assessors differ more clearly to each other than to our approach.

ASJC Scopus subject areas

Cite this

Intrinsic Quality Assessment of Arguments. / Wachsmuth, Henning; Werner, Till.
COLING 2020 - 28th International Conference on Computational Linguistics, Proceedings of the Conference. ed. / Donia Scott; Nuria Bel; Chengqing Zong. 2020. p. 6739-6745.

Research output: Chapter in book/report/conference proceedingConference contributionResearch

Wachsmuth, H & Werner, T 2020, Intrinsic Quality Assessment of Arguments. in D Scott, N Bel & C Zong (eds), COLING 2020 - 28th International Conference on Computational Linguistics, Proceedings of the Conference. pp. 6739-6745, 28th International Conference on Computational Linguistics, Barcelona (Online), Spain, 8 Dec 2020. https://doi.org/10.18653/v1/2020.coling-main.592
Wachsmuth, H., & Werner, T. (2020). Intrinsic Quality Assessment of Arguments. In D. Scott, N. Bel, & C. Zong (Eds.), COLING 2020 - 28th International Conference on Computational Linguistics, Proceedings of the Conference (pp. 6739-6745) https://doi.org/10.18653/v1/2020.coling-main.592
Wachsmuth H, Werner T. Intrinsic Quality Assessment of Arguments. In Scott D, Bel N, Zong C, editors, COLING 2020 - 28th International Conference on Computational Linguistics, Proceedings of the Conference. 2020. p. 6739-6745 doi: 10.18653/v1/2020.coling-main.592
Wachsmuth, Henning ; Werner, Till. / Intrinsic Quality Assessment of Arguments. COLING 2020 - 28th International Conference on Computational Linguistics, Proceedings of the Conference. editor / Donia Scott ; Nuria Bel ; Chengqing Zong. 2020. pp. 6739-6745
Download
@inproceedings{e8fbec912d314a4eb8f6c9b2cf331991,
title = "Intrinsic Quality Assessment of Arguments",
abstract = "Several quality dimensions of natural language arguments have been investigated. Some are likely to be reflected in linguistic features (e.g., an argument{\textquoteright}s arrangement), whereas others depend on context (e.g., relevance) or topic knowledge (e.g., acceptability). In this paper, we study the intrinsic computational assessment of 15 dimensions, i.e., only learning from an argument{\textquoteright}s text. In systematic experiments with eight feature types on an existing corpus, we observe moderate but significant learning success for most dimensions. Rhetorical quality seems hardest to assess, and subjectivity features turn out strong, although length bias in the corpus impedes full validity. We also find that human assessors differ more clearly to each other than to our approach.",
author = "Henning Wachsmuth and Till Werner",
note = "Publisher Copyright: {\textcopyright} 2020 COLING 2020 - 28th International Conference on Computational Linguistics, Proceedings of the Conference. All rights reserved.; 28th International Conference on Computational Linguistics ; Conference date: 08-12-2020 Through 13-12-2020",
year = "2020",
doi = "10.18653/v1/2020.coling-main.592",
language = "English",
pages = "6739--6745",
editor = "Donia Scott and Nuria Bel and Chengqing Zong",
booktitle = "COLING 2020 - 28th International Conference on Computational Linguistics, Proceedings of the Conference",

}

Download

TY - GEN

T1 - Intrinsic Quality Assessment of Arguments

AU - Wachsmuth, Henning

AU - Werner, Till

N1 - Publisher Copyright: © 2020 COLING 2020 - 28th International Conference on Computational Linguistics, Proceedings of the Conference. All rights reserved.

PY - 2020

Y1 - 2020

N2 - Several quality dimensions of natural language arguments have been investigated. Some are likely to be reflected in linguistic features (e.g., an argument’s arrangement), whereas others depend on context (e.g., relevance) or topic knowledge (e.g., acceptability). In this paper, we study the intrinsic computational assessment of 15 dimensions, i.e., only learning from an argument’s text. In systematic experiments with eight feature types on an existing corpus, we observe moderate but significant learning success for most dimensions. Rhetorical quality seems hardest to assess, and subjectivity features turn out strong, although length bias in the corpus impedes full validity. We also find that human assessors differ more clearly to each other than to our approach.

AB - Several quality dimensions of natural language arguments have been investigated. Some are likely to be reflected in linguistic features (e.g., an argument’s arrangement), whereas others depend on context (e.g., relevance) or topic knowledge (e.g., acceptability). In this paper, we study the intrinsic computational assessment of 15 dimensions, i.e., only learning from an argument’s text. In systematic experiments with eight feature types on an existing corpus, we observe moderate but significant learning success for most dimensions. Rhetorical quality seems hardest to assess, and subjectivity features turn out strong, although length bias in the corpus impedes full validity. We also find that human assessors differ more clearly to each other than to our approach.

UR - http://www.scopus.com/inward/record.url?scp=85101482308&partnerID=8YFLogxK

U2 - 10.18653/v1/2020.coling-main.592

DO - 10.18653/v1/2020.coling-main.592

M3 - Conference contribution

SP - 6739

EP - 6745

BT - COLING 2020 - 28th International Conference on Computational Linguistics, Proceedings of the Conference

A2 - Scott, Donia

A2 - Bel, Nuria

A2 - Zong, Chengqing

T2 - 28th International Conference on Computational Linguistics

Y2 - 8 December 2020 through 13 December 2020

ER -

By the same author(s)