The Argument Reasoning Comprehension Task: Identification and Reconstruction of Implicit Warrants

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Authors

External Research Organisations

  • Technische Universität Darmstadt
  • Bauhaus-Universität Weimar
View graph of relations

Details

Original languageEnglish
Title of host publicationProceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers)
EditorsMarilyn Walker, Heng Ji, Amanda Stent
Place of PublicationNew Orleans
Pages1930-1940
Number of pages11
Publication statusPublished - 2018
Externally publishedYes
Event2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL HLT 2018 - New Orleans, United States
Duration: 1 Jun 20186 Jun 2018

Abstract

Reasoning is a crucial part of natural language argumentation. To comprehend an argument, one must analyze its warrant, which explains why its claim follows from its premises. As arguments are highly contextualized, warrants are usually presupposed and left implicit. Thus, the comprehension does not only require language understanding and logic skills, but also depends on common sense. In this paper we develop a methodology for reconstructing warrants systematically. We operationalize it in a scalable crowdsourcing process, resulting in a freely licensed dataset with warrants for 2k authentic arguments from news comments. 1 On this basis, we present a new challenging task, the argument reasoning comprehension task. Given an argument with a claim and a premise, the goal is to choose the correct implicit warrant from two options. Both warrants are plausible and lexically close, but lead to contradicting claims. A solution to this task will define a substantial step towards automatic warrant reconstruction. However, experiments with several neural attention and language models reveal that current approaches do not suffice.

ASJC Scopus subject areas

Cite this

The Argument Reasoning Comprehension Task: Identification and Reconstruction of Implicit Warrants. / Habernal, Ivan; Wachsmuth, Henning; Gurevych, Iryna et al.
Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers). ed. / Marilyn Walker; Heng Ji; Amanda Stent. New Orleans, 2018. p. 1930-1940.

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Habernal, I, Wachsmuth, H, Gurevych, I & Stein, B 2018, The Argument Reasoning Comprehension Task: Identification and Reconstruction of Implicit Warrants. in M Walker, H Ji & A Stent (eds), Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers). New Orleans, pp. 1930-1940, 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL HLT 2018, New Orleans, United States, 1 Jun 2018. https://doi.org/10.48550/arXiv.1708.01425, https://doi.org/10.18653/v1/N18-1175
Habernal, I., Wachsmuth, H., Gurevych, I., & Stein, B. (2018). The Argument Reasoning Comprehension Task: Identification and Reconstruction of Implicit Warrants. In M. Walker, H. Ji, & A. Stent (Eds.), Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) (pp. 1930-1940). https://doi.org/10.48550/arXiv.1708.01425, https://doi.org/10.18653/v1/N18-1175
Habernal I, Wachsmuth H, Gurevych I, Stein B. The Argument Reasoning Comprehension Task: Identification and Reconstruction of Implicit Warrants. In Walker M, Ji H, Stent A, editors, Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers). New Orleans. 2018. p. 1930-1940 doi: 10.48550/arXiv.1708.01425, 10.18653/v1/N18-1175
Habernal, Ivan ; Wachsmuth, Henning ; Gurevych, Iryna et al. / The Argument Reasoning Comprehension Task : Identification and Reconstruction of Implicit Warrants. Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers). editor / Marilyn Walker ; Heng Ji ; Amanda Stent. New Orleans, 2018. pp. 1930-1940
Download
@inproceedings{e57d50c37b5d439984fb9cd2363a687d,
title = "The Argument Reasoning Comprehension Task: Identification and Reconstruction of Implicit Warrants",
abstract = "Reasoning is a crucial part of natural language argumentation. To comprehend an argument, one must analyze its warrant, which explains why its claim follows from its premises. As arguments are highly contextualized, warrants are usually presupposed and left implicit. Thus, the comprehension does not only require language understanding and logic skills, but also depends on common sense. In this paper we develop a methodology for reconstructing warrants systematically. We operationalize it in a scalable crowdsourcing process, resulting in a freely licensed dataset with warrants for 2k authentic arguments from news comments. 1 On this basis, we present a new challenging task, the argument reasoning comprehension task. Given an argument with a claim and a premise, the goal is to choose the correct implicit warrant from two options. Both warrants are plausible and lexically close, but lead to contradicting claims. A solution to this task will define a substantial step towards automatic warrant reconstruction. However, experiments with several neural attention and language models reveal that current approaches do not suffice.",
author = "Ivan Habernal and Henning Wachsmuth and Iryna Gurevych and Benno Stein",
note = "Funding Information: This work has been supported by the ArguAna Project GU 798/20-1 (DFG), and by the DFG-funded research training group “Adaptive Preparation of Information form Heterogeneous Sources” (AIPHES, GRK 1994/1).; 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL HLT 2018 ; Conference date: 01-06-2018 Through 06-06-2018",
year = "2018",
doi = "10.48550/arXiv.1708.01425",
language = "English",
isbn = "9781948087278",
pages = "1930--1940",
editor = "Marilyn Walker and Heng Ji and Amanda Stent",
booktitle = "Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers)",

}

Download

TY - GEN

T1 - The Argument Reasoning Comprehension Task

T2 - 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL HLT 2018

AU - Habernal, Ivan

AU - Wachsmuth, Henning

AU - Gurevych, Iryna

AU - Stein, Benno

N1 - Funding Information: This work has been supported by the ArguAna Project GU 798/20-1 (DFG), and by the DFG-funded research training group “Adaptive Preparation of Information form Heterogeneous Sources” (AIPHES, GRK 1994/1).

PY - 2018

Y1 - 2018

N2 - Reasoning is a crucial part of natural language argumentation. To comprehend an argument, one must analyze its warrant, which explains why its claim follows from its premises. As arguments are highly contextualized, warrants are usually presupposed and left implicit. Thus, the comprehension does not only require language understanding and logic skills, but also depends on common sense. In this paper we develop a methodology for reconstructing warrants systematically. We operationalize it in a scalable crowdsourcing process, resulting in a freely licensed dataset with warrants for 2k authentic arguments from news comments. 1 On this basis, we present a new challenging task, the argument reasoning comprehension task. Given an argument with a claim and a premise, the goal is to choose the correct implicit warrant from two options. Both warrants are plausible and lexically close, but lead to contradicting claims. A solution to this task will define a substantial step towards automatic warrant reconstruction. However, experiments with several neural attention and language models reveal that current approaches do not suffice.

AB - Reasoning is a crucial part of natural language argumentation. To comprehend an argument, one must analyze its warrant, which explains why its claim follows from its premises. As arguments are highly contextualized, warrants are usually presupposed and left implicit. Thus, the comprehension does not only require language understanding and logic skills, but also depends on common sense. In this paper we develop a methodology for reconstructing warrants systematically. We operationalize it in a scalable crowdsourcing process, resulting in a freely licensed dataset with warrants for 2k authentic arguments from news comments. 1 On this basis, we present a new challenging task, the argument reasoning comprehension task. Given an argument with a claim and a premise, the goal is to choose the correct implicit warrant from two options. Both warrants are plausible and lexically close, but lead to contradicting claims. A solution to this task will define a substantial step towards automatic warrant reconstruction. However, experiments with several neural attention and language models reveal that current approaches do not suffice.

UR - http://www.scopus.com/inward/record.url?scp=85064116274&partnerID=8YFLogxK

U2 - 10.48550/arXiv.1708.01425

DO - 10.48550/arXiv.1708.01425

M3 - Conference contribution

AN - SCOPUS:85064116274

SN - 9781948087278

SP - 1930

EP - 1940

BT - Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers)

A2 - Walker, Marilyn

A2 - Ji, Heng

A2 - Stent, Amanda

CY - New Orleans

Y2 - 1 June 2018 through 6 June 2018

ER -

By the same author(s)