English
Related papers

Related papers: Limited Generalizability in Argument Mining: State…

200 papers

Framing continues to remain one of the most extensively applied theories in political communication. Developments in computation, particularly with the introduction of transformer architecture and more so with large language models (LLMs),…

Computation and Language · Computer Science 2026-03-30 Vihang Jumle

Automated large-scale analysis of public discussions around contested issues like abortion requires detecting and understanding the use of arguments. While Large Language Models (LLMs) have shown promise in language processing tasks, their…

Computation and Language · Computer Science 2025-05-30 Matteo Guida , Yulia Otmakhova , Eduard Hovy , Lea Frermann

Pre-trained language models (PLMs) like BERT are being used for almost all language-related tasks, but interpreting their behavior still remains a significant challenge and many important questions remain largely unanswered. In this work,…

Computation and Language · Computer Science 2021-09-28 Samuel Stevens , Yu Su

Large Language Models (LLMs) have fundamentally reshaped Argument Mining (AM), shifting it from a pipeline of supervised, task-specific classifiers to a spectrum of prompt-driven, retrieval-augmented, and reasoning-oriented paradigms. Yet…

Computation and Language · Computer Science 2025-11-26 Hao Li , Viktor Schlegel , Yizheng Sun , Riza Batista-Navarro , Goran Nenadic

In recent years, large pretrained models have been used in dialogue systems to improve successful task completion rates. However, lack of reasoning capabilities of dialogue platforms make it difficult to provide relevant and fluent…

Computation and Language · Computer Science 2022-02-10 Sajjad Beygi , Maryam Fazel-Zarandi , Alessandra Cervone , Prakash Krishnan , Siddhartha Reddy Jonnalagadda

Argument mining is a subfield of argumentation that aims to automatically extract argumentative structures and their relations from natural language texts. This paper investigates how a single large language model can be leveraged to…

Computation and Language · Computer Science 2025-08-26 Henri Savigny , Bruno Yun

Existing work on probing of pretrained language models (LMs) has predominantly focused on sentence-level syntactic tasks. In this paper, we introduce document-level discourse probing to evaluate the ability of pretrained LMs to capture…

Computation and Language · Computer Science 2021-04-14 Fajri Koto , Jey Han Lau , Timothy Baldwin

Natural Language Processing (NLP) has witnessed a transformative leap with the advent of transformer-based architectures, which have significantly enhanced the ability of machines to understand and generate human-like text. This paper…

Computation and Language · Computer Science 2025-03-27 Tianhao Wu , Yu Wang , Ngoc Quach

Transformer-based language models achieve high performance on various tasks, but we still lack understanding of the kind of linguistic knowledge they learn and rely on. We evaluate three models (BERT, RoBERTa, and ALBERT), testing their…

Computation and Language · Computer Science 2020-11-03 Marius Mosbach , Stefania Degaetano-Ortlieb , Marie-Pauline Krielke , Badr M. Abdullah , Dietrich Klakow

Large Language Models (LLMs) achieve strong performance in analyzing and generating text, yet they struggle with explicit, transparent, and verifiable reasoning over complex texts such as those containing debates. In particular, they lack…

Artificial Intelligence · Computer Science 2026-03-04 Gianvincenzo Alfano , Sergio Greco , Lucio La Cava , Stefano Francesco Monea , Irina Trubitsyna

We analyze the ability of pre-trained language models to transfer knowledge among datasets annotated with different type systems and to generalize beyond the domain and dataset they were trained on. We create a meta task, over multiple…

Computation and Language · Computer Science 2021-12-16 Jaromir Savelka , Hannes Westermann , Karim Benyekhlef

In order to simplify a sentence, human editors perform multiple rewriting transformations: they split it into several shorter sentences, paraphrase words (i.e. replacing complex words or phrases by simpler synonyms), reorder components,…

Computation and Language · Computer Science 2020-05-04 Fernando Alva-Manchego , Louis Martin , Antoine Bordes , Carolina Scarton , Benoît Sagot , Lucia Specia

This paper presents new state-of-the-art models for three tasks, part-of-speech tagging, syntactic parsing, and semantic parsing, using the cutting-edge contextualized embedding framework known as BERT. For each task, we first replicate and…

Computation and Language · Computer Science 2020-05-26 Han He , Jinho D. Choi

The task of Argument Mining, that is extracting and classifying argument components for a specific topic from large document sources, is an inherently difficult task for machine learning models and humans alike, as large Argument Mining…

Computation and Language · Computer Science 2024-10-08 Benjamin Schiller , Johannes Daxenberger , Andreas Waldis , Iryna Gurevych

Recently, transformer-based methods such as RoBERTa and GPT-3 have led to significant experimental advances in natural language processing tasks such as question answering and commonsense reasoning. The latter is typically evaluated through…

Computation and Language · Computer Science 2020-11-19 Mayank Kejriwal , Ke Shen

As frontier language models increasingly saturate standard QA benchmarks, concerns about data contamination, memorization, and escalating dataset creation costs persist. We propose a debate-driven evaluation paradigm that transforms any…

Computation and Language · Computer Science 2025-08-11 Linbo Cao , Jinman Zhao

With the recent influx of bidirectional contextualized transformer language models in the NLP, it becomes a necessity to have a systematic comparative study of these models on variety of datasets. Also, the performance of these language…

Computation and Language · Computer Science 2020-09-10 Mayank Chhipa , Hrushikesh Mahesh Vazurkar , Abhijeet Kumar , Mridul Mishra

Pre-trained and fine-tuned transformer models like BERT and T5 have improved the state of the art in ad-hoc retrieval and question-answering, but not as yet in high-recall information retrieval, where the objective is to retrieve…

Information Retrieval · Computer Science 2022-08-16 Nima Sadri , Gordon V. Cormack

Pre-trained language models have recently emerged as a powerful tool for fine-tuning a variety of language tasks. Ideally, when models are pre-trained on large amount of data, they are expected to gain implicit knowledge. In this paper, we…

Computation and Language · Computer Science 2023-06-22 Mohamad Ballout , Ulf Krumnack , Gunther Heidemann , Kai-Uwe Kühnberger

Argument Mining is the research area which aims at extracting argument components and predicting argumentative relations (i.e.,support and attack) from text. In particular, numerous approaches have been proposed in the literature to predict…

Computation and Language · Computer Science 2020-03-12 Oana Cocarascu , Elena Cabrio , Serena Villata , Francesca Toni