English
Related papers

Related papers: Argument Summarization and its Evaluation in the E…

200 papers

Pre-trained Large Language Models (LLMs) are beginning to dominate the discourse around automatic code generation with natural language specifications. In contrast, the best-performing synthesizers in the domain of formal synthesis with…

Artificial Intelligence · Computer Science 2024-05-28 Yixuan Li , Julian Parsert , Elizabeth Polgreen

Automated large-scale analysis of public discussions around contested issues like abortion requires detecting and understanding the use of arguments. While Large Language Models (LLMs) have shown promise in language processing tasks, their…

Computation and Language · Computer Science 2025-05-30 Matteo Guida , Yulia Otmakhova , Eduard Hovy , Lea Frermann

Extractive summarization plays a pivotal role in natural language processing due to its wide-range applications in summarizing diverse content efficiently, while also being faithful to the original content. Despite significant advancement…

Computation and Language · Computer Science 2024-07-09 Mihir Parmar , Hanieh Deilamsalehy , Franck Dernoncourt , Seunghyun Yoon , Ryan A. Rossi , Trung Bui

Text summarization research has undergone several significant transformations with the advent of deep neural networks, pre-trained language models (PLMs), and recent large language models (LLMs). This survey thus provides a comprehensive…

Computation and Language · Computer Science 2024-06-18 Haopeng Zhang , Philip S. Yu , Jiawei Zhang

Large Language Models (LLMs) achieve strong performance in analyzing and generating text, yet they struggle with explicit, transparent, and verifiable reasoning over complex texts such as those containing debates. In particular, they lack…

Artificial Intelligence · Computer Science 2026-03-04 Gianvincenzo Alfano , Sergio Greco , Lucio La Cava , Stefano Francesco Monea , Irina Trubitsyna

Large Language Models (LLMs) exhibit powerful summarization abilities. However, their capabilities on conversational summarization remains under explored. In this work we evaluate LLMs (approx. 10 billion parameters) on conversational…

Computation and Language · Computer Science 2023-12-01 Ramesh Manuvinakurike , Saurav Sahay , Sangeeta Manepalli , Lama Nachman

Large Language Models (LLMs) are increasingly adopted as evaluators, offering a scalable alternative to human annotation. However, existing supervised fine-tuning (SFT) approaches often fall short in domains that demand complex reasoning.…

Computation and Language · Computer Science 2025-11-04 Nuo Chen , Zhiyuan Hu , Qingyun Zou , Jiaying Wu , Qian Wang , Bryan Hooi , Bingsheng He

The summarization capabilities of pretrained and large language models (LLMs) have been widely validated in general areas, but their use in scientific corpus, which involves complex sentences and specialized knowledge, has been less…

Computation and Language · Computer Science 2025-05-05 Xiuying Chen , Tairan Wang , Qingqing Zhu , Taicheng Guo , Shen Gao , Zhiyong Lu , Xin Gao , Xiangliang Zhang

Predictive analysis is a cornerstone of modern decision-making, with applications in various domains. Large Language Models (LLMs) have emerged as powerful tools in enabling nuanced, knowledge-intensive conversations, thus aiding in complex…

Computation and Language · Computer Science 2025-05-26 Qin Chen , Yuanyi Ren , Xiaojun Ma , Yuyang Shi

A Large Language Model (LLM) as judge evaluates the quality of victim Machine Learning (ML) models, specifically LLMs, by analyzing their outputs. An LLM as judge is the combination of one model and one specifically engineered judge prompt…

Cryptography and Security · Computer Science 2026-03-24 Tom Biskupski , Stephan Kleber

The rapid advancement of Large Language Models (LLMs) has inaugurated a transformative epoch in natural language processing, fostering unprecedented proficiency in text generation, comprehension, and contextual scrutiny. Nevertheless,…

Machine Learning · Computer Science 2024-04-22 Cangqing Wang , Yutian Yang , Ruisi Li , Dan Sun , Ruicong Cai , Yuzhu Zhang , Chengqian Fu , Lillian Floyd

The computational treatment of arguments on controversial issues has been subject to extensive NLP research, due to its envisioned impact on opinion formation, decision making, writing education, and the like. A critical task in any such…

Computation and Language · Computer Science 2024-03-26 Henning Wachsmuth , Gabriella Lapesa , Elena Cabrio , Anne Lauscher , Joonsuk Park , Eva Maria Vecchi , Serena Villata , Timon Ziegenbein

Training automatic summary fact verifiers often faces the challenge of a lack of human-labeled data. In this paper, we explore alternative way of leveraging Large Language Model (LLM) generated feedback to address the inherent limitation of…

Computation and Language · Computer Science 2024-12-17 Jihwan Oh , Jeonghwan Choi , Nicole Hee-Yeon Kim , Taewon Yun , Hwanjun Song

Text summarization tasks commonly employ Pre-trained Language Models (PLMs) to fit diverse standard datasets. While these PLMs excel in automatic evaluations, they frequently underperform in human evaluations, indicating a deviation between…

Computation and Language · Computer Science 2024-10-02 Yang Han , Yiming Wang , Rui Wang , Lu Chen , Kai Yu

The exponential growth of text-based data in domains such as healthcare, education, and social sciences has outpaced the capacity of traditional qualitative analysis methods, which are time-intensive and prone to subjectivity. Large…

Analyzing vast textual data and summarizing key information from electronic health records imposes a substantial burden on how clinicians allocate their time. Although large language models (LLMs) have shown promise in natural language…

Large language models (LLMs) have achieved substantial progress in processing long contexts but still struggle with long-context reasoning. Existing approaches typically involve fine-tuning LLMs with synthetic data, which depends on…

Computation and Language · Computer Science 2024-11-14 Siheng Li , Cheng Yang , Zesen Cheng , Lemao Liu , Mo Yu , Yujiu Yang , Wai Lam

Large language models (LLMs) have attracted considerable attention as they are capable of showcasing impressive capabilities generating comparable high-quality responses to human inputs. LLMs, can not only compose textual scripts such as…

Computational Engineering, Finance, and Science · Computer Science 2024-05-31 Denish Omondi Otieno , Faranak Abri , Sima Siami-Namini , Akbar Siami Namin

Existing approaches for low-resource text summarization primarily employ large language models (LLMs) like GPT-3 or GPT-4 at inference time to generate summaries directly; however, such approaches often suffer from inconsistent LLM outputs…

Computation and Language · Computer Science 2025-01-27 Gaurav Sahu , Olga Vechtomova , Issam H. Laradji

Storytelling is an integral part of human experience and plays a crucial role in social interactions. Thus, Automatic Story Evaluation (ASE) and Generation (ASG) could benefit society in multiple ways, but they are challenging tasks which…

Computation and Language · Computer Science 2024-05-24 Cyril Chhun , Fabian M. Suchanek , Chloé Clavel