English
Related papers

Related papers: Prompted Opinion Summarization with GPT-3.5

200 papers

Opinion summarization is the automatic creation of text reflecting subjective information expressed in multiple documents, such as user reviews of a product. The task is practically important and has attracted a lot of attention. However,…

Machine Learning · Computer Science 2020-10-13 Arthur Bražinskas , Mirella Lapata , Ivan Titov

A major challenge for scaling machine learning is training models to perform tasks that are very difficult or time-consuming for humans to evaluate. We present progress on this problem on the task of abstractive summarization of entire…

Computation and Language · Computer Science 2021-09-29 Jeff Wu , Long Ouyang , Daniel M. Ziegler , Nisan Stiennon , Ryan Lowe , Jan Leike , Paul Christiano

Large Language Models (LLMs) have revolutionized various Natural Language Generation (NLG) tasks, including Argument Summarization (ArgSum), a key subfield of Argument Mining. This paper investigates the integration of state-of-the-art LLMs…

Computation and Language · Computer Science 2025-10-10 Moritz Altemeyer , Steffen Eger , Johannes Daxenberger , Yanran Chen , Tim Altendorf , Philipp Cimiano , Benjamin Schiller

Text summarizing is a critical Natural Language Processing (NLP) task with applications ranging from information retrieval to content generation. Large Language Models (LLMs) have shown remarkable promise in generating fluent abstractive…

Computation and Language · Computer Science 2025-03-03 Colleen Gilhuly , Haleh Shahzad

Online reviews play a pivotal role in influencing consumer decisions across various domains, from purchasing products to selecting hotels or restaurants. However, the sheer volume of reviews -- often containing repetitive or irrelevant…

Computation and Language · Computer Science 2024-10-18 Mir Tafseer Nayeem , Davood Rafiei

We explore the need for more comprehensive and precise evaluation techniques for generative artificial intelligence (GenAI) in text summarization tasks, specifically in the area of opinion summarization. Traditional methods, which leverage…

Computation and Language · Computer Science 2026-02-10 Leandro Anghinoni , Jorge Sanchez

Text analysis of social media for sentiment, topic analysis, and other analysis depends initially on the selection of keywords and phrases that will be used to create the research corpora. However, keywords that researchers choose may occur…

Computation and Language · Computer Science 2022-04-21 Philip Feldman , Aaron Dant , James R. Foulds , Shemei Pan

This study investigates the ability of GPT models (ChatGPT, GPT-4 and GPT-4o) to generate dialogue summaries that adhere to human guidelines. Our evaluation involved experimenting with various prompts to guide the models in complying with…

Computation and Language · Computer Science 2025-10-07 Yongxin Zhou , Fabien Ringeval , François Portet

Evaluating text summarization has been a challenging task in natural language processing (NLP). Automatic metrics which heavily rely on reference summaries are not suitable in many situations, while human evaluation is time-consuming and…

Computation and Language · Computer Science 2024-07-02 Huyen Nguyen , Haihua Chen , Lavanya Pobbathi , Junhua Ding

In this paper, we introduce ChatCite, a novel method leveraging large language models (LLMs) for generating comparative literature summaries. The ability to summarize research papers with a focus on key comparisons between studies is an…

Computation and Language · Computer Science 2024-12-04 Fernando Gabriela Garcia , Spencer Burns , Harrison Fuller

Text summarization has been a crucial problem in natural language processing (NLP) for several decades. It aims to condense lengthy documents into shorter versions while retaining the most critical information. Various methods have been…

Computation and Language · Computer Science 2023-02-17 Xianjun Yang , Yan Li , Xinlu Zhang , Haifeng Chen , Wei Cheng

Humans perceive discrete events such as "restaurant visits" and "train rides" in their continuous experience. One important prerequisite for studying human event perception is the ability of researchers to quantify when one event ends and…

Computation and Language · Computer Science 2023-01-26 Sebastian Michelmann , Manoj Kumar , Kenneth A. Norman , Mariya Toneva

Due to the exponential growth of information and the need for efficient information consumption the task of summarization has gained paramount importance. Evaluating summarization accurately and objectively presents significant challenges,…

Computation and Language · Computer Science 2024-12-31 Dong Yuan , Eti Rastogi , Fen Zhao , Sagar Goyal , Gautam Naik , Sree Prasanna Rajagopal

Peer prediction mechanisms motivate high-quality feedback with provable guarantees. However, current methods only apply to rather simple reports, like multiple-choice or scalar numbers. We aim to broaden these techniques to the larger…

Computation and Language · Computer Science 2024-09-04 Yuxuan Lu , Shengwei Xu , Yichi Zhang , Yuqing Kong , Grant Schoenebeck

Modern natural language generation systems with Large Language Models (LLMs) exhibit the capability to generate a plausible summary of multiple documents; however, it is uncertain if they truly possess the capability of information…

Computation and Language · Computer Science 2024-06-05 Miao Li , Jey Han Lau , Eduard Hovy

Automatic summarization with pre-trained language models has led to impressively fluent results, but is prone to 'hallucinations', low performance on non-news genres, and outputs which are not exactly summaries. Targeting ACL 2023's…

Computation and Language · Computer Science 2023-06-21 Yang Janet Liu , Amir Zeldes

Abstractive speech summarization (SSUM) aims to generate human-like summaries from speech. Given variations in information captured and phrasing, recordings can be summarized in multiple ways. Therefore, it is more reasonable to consider a…

Computation and Language · Computer Science 2024-10-28 Jee-weon Jung , Roshan Sharma , William Chen , Bhiksha Raj , Shinji Watanabe

Assessing the performance of interpreting services is a complex task, given the nuanced nature of spoken language translation, the strategies that interpreters apply, and the diverse expectations of users. The complexity of this task become…

Computation and Language · Computer Science 2024-06-17 Xiaoman Wang , Claudio Fantinuoli

Recent work on opinion summarization produces general summaries based on a set of input reviews and the popularity of opinions expressed in them. In this paper, we propose an approach that allows the generation of customized summaries based…

Computation and Language · Computer Science 2021-09-08 Reinald Kim Amplayo , Stefanos Angelidis , Mirella Lapata

Recent advancements in Large Language Models (LLMs) and Prompt Engineering have made chatbot customization more accessible, significantly reducing barriers to tasks that previously required programming skills. However, prompt evaluation,…

Human-Computer Interaction · Computer Science 2025-08-13 Sam Yu-Te Lee , Aryaman Bahukhandi , Dongyu Liu , Kwan-Liu Ma