English
Related papers

Related papers: Polarity Calibration for Opinion Summarization

200 papers

Calibration is a well-studied property of predictors which guarantees meaningful uncertainty estimates. Multicalibration is a related notion -- originating in algorithmic fairness -- which requires predictors to be simultaneously calibrated…

Machine Learning · Computer Science 2024-11-06 Dutch Hansen , Siddartha Devic , Preetum Nakkiran , Vatsal Sharan

Automatic dialogue summarization is a well-established task with the goal of distilling the most crucial information from human conversations into concise textual summaries. However, most existing research has predominantly focused on…

Computation and Language · Computer Science 2024-05-06 Yongxin Zhou , Fabien Ringeval , François Portet

Summarization is an important application of large language models (LLMs). Most previous evaluation of summarization models has focused on their content selection, faithfulness, grammaticality and coherence. However, it is well known that…

Computation and Language · Computer Science 2024-06-07 Julius Steen , Katja Markert

As performance gains through scaling data and/or model size experience diminishing returns, it is becoming increasingly popular to turn to ensembling, where the predictions of multiple models are combined to improve accuracy. In this paper,…

Machine Learning · Statistics 2024-11-04 Hyunsuk Kim , Liam Hodgkinson , Ryan Theisen , Michael W. Mahoney

Multi-document summarization is the process of automatically generating a concise summary of multiple documents related to the same topic. This summary can help users quickly understand the key information from a large collection of…

Computation and Language · Computer Science 2023-12-20 Charles Rajan , Nishit Asnani , Shreya Singh

This paper considers extractive summarisation in a comparative setting: given two or more document groups (e.g., separated by publication time), the goal is to select a small number of documents that are representative of each group, and…

Information Retrieval · Computer Science 2020-01-03 Umanga Bista , Alexander Mathews , Minjeong Shin , Aditya Krishna Menon , Lexing Xie

While we typically focus on data visualization as a tool for facilitating cognitive tasks (e.g., learning facts, making decisions), we know relatively little about their second-order impacts on our opinions, attitudes, and values. For…

Human-Computer Interaction · Computer Science 2023-09-06 Eli Holder , Cindy Xiong Bearfield

Modern deep models for summarization attains impressive benchmark performance, but they are prone to generating miscalibrated predictive uncertainty. This means that they assign high confidence to low-quality predictions, leading to…

Computation and Language · Computer Science 2023-04-19 Polina Zablotskaia , Du Phan , Joshua Maynez , Shashi Narayan , Jie Ren , Jeremiah Liu

Opinions in scientific research papers can be divergent, leading to controversies among reviewers. However, most existing datasets for opinion summarization are centered around product reviews and assume that the analyzed opinions are…

Computation and Language · Computer Science 2024-06-18 Qi Zeng , Mankeerat Sidhu , Ansel Blume , Hou Pong Chan , Lu Wang , Heng Ji

Existing multi-document summarization approaches produce a uniform summary for all users without considering individuals' interests, which is highly impractical. Making a user-specific summary is a challenging task as it requires: i)…

Information Retrieval · Computer Science 2024-08-15 Samira Ghodratnama , Mehrdad Zakershahrak

Characterizing relationships between people is fundamental for the understanding of narratives. In this work, we address the problem of inferring the polarity of relationships between people in narrative summaries. We formulate the problem…

Computation and Language · Computer Science 2015-12-02 Shashank Srivastava , Snigdha Chaturvedi , Tom Mitchell

Calibration is a classical notion from the forecasting literature which aims to address the question: how should predicted probabilities be interpreted? In a world where we only get to observe (discrete) outcomes, how should we evaluate a…

Machine Learning · Computer Science 2025-09-03 Parikshit Gopalan , Lunjia Hu

Due to the exponential growth of information and the need for efficient information consumption the task of summarization has gained paramount importance. Evaluating summarization accurately and objectively presents significant challenges,…

Computation and Language · Computer Science 2024-12-31 Dong Yuan , Eti Rastogi , Fen Zhao , Sagar Goyal , Gautam Naik , Sree Prasanna Rajagopal

Polarization, defined as the emergence of sharply divided groups with opposing and often extreme views, is an increasingly prominent feature of modern societies. While many studies analyze this phenomenon in the context of single issues,…

In sentiment analysis, the polarities of the opinions expressed on an object/feature are determined to assess the sentiment of a sentence or document whether it is positive/negative/neutral. Naturally, the object/feature is a noun…

Computation and Language · Computer Science 2016-07-15 K Paramesha , K C Ravishankar

Opinion mining and Sentiment analysis have emerged as a field of study since the widespread of World Wide Web and internet. Opinion refers to extraction of those lines or phrase in the raw and huge data which express an opinion. Sentiment…

Information Retrieval · Computer Science 2014-01-14 Deepali Virmani , Vikrant Malhotra , Ridhi Tyagi

Opinion summarization focuses on generating summaries that reflect popular subjective information expressed in multiple online reviews. While generated summaries offer general and concise information about a particular hotel or product, the…

Computation and Language · Computer Science 2022-04-19 Hayate Iso , Xiaolan Wang , Stefanos Angelidis , Yoshihiko Suhara

Despite the recent advances in abstractive text summarization, current summarization models still suffer from generating factually inconsistent summaries, reducing their utility for real-world application. We argue that the main reason for…

Computation and Language · Computer Science 2023-10-16 Polina Zablotskaia , Misha Khalman , Rishabh Joshi , Livio Baldini Soares , Shoshana Jakobovits , Joshua Maynez , Shashi Narayan

We propose to augment rating based recommender systems by providing the user with additional information which might help him in his choice or in the understanding of the recommendation. We consider here as a new task, the generation of…

Information Retrieval · Computer Science 2014-12-18 Mickaël Poussevin , Vincent Guigue , Patrick Gallinari

Presenting high-level arguments is a crucial task for fostering participation in online societal discussions. Current argument summarization approaches miss an important facet of this task -- capturing diversity -- which is important for…

Computation and Language · Computer Science 2024-02-15 Michiel van der Meer , Piek Vossen , Catholijn M. Jonker , Pradeep K. Murukannaiah