English
Related papers

Related papers: Efficient Few-Shot Fine-Tuning for Opinion Summari…

200 papers

Transformer-based models have achieved state-of-the-art results in a wide range of natural language processing (NLP) tasks including document summarization. Typically these systems are trained by fine-tuning a large pre-trained model to the…

Computation and Language · Computer Science 2021-06-01 Potsawee Manakul , Mark J. F. Gales

The most advanced abstractive dialogue summarizers lack generalization ability on new domains and the existing researches for domain adaptation in summarization generally rely on large-scale pre-trainings. To explore the lightweight…

Computation and Language · Computer Science 2022-04-12 Lulu Zhao , Fujia Zheng , Weihao Zeng , Keqing He , Weiran Xu , Huixing Jiang , Wei Wu , Yanan Wu

Abstractive summarization has been studied using neural sequence transduction methods with datasets of large, paired document-summary examples. However, such datasets are rare and the models trained from them do not generalize to other…

Computation and Language · Computer Science 2019-05-24 Eric Chu , Peter J. Liu

Pre-trained language models have shown excellent results in few-shot learning scenarios using in-context learning. Although it is impressive, the size of language models can be prohibitive to make them usable in on-device applications, such…

Computation and Language · Computer Science 2022-04-27 Navid Rezaei , Marek Z. Reformat

Few-shot fine-tuning and in-context learning are two alternative strategies for task adaptation of pre-trained language models. Recently, in-context learning has gained popularity over fine-tuning due to its simplicity and improved…

Computation and Language · Computer Science 2023-05-31 Marius Mosbach , Tiago Pimentel , Shauli Ravfogel , Dietrich Klakow , Yanai Elazar

Opinion summarization aims to profile a target by extracting opinions from multiple documents. Most existing work approaches the task in a semi-supervised manner due to the difficulty of obtaining high-quality annotation from thousands of…

Computation and Language · Computer Science 2021-10-19 Suyu Ge , Jiaxin Huang , Yu Meng , Sharon Wang , Jiawei Han

When adapting large language models (LLMs) to a specific downstream task, two primary approaches are commonly employed: (1) prompt engineering, often with in-context few-shot learning, leveraging the model's inherent generalization…

Machine Learning · Computer Science 2025-12-24 Jorg Bornschein , Clare Lyle , Yazhe Li , Amal Rannen-Triki , Xu Owen He , Razvan Pascanu

This study aims to explore efficient tuning methods for the screenshot captioning task. Recently, image captioning has seen significant advancements, but research in captioning tasks for mobile screens remains relatively scarce. Current…

Machine Learning · Computer Science 2023-09-27 Ching-Yu Chiang , I-Hua Chang , Shih-Wei Liao

In real-world scenarios, labeled samples for dialogue summarization are usually limited (i.e., few-shot) due to high annotation costs for high-quality dialogue summaries. To efficiently learn from few-shot samples, previous works have…

Computation and Language · Computer Science 2024-02-28 Kaige Xie , Tong Yu , Haoliang Wang , Junda Wu , Handong Zhao , Ruiyi Zhang , Kanak Mahadik , Ani Nenkova , Mark Riedl

Recent pre-trained abstractive summarization systems have started to achieve credible performance, but a major barrier to their use in practice is their propensity to output summaries that are not faithful to the input and that contain…

Computation and Language · Computer Science 2021-04-12 Tanya Goyal , Greg Durrett

Neural network-based methods for abstractive summarization produce outputs that are more fluent than other techniques, but which can be poor at content selection. This work proposes a simple technique for addressing this issue: use a…

Computation and Language · Computer Science 2018-10-10 Sebastian Gehrmann , Yuntian Deng , Alexander M. Rush

A massive amount of reviews are generated daily from various platforms. It is impossible for people to read through tons of reviews and to obtain useful information. Automatic summarizing customer reviews thus is important for identifying…

Computation and Language · Computer Science 2020-06-02 Pengyuan Li , Lei Huang , Guang-jie Ren

Transformer-based large language models exhibit in-context learning, enabling adaptation to downstream tasks via few-shot prompting with demonstrations. In practice, such models are often fine-tuned to improve zero-shot performance on…

Computation and Language · Computer Science 2026-02-27 Chungpa Lee , Jy-yong Sohn , Kangwook Lee

Pre-trained Language Models (PLMs) can be accurately fine-tuned for downstream text processing tasks. Recently, researchers have introduced several parameter-efficient fine-tuning methods that optimize input prompts or adjust a small number…

Computation and Language · Computer Science 2024-06-07 Saeed Najafi , Alona Fyshe

The recent success of deep learning techniques for abstractive summarization is predicated on the availability of large-scale datasets. When summarizing reviews (e.g., for products or movies), such training data is neither available nor can…

Computation and Language · Computer Science 2020-12-15 Reinald Kim Amplayo , Stefanos Angelidis , Mirella Lapata

Opinion summarization has been traditionally approached with unsupervised, weakly-supervised and few-shot learning techniques. In this work, we collect a large dataset of summaries paired with user reviews for over 31,000 products, enabling…

Computation and Language · Computer Science 2021-09-10 Arthur Bražinskas , Mirella Lapata , Ivan Titov

When faced with a large number of product reviews, it is not clear that a human can remember all of them and weight opinions representatively to write a good reference summary. We propose an automatic metric to test the prevalence of the…

Computation and Language · Computer Science 2023-07-27 Christopher Malon

Large language models have shown impressive performance across a wide variety of tasks, including text summarization. In this paper, we show that this strong performance extends to opinion summarization. We explore several pipeline methods…

Computation and Language · Computer Science 2023-05-24 Adithya Bhaskar , Alexander R. Fabbri , Greg Durrett

Few-shot, fine-grained classification in computer vision poses significant challenges due to the need to differentiate subtle class distinctions with limited data. This paper presents a novel method that enhances the Contrastive…

Computer Vision and Pattern Recognition · Computer Science 2025-04-24 Eric Brouwer , Jan Erik van Woerden , Gertjan Burghouts , Matias Valdenegro-Toro , Marco Zullich

Reviews are valuable resources for customers making purchase decisions in online shopping. However, it is impractical for customers to go over the vast number of reviews and manually conclude the prominent opinions, which prompts the need…

Computation and Language · Computer Science 2025-06-13 Wendi Zhou , Ameer Saadat-Yazdi , Nadin Kokciyan