English
Related papers

Related papers: Improving Zero and Few-Shot Abstractive Summarizat…

200 papers

Fine-tuning large-scale text-to-video diffusion models to add new generative controls, such as those over physical camera parameters (e.g., shutter speed or aperture), typically requires vast, high-fidelity datasets that are difficult to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Shihan Cheng , Nilesh Kulkarni , David Hyde , Dmitriy Smirnov

Creating abstractive summaries from meeting transcripts has proven to be challenging due to the limited amount of labeled data available for training neural network models. Moreover, Transformer-based architectures have proven to beat…

Computation and Language · Computer Science 2021-08-16 Nima Sadri , Bohan Zhang , Bihan Liu

Recognizing fine-grained categories remains a challenging task, due to the subtle distinctions among different subordinate categories, which results in the need of abundant annotated samples. To alleviate the data-hungry problem, we…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Junjie Chen , Li Niu , Liu Liu , Liqing Zhang

Recent prompt-based approaches allow pretrained language models to achieve strong performances on few-shot finetuning by reformulating downstream tasks as a language modeling problem. In this work, we demonstrate that, despite its…

Computation and Language · Computer Science 2021-09-10 Prasetya Ajie Utama , Nafise Sadat Moosavi , Victor Sanh , Iryna Gurevych

Today's research progress in the field of multi-document summarization is obstructed by the small number of available datasets. Since the acquisition of reference summaries is costly, existing datasets contain only hundreds of samples at…

Computation and Language · Computer Science 2020-02-18 Diego Antognini , Boi Faltings

Lack of specialized data makes building a multi-domain neural machine translation tool challenging. Although emerging literature dealing with low resource languages starts to show promising results, most state-of-the-art models used…

Computation and Language · Computer Science 2020-04-17 Idriss Mghabbar , Pirashanth Ratnamogan

Pre-training general-purpose visual features with convolutional neural networks without relying on annotations is a challenging and important task. Most recent efforts in unsupervised feature learning have focused on either small or highly…

Computer Vision and Pattern Recognition · Computer Science 2019-08-14 Mathilde Caron , Piotr Bojanowski , Julien Mairal , Armand Joulin

Text summarization is a fundamental task in natural language processing that aims to condense large amounts of textual information into concise and coherent summaries. With the exponential growth of content and the need to extract key…

Computation and Language · Computer Science 2023-06-26 Öykü Berfin Mercan , Sena Nur Cavsak , Aysu Deliahmetoglu , Senem Tanberk

Pre-trained language models (PLM) based on transformer neural networks developed in the field of natural language processing (NLP) offer great opportunities to improve automatic content analysis in communication science, especially for the…

This work improves the quality of automated machine learning (AutoML) systems by using dataset and function descriptions while significantly decreasing computation time from minutes to milliseconds by using a zero-shot approach. Given a new…

Machine Learning · Computer Science 2021-06-28 Nikhil Singh , Brandon Kates , Jeff Mentch , Anant Kharkar , Madeleine Udell , Iddo Drori

This article focuses on large language models (LLMs) fine-tuning in the scarce data regime (also known as the "few-shot" learning setting). We propose a method to increase the generalization capabilities of LLMs based on neural network…

Machine Learning · Computer Science 2023-10-25 Louis Falissard , Vincent Guigue , Laure Soulier

We propose encoder-centric stepwise models for extractive summarization using structured transformers -- HiBERT and Extended Transformers. We enable stepwise summarization by injecting the previously generated summary into the structured…

Computation and Language · Computer Science 2020-10-07 Shashi Narayan , Joshua Maynez , Jakub Adamek , Daniele Pighin , Blaž Bratanič , Ryan McDonald

Tweets are specific text data when compared to general text. Although sentiment analysis over tweets has become very popular in the last decade for English, it is still difficult to find huge annotated corpora for non-English languages. The…

Computation and Language · Computer Science 2020-10-08 Valentin Barriere , Alexandra Balahur

Misinformation on YouTube is a significant concern, necessitating robust detection strategies. In this paper, we introduce a novel methodology for video classification, focusing on the veracity of the content. We convert the conventional…

Computation and Language · Computer Science 2023-07-25 Christos Christodoulou , Nikos Salamanos , Pantelitsa Leonidou , Michail Papadakis , Michael Sirivianos

Finetuning language models for a new domain inevitably leads to the deterioration of their general performance. This becomes more pronounced the more limited the finetuning data resource. We introduce minifinetuning (MFT), a method for…

Machine Learning · Computer Science 2025-06-23 Peter Belcak , Greg Heinrich , Jan Kautz , Pavlo Molchanov

Neural models trained with large amount of parallel data have achieved impressive performance in abstractive summarization tasks. However, large-scale parallel corpora are expensive and challenging to construct. In this work, we introduce a…

Computation and Language · Computer Science 2022-01-17 Mengsay Loem , Sho Takase , Masahiro Kaneko , Naoaki Okazaki

Based on the remarkable achievements of pre-trained language models in abstractive summarization, the copying mechanism has proved helpful by improving the factuality, stability, and overall performance. This work proposes PROM, a new…

Computation and Language · Computer Science 2024-02-29 Xinbei Ma , Yeyun Gong , Pengcheng He , Hai Zhao , Nan Duan

Modern video summarization methods are based on deep neural networks that require a large amount of annotated data for training. However, existing datasets for video summarization are small-scale, easily leading to over-fitting of the deep…

Computer Vision and Pattern Recognition · Computer Science 2022-10-20 Li Haopeng , Ke Qiuhong , Gong Mingming , Tom Drummond

This work presents a new approach to unsupervised abstractive summarization based on maximizing a combination of coverage and fluency for a given length constraint. It introduces a novel method that encourages the inclusion of key terms…

Computation and Language · Computer Science 2021-05-13 Philippe Laban , Andrew Hsi , John Canny , Marti A. Hearst

The realm of scientific text summarization has experienced remarkable progress due to the availability of annotated brief summaries and ample data. However, the utilization of multiple input modalities, such as videos and audio, has yet to…

Computation and Language · Computer Science 2023-06-27 Yash Kumar Atri , Vikram Goyal , Tanmoy Chakraborty
‹ Prev 1 8 9 10 Next ›