English
Related papers

Related papers: Enhancing Keyphrase Generation by BART Finetuning …

200 papers

Scarcity of parallel data causes formality style transfer models to have scarce success in preserving content. We show that fine-tuning pre-trained language (GPT-2) and sequence-to-sequence (BART) models boosts content preservation, and…

Computation and Language · Computer Science 2021-07-06 Huiyuan Lai , Antonio Toral , Malvina Nissim

Sentiment analysis is a natural language processing task that aims to identify and extract the emotional aspects of a text. However, many existing sentiment analysis methods primarily classify the overall polarity of a text, overlooking the…

Computation and Language · Computer Science 2024-07-30 Mahdi Rezapour

Multi-modal keyphrase generation aims to produce a set of keyphrases that represent the core points of the input text-image pair. In this regard, dominant methods mainly focus on multi-modal fusion for keyphrase generation. Nevertheless,…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Yifan Dong , Suhang Wu , Fandong Meng , Jie Zhou , Xiaoli Wang , Jianxin Lin , Jinsong Su

Generating keyphrases that summarize the main points of a document is a fundamental task in natural language processing. Although existing generative models are capable of predicting multiple keyphrases for an input document as well as…

Computation and Language · Computer Science 2019-06-11 Hou Pong Chan , Wang Chen , Lu Wang , Irwin King

In this paper, we present a novel integrated approach for keyphrase generation (KG). Unlike previous works which are purely extractive or generative, we first propose a new multi-task learning framework that jointly learns an extractive…

Computation and Language · Computer Science 2019-04-09 Wang Chen , Hou Pong Chan , Piji Li , Lidong Bing , Irwin King

In dialogue systems, utterances with similar semantics may have distinctive emotions under different contexts. Therefore, modeling long-range contextual emotional relationships with speaker dependency plays a crucial part in dialogue…

Computation and Language · Computer Science 2022-01-25 Shimin Li , Hang Yan , Xipeng Qiu

Keyphrase generation (KPG) aims to automatically generate a collection of phrases representing the core concepts of a given document. The dominant paradigms in KPG include one2seq and one2set. Recently, there has been increasing interest in…

Computation and Language · Computer Science 2024-10-22 Liangying Shao , Liang Zhang , Minlong Peng , Guoqi Ma , Hao Yue , Mingming Sun , Jinsong Su

Keyphrase extraction aims at automatically extracting a list of "important" phrases representing the key concepts in a document. Prior approaches for unsupervised keyphrase extraction resorted to heuristic notions of phrase importance via…

Computation and Language · Computer Science 2023-02-20 Rishabh Joshi , Vidhisha Balachandran , Emily Saldanha , Maria Glenski , Svitlana Volkova , Yulia Tsvetkov

We propose a two-stage neural model to tackle question generation from documents. First, our model estimates the probability that word sequences in a document are ones that a human would pick when selecting candidate answers by training a…

Computation and Language · Computer Science 2018-05-31 Sandeep Subramanian , Tong Wang , Xingdi Yuan , Saizheng Zhang , Yoshua Bengio , Adam Trischler

This paper demonstrates a task to finetune a BART model so it can construct a sentence from an arbitrary set of words, which used to be a difficult NLP task. The training task is making sentences with four words, but the trained model can…

Computation and Language · Computer Science 2022-06-28 Yuanliang Meng

Keyphrase annotation is the task of identifying textual units that represent the main content of a document. Keyphrase annotation is either carried out by extracting the most important phrases from a document, keyphrase extraction, or by…

Computation and Language · Computer Science 2016-11-08 Adrien Bougouin , Florian Boudin , Béatrice Daille

Aiming to generate a set of keyphrases, Keyphrase Generation (KG) is a classical task for capturing the central idea from a given document. Based on Seq2Seq models, the previous reinforcement learning framework on KG tasks utilizes the…

Computation and Language · Computer Science 2021-09-13 Yichao Luo , Yige Xu , Jiacheng Ye , Xipeng Qiu , Qi Zhang

Keyphrases efficiently summarize a document's content and are used in various document processing and retrieval tasks. Several unsupervised techniques and classifiers exist for extracting keyphrases from text documents. Most of these…

Computation and Language · Computer Science 2016-08-04 Sujatha Das Gollapalli , Xiao-li Li

Phrase mining is a fundamental text mining task that aims to identify quality phrases from context. Nevertheless, the scarcity of extensive gold labels datasets, demanding substantial annotation efforts from experts, renders this task…

Computation and Language · Computer Science 2024-01-01 Zhihao Zhang , Yuan Zuo , Chenghua Lin , Junjie Wu

Conversational AI assistants are becoming popular and question-answering is an important part of any conversational assistant. Using relevant utterances as features in question-answering has shown to improve both the precision and recall…

Computation and Language · Computer Science 2020-04-09 Soham Parikh , Quaizar Vohra , Mitul Tiwari

The emergence of ChatGPT has recently garnered significant attention from the computational linguistics community. To demonstrate its capabilities as a keyphrase generator, we conduct a preliminary evaluation of ChatGPT for the keyphrase…

Computation and Language · Computer Science 2023-12-25 Mingyang Song , Haiyun Jiang , Shuming Shi , Songfang Yao , Shilong Lu , Yi Feng , Huafeng Liu , Liping Jing

This paper proposes Attention-Seeker, an unsupervised keyphrase extraction method that leverages self-attention maps from a Large Language Model to estimate the importance of candidate phrases. Our approach identifies specific components -…

Computation and Language · Computer Science 2024-12-17 Erwin D. López Z. , Cheng Tang , Atsushi Shimada

We introduce KERT (Keyphrase Extraction and Ranking by Topic), a framework for topical keyphrase generation and ranking. By shifting from the unigram-centric traditional methods of unsupervised keyphrase extraction to a phrase-centric…

Machine Learning · Computer Science 2013-06-04 Marina Danilevsky , Chi Wang , Nihit Desai , Jingyi Guo , Jiawei Han

Missing sentence generation (or sentence infilling) fosters a wide range of applications in natural language generation, such as document auto-completion and meeting note expansion. This task asks the model to generate intermediate missing…

Computation and Language · Computer Science 2020-08-04 Yichen Huang , Yizhe Zhang , Oussama Elachqar , Yu Cheng

Generative commonsense reasoning which aims to empower machines to generate sentences with the capacity of reasoning over a set of concepts is a critical bottleneck for text generation. Even the state-of-the-art pre-trained language…

Computation and Language · Computer Science 2021-01-22 Ye Liu , Yao Wan , Lifang He , Hao Peng , Philip S. Yu