English
Related papers

Related papers: Keyphrase Prediction With Pre-trained Language Mod…

200 papers

Keyphrase generation (KG) aims to generate a set of keyphrases given a document, which is a fundamental task in natural language processing (NLP). Most previous methods solve this problem in an extractive manner, while recently, several…

Computation and Language · Computer Science 2019-01-17 Wang Chen , Yifan Gao , Jiani Zhang , Irwin King , Michael R. Lyu

Generating keyphrases that summarize the main points of a document is a fundamental task in natural language processing. Although existing generative models are capable of predicting multiple keyphrases for an input document as well as…

Computation and Language · Computer Science 2019-06-11 Hou Pong Chan , Wang Chen , Lu Wang , Irwin King

Natural language processing techniques have demonstrated promising results in keyphrase generation. However, one of the major challenges in \emph{neural} keyphrase generation is processing long documents using deep neural networks.…

Computation and Language · Computer Science 2021-06-08 Wasi Uddin Ahmad , Xiao Bai , Soomin Lee , Kai-Wei Chang

We propose a two-stage neural model to tackle question generation from documents. First, our model estimates the probability that word sequences in a document are ones that a human would pick when selecting candidate answers by training a…

Computation and Language · Computer Science 2018-05-31 Sandeep Subramanian , Tong Wang , Xingdi Yuan , Saizheng Zhang , Yoshua Bengio , Adam Trischler

In recent years, a number of keyphrase generation (KPG) approaches were proposed consisting of complex model architectures, dedicated training paradigms and decoding strategies. In this work, we opt for simplicity and show how a commonly…

Computation and Language · Computer Science 2022-01-17 Md Faisal Mahbub Chowdhury , Gaetano Rossiello , Michael Glass , Nandana Mihindukulasooriya , Alfio Gliozzo

Non-autoregressive generation (NAG) has recently attracted great attention due to its fast inference speed. However, the generation quality of existing NAG models still lags behind their autoregressive counterparts. In this work, we show…

Computation and Language · Computer Science 2021-02-17 Yixuan Su , Deng Cai , Yan Wang , David Vandyke , Simon Baker , Piji Li , Nigel Collier

State-of-the-art keyphrase generation methods generally depend on large annotated datasets, limiting their performance in domains with limited annotated data. To overcome this challenge, we design a data-oriented approach that first…

Computation and Language · Computer Science 2022-10-25 Di Wu , Wasi Uddin Ahmad , Sunipa Dev , Kai-Wei Chang

Keyphrase generation is the task of summarizing the contents of any given article into a few salient phrases (or keyphrases). Existing works for the task mostly rely on large-scale annotated datasets, which are not easy to acquire. Very few…

Computation and Language · Computer Science 2023-05-30 Krishna Garg , Jishnu Ray Chowdhury , Cornelia Caragea

Keyphrase generation refers to the task of producing a set of words or phrases that summarises the content of a document. Continuous efforts have been dedicated to this task over the past few years, spreading across multiple lines of…

Information Retrieval · Computer Science 2025-06-13 Florian Boudin , Akiko Aizawa

Keyphrases are crucial for searching and systematizing scholarly documents. Most current methods for keyphrase extraction are aimed at the extraction of the most significant words in the text. But in practice, the list of keyphrases often…

Computation and Language · Computer Science 2024-10-23 Anna Glazkova , Dmitry Morozov

Keyphrase generation aims to produce a set of phrases summarizing the essentials of a given document. Conventional methods normally apply an encoder-decoder architecture to generate the output keyphrases for an input document, where they…

Computation and Language · Computer Science 2022-12-23 Shizhe Diao , Yan Song , Tong Zhang

Open-domain KeyPhrase Extraction (KPE) aims to extract keyphrases from documents without domain or quality restrictions, e.g., web pages with variant domains and qualities. Recently, neural methods have shown promising results in many KPE…

Computation and Language · Computer Science 2021-09-20 Si Sun , Zhenghao Liu , Chenyan Xiong , Zhiyuan Liu , Jie Bao

Keyphrases are capable of providing semantic metadata characterizing documents and producing an overview of the content of a document. Since keyphrase extraction is able to facilitate the management, categorization, and retrieval of…

Computation and Language · Computer Science 2020-02-14 Funan Mu , Zhenting Yu , LiFeng Wang , Yequan Wang , Qingyu Yin , Yibo Sun , Liqun Liu , Teng Ma , Jing Tang , Xing Zhou

Neural keyphrase generation models have recently attracted much interest due to their ability to output absent keyphrases, that is, keyphrases that do not appear in the source text. In this paper, we discuss the usefulness of absent…

Information Retrieval · Computer Science 2021-04-05 Florian Boudin , Ygor Gallina

Keyphrase generation is the task of generating phrases (keyphrases) that summarize the main topics of a given document. Keyphrases can be either present or absent from the given document. While the extraction of present keyphrases has…

Computation and Language · Computer Science 2022-10-25 Jishnu Ray Chowdhury , Seoyeon Park , Tuhin Kundu , Cornelia Caragea

Keyphrase extraction (KE) aims to summarize a set of phrases that accurately express a concept or a topic covered in a given document. Recently, Sequence-to-Sequence (Seq2Seq) based generative framework is widely used in KE task, and it has…

Computation and Language · Computer Science 2020-10-27 Haoyu Zhang , Dingkun Long , Guangwei Xu , Pengjun Xie , Fei Huang , Ji Wang

Transformer-based architectures in natural language processing force input size limits that can be problematic when long documents need to be processed. This paper overcomes this issue for keyphrase extraction by chunking the long documents…

Computation and Language · Computer Science 2022-05-12 Martin Docekal , Pavel Smrz

Sequence-to-sequence models have lead to significant progress in keyphrase generation, but it remains unknown whether they are reliable enough to be beneficial for document retrieval. This study provides empirical evidence that such models…

Information Retrieval · Computer Science 2021-06-29 Florian Boudin , Ygor Gallina , Akiko Aizawa

In this paper, we study automatic keyphrase generation. Although conventional approaches to this task show promising results, they neglect correlation among keyphrases, resulting in duplication and coverage issues. To solve these problems,…

Computation and Language · Computer Science 2018-08-23 Jun Chen , Xiaoming Zhang , Yu Wu , Zhao Yan , Zhoujun Li

Unsupervised keyphrase prediction has gained growing interest in recent years. However, existing methods typically rely on heuristically defined importance scores, which may lead to inaccurate informativeness estimation. In addition, they…

Computation and Language · Computer Science 2025-06-02 Lam Thanh Do , Aaditya Bodke , Pritom Saha Akash , Kevin Chen-Chuan Chang