English
Related papers

Related papers: One2Set: Generating Diverse Keyphrases as a Set

200 papers

Auto-regressive sequence-to-sequence models with attention mechanism have achieved state-of-the-art performance in many tasks such as machine translation and speech synthesis. These models can be difficult to train. The standard approach,…

Machine Learning · Computer Science 2019-10-04 Qingyun Dou , Yiting Lu , Joshua Efiong , Mark J. F. Gales

A multi-turn dialogue always follows a specific topic thread, and topic shift at the discourse level occurs naturally as the conversation progresses, necessitating the model's ability to capture different topics and generate topic-aware…

Computation and Language · Computer Science 2021-09-14 Hongru Wang , Mingyu Cui , Zimo Zhou , Gabriel Pui Cheong Fung , Kam-Fai Wong

Recently, generative methods have been widely used in keyphrase prediction, thanks to their capability to produce both present keyphrases that appear in the source text and absent keyphrases that do not match any source text. However, the…

Computation and Language · Computer Science 2020-04-23 Rui Liu , Zheng Lin , Weiping Wang

Keyphrase generation is a task of identifying a set of phrases that best repre-sent the main topics or themes of a given text. Keyphrases are dividend int pre-sent and absent keyphrases. Recent approaches utilizing sequence-to-sequence…

Computation and Language · Computer Science 2023-09-28 Bin Chen , Mizuho Iwaihara

Simultaneous sequence generation is a pivotal task for real-time scenarios, such as streaming speech recognition, simultaneous machine translation and simultaneous speech translation, where the target sequence is generated while receiving…

Computation and Language · Computer Science 2023-12-01 Shaolei Zhang , Yang Feng

Traditional keyphrase prediction methods predict a single set of keyphrases per document, failing to cater to the diverse needs of users and downstream applications. To bridge the gap, we introduce on-demand keyphrase generation, a novel…

Computation and Language · Computer Science 2024-10-07 Di Wu , Xiaoxian Shen , Kai-Wei Chang

Generating keyphrases that summarize the main points of a document is a fundamental task in natural language processing. Although existing generative models are capable of predicting multiple keyphrases for an input document as well as…

Computation and Language · Computer Science 2019-06-11 Hou Pong Chan , Wang Chen , Lu Wang , Irwin King

Large pre-trained language models have recently been expanded and applied to programming language tasks with great success, often through further pre-training of a strictly-natural language model--where training sequences typically contain…

Computation and Language · Computer Science 2024-02-13 Fenia Christopoulou , Guchun Zhang , Gerasimos Lampouras

Keyphrase provides highly-condensed information that can be effectively used for understanding, organizing and retrieving text content. Though previous studies have provided many workable solutions for automated keyphrase extraction, they…

Computation and Language · Computer Science 2021-06-02 Rui Meng , Sanqiang Zhao , Shuguang Han , Daqing He , Peter Brusilovsky , Yu Chi

The recently proposed Sequence-to-Sequence (seq2seq) framework advocates replacing complex data processing pipelines, such as an entire automatic speech recognition system, with a single neural network trained in an end-to-end fashion. In…

Neural and Evolutionary Computing · Computer Science 2016-12-09 Jan Chorowski , Navdeep Jaitly

Keyphrase generation aims to summarize long documents with a collection of salient phrases. Deep neural models have demonstrated a remarkable success in this task, capable of predicting keyphrases that are even absent from a document.…

Computation and Language · Computer Science 2021-04-20 Xianjie Shen , Yinghan Wang , Rui Meng , Jingbo Shang

Neural models that do not rely on pre-training have excelled in the keyphrase generation task with large annotated datasets. Meanwhile, new approaches have incorporated pre-trained language models (PLMs) for their data efficiency. However,…

Computation and Language · Computer Science 2024-02-26 Di Wu , Wasi Uddin Ahmad , Kai-Wei Chang

We address the text-to-text generation problem of sentence-level paraphrasing -- a phenomenon distinct from and more difficult than word- or phrase-level paraphrasing. Our approach applies multiple-sequence alignment to sentences gathered…

Computation and Language · Computer Science 2007-05-23 Regina Barzilay , Lillian Lee

Multi-modal keyphrase generation aims to produce a set of keyphrases that represent the core points of the input text-image pair. In this regard, dominant methods mainly focus on multi-modal fusion for keyphrase generation. Nevertheless,…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Yifan Dong , Suhang Wu , Fandong Meng , Jie Zhou , Xiaoli Wang , Jianxin Lin , Jinsong Su

Sequence-to-sequence models have lead to significant progress in keyphrase generation, but it remains unknown whether they are reliable enough to be beneficial for document retrieval. This study provides empirical evidence that such models…

Information Retrieval · Computer Science 2021-06-29 Florian Boudin , Ygor Gallina , Akiko Aizawa

Program synthesis is the task of automatically generating a program consistent with a specification. Recent years have seen proposal of a number of neural approaches for program synthesis, many of which adopt a sequence generation paradigm…

Machine Learning · Computer Science 2018-05-23 Rudy Bunel , Matthew Hausknecht , Jacob Devlin , Rishabh Singh , Pushmeet Kohli

The encoder-decoder framework achieves state-of-the-art results in keyphrase generation (KG) tasks by predicting both present keyphrases that appear in the source document and absent keyphrases that do not. However, relying solely on the…

Computation and Language · Computer Science 2021-09-13 Jiacheng Ye , Ruijian Cai , Tao Gui , Qi Zhang

Sequences have become first class citizens in supervised learning thanks to the resurgence of recurrent neural networks. Many complex tasks that require mapping from or to a sequence of observations can now be formulated with the…

Machine Learning · Statistics 2016-02-25 Oriol Vinyals , Samy Bengio , Manjunath Kudlur

Automatic keyphrase labelling stands for the ability of models to retrieve words or short phrases that adequately describe documents' content. Previous work has put much effort into exploring extractive techniques to address this task;…

Information Retrieval · Computer Science 2024-09-26 Jorge Gabín , M. Eduardo Ares , Javier Parapar

Training keyphrase generation (KPG) models require a large amount of annotated data, which can be prohibitively expensive and often limited to specific domains. In this study, we first demonstrate that large distribution shifts among…

Computation and Language · Computer Science 2023-05-09 Rui Meng , Tong Wang , Xingdi Yuan , Yingbo Zhou , Daqing He