English
Related papers

Related papers: One2set + Large Language Model: Best Partners for …

200 papers

Keyphrase generation aims to produce a set of phrases summarizing the essentials of a given document. Conventional methods normally apply an encoder-decoder architecture to generate the output keyphrases for an input document, where they…

Computation and Language · Computer Science 2022-12-23 Shizhe Diao , Yan Song , Tong Zhang

Keyphrase generation aims at generating topical phrases from a given text either by copying from the original text (present keyphrases) or by producing new keyphrases (absent keyphrases) that capture the semantic meaning of the text.…

Computation and Language · Computer Science 2023-04-28 Tuhin Kundu , Jishnu Ray Chowdhury , Cornelia Caragea

Natural language processing techniques have demonstrated promising results in keyphrase generation. However, one of the major challenges in \emph{neural} keyphrase generation is processing long documents using deep neural networks.…

Computation and Language · Computer Science 2021-06-08 Wasi Uddin Ahmad , Xiao Bai , Soomin Lee , Kai-Wei Chang

Sequence-to-sequence models have lead to significant progress in keyphrase generation, but it remains unknown whether they are reliable enough to be beneficial for document retrieval. This study provides empirical evidence that such models…

Information Retrieval · Computer Science 2021-06-29 Florian Boudin , Ygor Gallina , Akiko Aizawa

Despite the recent advancements in Large Language Models (LLMs), which have significantly enhanced the generative capabilities for various NLP tasks, LLMs still face limitations in directly handling retrieval tasks. However, many practical…

Computation and Language · Computer Science 2024-10-03 Jintian Zhang , Cheng Peng , Mengshu Sun , Xiang Chen , Lei Liang , Zhiqiang Zhang , Jun Zhou , Huajun Chen , Ningyu Zhang

Different texts shall by nature correspond to different number of keyphrases. This desideratum is largely missing from existing neural keyphrase generation models. In this study, we address this problem from both modeling and evaluation…

Computation and Language · Computer Science 2020-05-13 Xingdi Yuan , Tong Wang , Rui Meng , Khushboo Thaker , Peter Brusilovsky , Daqing He , Adam Trischler

Large language models (LLMs) successfully model natural language from vast amounts of text without the need for explicit supervision. In this paper, we investigate the efficacy of LLMs in modeling passwords. We present PassGPT, a LLM…

Computation and Language · Computer Science 2023-06-16 Javier Rando , Fernando Perez-Cruz , Briland Hitaj

Keyphrase generation (KG) aims to generate a set of keyphrases given a document, which is a fundamental task in natural language processing (NLP). Most previous methods solve this problem in an extractive manner, while recently, several…

Computation and Language · Computer Science 2019-01-17 Wang Chen , Yifan Gao , Jiani Zhang , Irwin King , Michael R. Lyu

We propose a two-stage neural model to tackle question generation from documents. First, our model estimates the probability that word sequences in a document are ones that a human would pick when selecting candidate answers by training a…

Computation and Language · Computer Science 2018-05-31 Sandeep Subramanian , Tong Wang , Xingdi Yuan , Saizheng Zhang , Yoshua Bengio , Adam Trischler

This study addresses the application of encoder-only Pre-trained Language Models (PLMs) in keyphrase generation (KPG) amidst the broader availability of domain-tailored encoder-only models compared to encoder-decoder models. We investigate…

Computation and Language · Computer Science 2024-02-23 Di Wu , Wasi Uddin Ahmad , Kai-Wei Chang

Keyphrase generation is the task of automatically predicting keyphrases given a piece of long text. Despite its recent flourishing, keyphrase generation on non-English languages haven't been vastly investigated. In this paper, we call…

Computation and Language · Computer Science 2022-06-02 Yifan Gao , Qingyu Yin , Zheng Li , Rui Meng , Tong Zhao , Bing Yin , Irwin King , Michael R. Lyu

Large language models(LLMS)have shown excellent text generation capabilities, capable of generating fluent human-like responses for many downstream tasks. However, applying large language models to real-world critical tasks remains…

Computation and Language · Computer Science 2023-07-21 Le Xiao , Xin Shan

Recently, generative methods have been widely used in keyphrase prediction, thanks to their capability to produce both present keyphrases that appear in the source text and absent keyphrases that do not match any source text. However, the…

Computation and Language · Computer Science 2020-04-23 Rui Liu , Zheng Lin , Weiping Wang

Automatic generation of paraphrases from a given sentence is an important yet challenging task in natural language processing (NLP), and plays a key role in a number of applications such as question answering, search, and dialogue. In this…

Computation and Language · Computer Science 2018-08-24 Zichao Li , Xin Jiang , Lifeng Shang , Hang Li

Large language models (LLMs) have gained considerable attention for Artificial Intelligence Generated Content (AIGC), particularly with the emergence of ChatGPT. However, the direct adaptation of continuous speech to LLMs that process…

Audio and Speech Processing · Electrical Eng. & Systems 2023-08-28 Haibin Wu , Kai-Wei Chang , Yuan-Kuei Wu , Hung-yi Lee

In this paper, we study an under-explored area of language and vocabulary learning: keyword mnemonics, a technique for memorizing vocabulary through memorable associations with a target word via a verbal cue. Typically, creating verbal cues…

Computation and Language · Computer Science 2024-09-24 Jaewook Lee , Hunter McNichols , Andrew Lan

Large Language Models (LLMs) excel in data synthesis but can be inaccurate in domain-specific tasks, which retrieval-augmented generation (RAG) systems address by leveraging user-provided data. However, RAGs require optimization in both…

Computation and Language · Computer Science 2024-11-05 Kazi Ahmed Asif Fuad , Lizhong Chen

Recently, large language models such as GPT-2 have shown themselves to be extremely adept at text generation and have also been able to achieve high-quality results in many downstream NLP tasks such as text classification, sentiment…

Computation and Language · Computer Science 2019-11-22 Sam Witteveen , Martin Andrews

Traditional keyphrase prediction methods predict a single set of keyphrases per document, failing to cater to the diverse needs of users and downstream applications. To bridge the gap, we introduce on-demand keyphrase generation, a novel…

Computation and Language · Computer Science 2024-10-07 Di Wu , Xiaoxian Shen , Kai-Wei Chang

Keyphrase generation is the task of predicting a set of lexical units that conveys the main content of a source text. Existing datasets for keyphrase generation are only readily available for the scholarly domain and include non-expert…

Information Retrieval · Computer Science 2019-12-02 Ygor Gallina , Florian Boudin , Béatrice Daille