English
Related papers

Related papers: Representation Learning for Resource-Constrained K…

200 papers

In this paper, we present a keyphrase generation approach using conditional Generative Adversarial Networks (GAN). In our GAN model, the generator outputs a sequence of keyphrases based on the title and abstract of a scientific article. The…

Computation and Language · Computer Science 2019-09-27 Avinash Swaminathan , Raj Kuwar Gupta , Haimin Zhang , Debanjan Mahata , Rakesh Gosangi , Rajiv Ratn Shah

Although language models (LMs) have boosted the performance of Question Answering, they still need plenty of data. Data annotation, in contrast, is a time-consuming process. This especially applies to Question Answering, where possibly…

Computation and Language · Computer Science 2024-05-16 Maximilian Schmidt , Andrea Bartezzaghi , Ngoc Thang Vu

A major obstacle to the wide-spread adoption of neural retrieval models is that they require large supervised training sets to surpass traditional term-based techniques, which are constructed from raw corpora. In this paper, we propose an…

Information Retrieval · Computer Science 2021-01-28 Ji Ma , Ivan Korotkov , Yinfei Yang , Keith Hall , Ryan McDonald

Representation learning is a central challenge across a range of machine learning areas. In reinforcement learning, effective and functional representations have the potential to tremendously accelerate learning progress and solve more…

Machine Learning · Computer Science 2019-01-30 Dibya Ghosh , Abhishek Gupta , Sergey Levine

Neural approaches have become very popular in Question Answering (QA), however, they require a large amount of annotated data. In this work, we propose a novel approach that combines data augmentation via question-answer generation with…

Computation and Language · Computer Science 2024-09-16 Maximilian Kimmich , Andrea Bartezzaghi , Jasmina Bogojeska , Cristiano Malossi , Ngoc Thang Vu

Keyphrase Generation (KG) is the task of generating central topics from a given document or literary work, which captures the crucial information necessary to understand the content. Documents such as scientific literature contain rich…

Computation and Language · Computer Science 2020-12-15 Yichao Luo , Zhengyan Li , Bingning Wang , Xiaoyu Xing , Qi Zhang , Xuanjing Huang

Keyphrases are crucial for searching and systematizing scholarly documents. Most current methods for keyphrase extraction are aimed at the extraction of the most significant words in the text. But in practice, the list of keyphrases often…

Computation and Language · Computer Science 2024-10-23 Anna Glazkova , Dmitry Morozov

Deep generative neural networks have proven effective at both conditional and unconditional modeling of complex data distributions. Conditional generation enables interactive control, but creating new controls often requires expensive…

Machine Learning · Computer Science 2017-12-25 Jesse Engel , Matthew Hoffman , Adam Roberts

Keyphrases, that concisely summarize the high-level topics discussed in a document, can be categorized into present keyphrase which explicitly appears in the source text, and absent keyphrase which does not match any contiguous subsequence…

Computation and Language · Computer Science 2021-10-14 Jing Zhao , Junwei Bao , Yifan Wang , Youzheng Wu , Xiaodong He , Bowen Zhou

Large-scale pretrained language models have led to dramatic improvements in text generation. Impressive performance can be achieved by finetuning only on a small number of instances (few-shot setting). Nonetheless, almost all previous work…

Computation and Language · Computer Science 2021-07-08 Ernie Chang , Xiaoyu Shen , Hui-Syuan Yeh , Vera Demberg

Supervised deep learning requires a large amount of training samples with annotations (e.g. label class for classification task, pixel- or voxel-wised label map for segmentation tasks), which are expensive and time-consuming to obtain.…

Computer Vision and Pattern Recognition · Computer Science 2020-04-14 Yuanhan Mo , Shuo Wang , Chengliang Dai , Rui Zhou , Zhongzhao Teng , Wenjia Bai , Yike Guo

The Automated Speech Recognition (ASR) task has been a challenging domain especially for low data scenarios with few audio examples. This is the main problem in training ASR systems on the data from low-resource or marginalized languages.…

Computation and Language · Computer Science 2021-02-09 Anastasia Kuznetsova , Anurag Kumar , Francis M. Tyers

In this paper, we present a novel integrated approach for keyphrase generation (KG). Unlike previous works which are purely extractive or generative, we first propose a new multi-task learning framework that jointly learns an extractive…

Computation and Language · Computer Science 2019-04-09 Wang Chen , Hou Pong Chan , Piji Li , Lidong Bing , Irwin King

Modern models for text generation show state-of-the-art results in many natural language processing tasks. In this work, we explore the effectiveness of abstractive text summarization models for keyphrase selection. A list of keyphrases is…

Computation and Language · Computer Science 2024-10-23 Anna Glazkova , Dmitry Morozov

Foundation models contain a wealth of information from their vast number of training samples. However, most prior arts fail to extract this information in a precise and efficient way for small sample sizes. In this work, we propose a…

Machine Learning · Computer Science 2024-04-26 Nico Schiavone , Xingyu Li

A major obstacle in reinforcement learning-based sentence generation is the large action space whose size is equal to the vocabulary size of the target-side language. To improve the efficiency of reinforcement learning, we present a novel…

Computation and Language · Computer Science 2019-04-08 Kazuma Hashimoto , Yoshimasa Tsuruoka

The encoder-decoder framework achieves state-of-the-art results in keyphrase generation (KG) tasks by predicting both present keyphrases that appear in the source document and absent keyphrases that do not. However, relying solely on the…

Computation and Language · Computer Science 2021-09-13 Jiacheng Ye , Ruijian Cai , Tao Gui , Qi Zhang

In order to reveal the rationale behind model predictions, many works have exploited providing explanations in various forms. Recently, to further guarantee readability, more and more works turn to generate sentence-level human language…

Computation and Language · Computer Science 2023-02-22 Yan Liu , Xiaokang Chen , Qi Dai

Keyphrase generation aims at generating important phrases (keyphrases) that best describe a given document. In scholarly domains, current approaches have largely used only the title and abstract of the articles to generate keyphrases. In…

Computation and Language · Computer Science 2022-10-24 Krishna Garg , Jishnu Ray Chowdhury , Cornelia Caragea

Paraphrase generation has benefited extensively from recent progress in the designing of training objectives and model architectures. However, previous explorations have largely focused on supervised methods, which require a large amount of…

Computation and Language · Computer Science 2021-09-14 Tong Niu , Semih Yavuz , Yingbo Zhou , Nitish Shirish Keskar , Huan Wang , Caiming Xiong