English
Related papers

Related papers: SimCKP: Simple Contrastive Learning of Keyphrase R…

200 papers

Automatic generation of paraphrases from a given sentence is an important yet challenging task in natural language processing (NLP), and plays a key role in a number of applications such as question answering, search, and dialogue. In this…

Computation and Language · Computer Science 2018-08-24 Zichao Li , Xin Jiang , Lifeng Shang , Hang Li

Keyphrase extraction (KPE) automatically extracts phrases in a document that provide a concise summary of the core content, which benefits downstream information retrieval and NLP tasks. Previous state-of-the-art (SOTA) methods select…

Computation and Language · Computer Science 2023-03-01 Linhan Zhang , Qian Chen , Wen Wang , Chong Deng , Shiliang Zhang , Bing Li , Wei Wang , Xin Cao

Keyphrases are crucial for searching and systematizing scholarly documents. Most current methods for keyphrase extraction are aimed at the extraction of the most significant words in the text. But in practice, the list of keyphrases often…

Computation and Language · Computer Science 2024-10-23 Anna Glazkova , Dmitry Morozov

Conditional contrastive learning frameworks consider the conditional sampling procedure that constructs positive or negative data pairs conditioned on specific variables. Fair contrastive learning constructs negative pairs, for example,…

Machine Learning · Computer Science 2022-03-16 Yao-Hung Hubert Tsai , Tianqin Li , Martin Q. Ma , Han Zhao , Kun Zhang , Louis-Philippe Morency , Ruslan Salakhutdinov

Training dense passage representations via contrastive learning has been shown effective for Open-Domain Passage Retrieval (ODPR). Existing studies focus on further optimizing by improving negative sampling strategy or extra pretraining.…

Computation and Language · Computer Science 2022-03-08 Bohong Wu , Zhuosheng Zhang , Jinyuan Wang , Hai Zhao

Keyphrases are useful for a variety of purposes, including summarizing, indexing, labeling, categorizing, clustering, highlighting, browsing, and searching. The task of automatic keyphrase extraction is to select keyphrases from within the…

Machine Learning · Computer Science 2007-05-23 Peter D. Turney

Contrastive Learning has emerged as a powerful representation learning method and facilitates various downstream tasks especially when supervised data is limited. How to construct efficient contrastive samples through data augmentation is…

Computation and Language · Computer Science 2021-11-30 Yangkai Du , Tengfei Ma , Lingfei Wu , Fangli Xu , Xuhong Zhang , Bo Long , Shouling Ji

As a fundamental task in Information Retrieval and Computational Linguistics, sentence representation has profound implications for a wide range of practical applications such as text clustering, content analysis, question-answering…

Computation and Language · Computer Science 2025-05-02 Bowen Zhang , Zixin Song , Chunping Li

As a natural language generation task, it is challenging to generate informative and coherent review text. In order to enhance the informativeness of the generated text, existing solutions typically learn to copy entities or triples from…

Computation and Language · Computer Science 2021-05-11 Junyi Li , Wayne Xin Zhao , Zhicheng Wei , Nicholas Jing Yuan , Ji-Rong Wen

Keyphrases are a very short summary of an input text and provide the main subjects discussed in the text. Keyphrase extraction is a useful upstream task and can be used in various natural language processing problems, for example, text…

Computation and Language · Computer Science 2020-09-28 Ehsan Doostmohammadi , Mohammad Hadi Bokaei , Hossein Sameti

Existing NTMs with contrastive learning suffer from the sample bias problem owing to the word frequency-based sampling strategy, which may result in false negative samples with similar semantics to the prototypes. In this paper, we aim to…

Computation and Language · Computer Science 2023-07-06 Zheheng Luo , Lei Liu , Qianqian Xie , Sophia Ananiadou

The recent demand for customized image generation raises a need for techniques that effectively extract the common concept from small sets of images. Existing methods typically rely on additional guidance, such as text prompts or spatial…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Minseo Kim , Minchan Kwon , Dongyeun Lee , Yunho Jeon , Junmo Kim

This paper presents SimCSE, a simple contrastive learning framework that greatly advances state-of-the-art sentence embeddings. We first describe an unsupervised approach, which takes an input sentence and predicts itself in a contrastive…

Computation and Language · Computer Science 2022-05-19 Tianyu Gao , Xingcheng Yao , Danqi Chen

This paper presents SimCLR: a simple framework for contrastive learning of visual representations. We simplify recently proposed contrastive self-supervised learning algorithms without requiring specialized architectures or a memory bank.…

Machine Learning · Computer Science 2020-07-02 Ting Chen , Simon Kornblith , Mohammad Norouzi , Geoffrey Hinton

Knowledge-grounded dialogue (KGD) learns to generate an informative response based on a given dialogue context and external knowledge (\emph{e.g.}, knowledge graphs; KGs). Recently, the emergence of large language models (LLMs) and…

Computation and Language · Computer Science 2024-01-10 Jiaan Wang , Jianfeng Qu , Kexin Wang , Zhixu Li , Wen Hua , Ximing Li , An Liu

Paraphrase generation is an important task in natural language processing. Previous works focus on sentence-level paraphrase generation, while ignoring document-level paraphrase generation, which is a more challenging and valuable task. In…

Computation and Language · Computer Science 2021-09-16 Zhe Lin , Yitao Cai , Xiaojun Wan

Detecting tampered text in document images is a challenging task due to data scarcity. To address this, previous work has attempted to generate tampered documents using rule-based methods. However, the resulting documents often suffer from…

Computer Vision and Pattern Recognition · Computer Science 2026-02-20 Mohamed Dhouib , Davide Buscaldi , Sonia Vanier , Aymen Shabou

Traditional methods of linking large language models (LLMs) to knowledge bases via the semantic similarity search often fall short of capturing complex relational dynamics. To address these limitations, we introduce AutoKG, a lightweight…

Computation and Language · Computer Science 2023-11-28 Bohan Chen , Andrea L. Bertozzi

This paper describes our submission to ICASSP 2023 MUG Challenge Track 4, Keyphrase Extraction, which aims to extract keyphrases most relevant to the conference theme from conference materials. We model the challenge as a single-class Named…

Computation and Language · Computer Science 2023-03-24 Wen Cheng , Shichen Dong , Wei Wang

In this paper, we present a keyphrase generation approach using conditional Generative Adversarial Networks (GAN). In our GAN model, the generator outputs a sequence of keyphrases based on the title and abstract of a scientific article. The…

Computation and Language · Computer Science 2019-09-27 Avinash Swaminathan , Raj Kuwar Gupta , Haimin Zhang , Debanjan Mahata , Rakesh Gosangi , Rajiv Ratn Shah