English
Related papers

Related papers: Contrastive Learning with Hard Negative Entities f…

200 papers

Bootstrapping has become the mainstream method for entity set expansion. Conventional bootstrapping methods mostly define the expansion boundary using seed-based distance metrics, which heavily depend on the quality of selected seeds and…

Computation and Language · Computer Science 2021-09-27 Lingyong Yan , Xianpei Han , Le Sun

Previous contrastive learning methods for sentence representations often focus on insensitive transformations to produce positive pairs, but neglect the role of sensitive transformations that are harmful to semantic representations.…

Computation and Language · Computer Science 2023-03-10 Jie Liu , Yixuan Liu , Xue Han , Chao Deng , Junlan Feng

Entity Resolution (ER) is the task of finding entity profiles that correspond to the same real-world entity. Progressive ER aims to efficiently resolve large datasets when limited time and/or computational resources are available. In…

Databases · Computer Science 2019-05-17 Giovanni Simonini , George Papadakis , Themis Palpanas , Sonia Bergamaschi

Contrastive learning has been demonstrated to be effective in enhancing pre-trained language models (PLMs) to derive superior universal sentence embeddings. However, existing contrastive methods still have two limitations. Firstly, previous…

Computation and Language · Computer Science 2022-10-11 Yuxin Jiang , Linhan Zhang , Wei Wang

Prompt-based language models have produced encouraging results in numerous applications, including Named Entity Recognition (NER) tasks. NER aims to identify entities in a sentence and provide their types. However, the strong performance of…

Computation and Language · Computer Science 2023-08-08 Amirhossein Layegh , Amir H. Payberah , Ahmet Soylu , Dumitru Roman , Mihhail Matskin

Corpus-based set expansion (i.e., finding the "complete" set of entities belonging to the same semantic class, based on a given corpus and a tiny set of seeds) is a critical task in knowledge discovery. It may facilitate numerous downstream…

Computation and Language · Computer Science 2019-10-21 Jiaming Shen , Zeqiu Wu , Dongming Lei , Jingbo Shang , Xiang Ren , Jiawei Han

While speech emotion recognition (SER) research has made significant progress, achieving generalization across various corpora continues to pose a problem. We propose a novel domain adaptation technique that embodies a multitask framework…

Computation and Language · Computer Science 2023-10-10 Chung-Soo Ahn , Jagath C. Rajapakse , Rajib Rana

The recent success of SimCSE has greatly advanced state-of-the-art sentence representations. However, the original formulation of SimCSE does not fully exploit the potential of hard negative samples in contrastive learning. This study…

Computation and Language · Computer Science 2023-10-24 Pengyue Hou , Xingyu Li

The rapid development of multimodal large language models (MLLMs) has brought significant improvements to a wide range of tasks in real-world applications. However, LLMs still exhibit certain limitations in extracting implicit semantic…

Computation and Language · Computer Science 2025-01-03 Hebin Wang , Yangning Li , Yinghui Li , Hai-Tao Zheng , Wenhao Jiang , Hong-Gee Kim

State-of-the-art pre-trained image models predominantly adopt a two-stage approach: initial unsupervised pre-training on large-scale datasets followed by task-specific fine-tuning using Cross-Entropy loss~(CE). However, it has been…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Zijun Long , George Killick , Lipeng Zhuang , Gerardo Aragon-Camarasa , Zaiqiao Meng , Richard Mccreadie

Taking inspiration from Set Theory, we introduce SetCSE, an innovative information retrieval framework. SetCSE employs sets to represent complex semantics and incorporates well-defined operations for structured information querying under…

Information Retrieval · Computer Science 2024-04-30 Kang Liu

Visual storytelling systems, particularly large vision-language models, struggle to maintain character and object identity across frames, often failing to recognize when entities in different images represent the same individuals or…

Computer Vision and Pattern Recognition · Computer Science 2025-07-14 Daniel A. P. Oliveira , David Martins de Matos

Despite considerable progress in neural relevance ranking techniques, search engines still struggle to process complex queries effectively - both in terms of precision and recall. Sparse and dense Pseudo-Relevance Feedback (PRF) approaches…

Information Retrieval · Computer Science 2023-12-06 Iain Mackie , Shubham Chatterjee , Sean MacAvaney , Jeffrey Dalton

Since the meaning representations are detailed and accurate annotations which express fine-grained sequence-level semtantics, it is usually hard to train discriminative semantic parsers via Maximum Likelihood Estimation (MLE) in an…

Computation and Language · Computer Science 2023-01-20 Shan Wu , Chunlei Xin , Bo Chen , Xianpei Han , Le Sun

The Document Set Expansion (DSE) task involves identifying relevant documents from large collections based on a limited set of example documents. Previous research has highlighted Positive and Unlabeled (PU) learning as a promising approach…

Information Retrieval · Computer Science 2024-03-27 Haiyang Zhang , Qiuyi Chen , Yuanjie Zou , Yushan Pan , Jia Wang , Mark Stevenson

Given a few seed entities of a certain type (e.g., Software or Programming Language), entity set expansion aims to discover an extensive set of entities that share the same type as the seeds. Entity set expansion in software-related domains…

Computation and Language · Computer Science 2022-12-06 Yu Zhang , Yunyi Zhang , Yucheng Jiang , Martin Michalski , Yu Deng , Lucian Popa , ChengXiang Zhai , Jiawei Han

Joint representation learning of words and entities benefits many NLP tasks, but has not been well explored in cross-lingual settings. In this paper, we propose a novel method for joint representation learning of cross-lingual words and…

Computation and Language · Computer Science 2018-11-28 Yixin Cao , Lei Hou , Juanzi Li , Zhiyuan Liu , Chengjiang Li , Xu Chen , Tiansi Dong

Entity summarization aims at creating brief but informative descriptions of entities from knowledge graphs. While previous work mostly focused on traditional techniques such as clustering algorithms and graph models, we ask how to apply…

Computation and Language · Computer Science 2020-05-27 Dongjun Wei , Yaxin Liu , Fuqing Zhu , Liangjun Zang , Wei Zhou , Jizhong Han , Songlin Hu

As the categories of named entities rapidly increase, the deployed NER models are required to keep updating toward recognizing more entity types, creating a demand for class-incremental learning for NER. Considering the privacy concerns and…

Computation and Language · Computer Science 2023-07-25 Ruotian Ma , Xuanting Chen , Lin Zhang , Xin Zhou , Junzhe Wang , Tao Gui , Qi Zhang , Xiang Gao , Yunwen Chen

Masked language modeling, widely used in discriminative language model (e.g., BERT) pretraining, commonly adopts a random masking strategy. However, random masking does not consider the importance of the different words in the sentence…

Computation and Language · Computer Science 2023-05-25 Qihuang Zhong , Liang Ding , Juhua Liu , Bo Du , Dacheng Tao