English
Related papers

Related papers: Compass-Embedding v4: Robust Contrastive Learning …

200 papers

Contrastive learning is a powerful technique to learn representations that are semantically distinctive and geometrically invariant. While most of the earlier approaches have demonstrated its effectiveness on single-modality learning tasks…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Anurag Jain , Yashaswi Verma

We propose a two-stage "Mine and Refine" contrastive training framework for semantic text embeddings to enhance multi-category e-commerce search retrieval. Large scale e-commerce search demands embeddings that generalize to long tail, noisy…

Information Retrieval · Computer Science 2026-02-20 Jiaqi Xi , Raghav Saboo , Luming Chen , Martin Wang , Sudeep Das

Multimodal Large Language Models (MLLMs) have demonstrated remarkable capabilities by integrating visual and textual inputs, yet modality alignment remains one of the most challenging aspects. Current MLLMs typically rely on simple adapter…

Computer Vision and Pattern Recognition · Computer Science 2025-09-08 Yuanyang Yin , Yaqi Zhao , Yajie Zhang , Yuanxing Zhang , Ke Lin , Jiahao Wang , Xin Tao , Pengfei Wan , Wentao Zhang , Feng Zhao

Cross-lingual transfer of word embeddings aims to establish the semantic mappings among words in different languages by learning the transformation functions over the corresponding word embedding spaces. Successfully solving this problem…

Computation and Language · Computer Science 2018-09-12 Ruochen Xu , Yiming Yang , Naoki Otani , Yuexin Wu

The core of cross-modal matching is to accurately measure the similarity between different modalities in a unified representation space. However, compared to textual descriptions of a certain perspective, the visual modality has more…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Wenzhang Wei , Zhipeng Gui , Changguang Wu , Anqi Zhao , Dehua Peng , Huayi Wu

The field of cross-lingual sentence embeddings has recently experienced significant advancements, but research concerning low-resource languages has lagged due to the scarcity of parallel corpora. This paper shows that cross-lingual word…

Computation and Language · Computer Science 2024-04-04 Zhongtao Miao , Qiyu Wu , Kaiyan Zhao , Zilong Wu , Yoshimasa Tsuruoka

Recent advancements in contrastive learning have revolutionized self-supervised representation learning and achieved state-of-the-art performance on benchmark tasks. While most existing methods focus on applying contrastive learning to…

Machine Learning · Computer Science 2024-04-16 Lihui Liu , Jinha Kim , Vidit Bansal

Contrastive learning is widely used for sentence representation learning. Despite this prevalence, most studies have focused exclusively on English and few concern domain adaptation for domain-specific downstream tasks, especially for…

Computation and Language · Computer Science 2023-01-20 Zihao Chen , Hisashi Handa , Kimiaki Shirahama

This paper tackles the pressing challenge of preserving semantic meaning in communication systems constrained by limited bandwidth. We introduce a novel reinforcement learning framework that achieves per-dimension unequal error protection…

Machine Learning · Computer Science 2026-03-02 Moirangthem Tiken Singh , Adnan Arif

Multimodal representation learning produces high-dimensional embeddings that align diverse modalities in a shared latent space. While this enables strong generalization, it also introduces scalability challenges, both in terms of storage…

Machine Learning · Computer Science 2025-09-30 Eleonora Grassucci , Giordano Cicchetti , Aurelio Uncini , Danilo Comminiello

Acoustic Word Embeddings (AWEs) improve the efficiency of speech retrieval tasks such as Spoken Term Detection (STD) and Keyword Spotting (KWS). However, existing approaches suffer from limitations, including unimodal supervision, disjoint…

Sound · Computer Science 2025-12-17 Ramesh Gundluru , Shubham Gupta , Sri Rama Murty K

Recent progress on unsupervised learning of cross-lingual embeddings in bilingual setting has given impetus to learning a shared embedding space for several languages without any supervision. A popular framework to solve the latter problem…

Computation and Language · Computer Science 2020-04-21 Pratik Jawanpuria , Mayank Meghwanshi , Bamdev Mishra

Remote sensing image segmentation faces persistent challenges in distinguishing morphologically similar categories and adapting to diverse scene variations. While existing methods rely on implicit representation learning paradigms, they…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Xuechao Zou , Yue Li , Shun Zhang , Kai Li , Shiying Wang , Pin Tao , Junliang Xing , Congyan Lang

Robust radio signal recognition is fundamental to spectrum management, electromagnetic space security, and intelligent wireless applications, yet existing deep-learning methods rely heavily on large labeled datasets and struggle to capture…

Signal Processing · Electrical Eng. & Systems 2026-04-14 Shilian Zheng , Jie Chen , Luxin Zhang , Xiaoniu Yang

Recent recommender systems increasingly leverage embeddings from large pre-trained language models (PLMs). However, such embeddings exhibit two key limitations: (1) PLMs are not explicitly optimized to produce structured and discriminative…

Computation and Language · Computer Science 2026-01-19 Guy Hadad , Neomi Rabaev , Bracha Shapira

Contrastive learning has been demonstrated to be effective in enhancing pre-trained language models (PLMs) to derive superior universal sentence embeddings. However, existing contrastive methods still have two limitations. Firstly, previous…

Computation and Language · Computer Science 2022-10-11 Yuxin Jiang , Linhan Zhang , Wei Wang

Recent advances in cross-lingual word embeddings have primarily relied on mapping-based methods, which project pretrained word embeddings from different languages into a shared space through a linear transformation. However, these…

Computation and Language · Computer Science 2020-05-04 Ali Sabet , Prakhar Gupta , Jean-Baptiste Cordonnier , Robert West , Martin Jaggi

This paper improves contrastive learning for sentence embeddings from two perspectives: handling dropout noise and addressing feature corruption. Specifically, for the first perspective, we identify that the dropout noise from negative…

Computation and Language · Computer Science 2023-12-25 Jiahao Xu , Wei Shao , Lihui Chen , Lemao Liu

As a pioneering work, PointContrast conducts unsupervised 3D representation learning via leveraging contrastive learning over raw RGB-D frames and proves its effectiveness on various downstream tasks. However, the trend of large-scale…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Xiaoyang Wu , Xin Wen , Xihui Liu , Hengshuang Zhao

Unsupervised region representation learning aims to extract dense and effective features from unlabeled urban data. While some efforts have been made for solving this problem based on multiple views, existing methods are still insufficient…

Computer Vision and Pattern Recognition · Computer Science 2022-11-17 Liang Zhang , Cheng Long , Gao Cong