English
Related papers

Related papers: i-Mix: A Domain-Agnostic Strategy for Contrastive …

200 papers

This paper proposes a novel formulation of prototypical loss with mixup for speaker verification. Mixup is a simple yet efficient data augmentation technique that fabricates a weighted combination of random data point and label pairs for…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-13 Xin Zhang , Minho Jin , Roger Cheng , Ruirui Li , Eunjung Han , Andreas Stolcke

Contrastive learning has recently established itself as a powerful self-supervised learning framework for extracting rich and versatile data representations. Broadly speaking, contrastive learning relies on a data augmentation scheme to…

Machine Learning · Computer Science 2023-05-02 Ilgee Hong , Huy Tran , Claire Donnat

In general, an experimental environment for deep learning assumes that the training and the test dataset are sampled from the same distribution. However, in real-world situations, a difference in the distribution between two datasets,…

Computer Vision and Pattern Recognition · Computer Science 2021-04-21 Daehee Kim , Seunghyun Park , Jinkyu Kim , Jaekoo Lee

Change captioning aims to succinctly describe the semantic change between a pair of similar images, while being immune to distractors (illumination and viewpoint changes). Under these distractors, unchanged objects often appear pseudo…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Yunbin Tu , Liang Li , Li Su , Chenggang Yan , Qingming Huang

Graph Contrastive Learning frameworks have demonstrated success in generating high-quality node representations. The existing research on efficient data augmentation methods and ideal pretext tasks for graph contrastive learning remains…

Machine Learning · Computer Science 2024-10-22 Zhenyu Lin , Hongzheng Li , Yingxia Shao , Guanhua Ye , Yawen Li , Quanqing Xu

Unsupervised region representation learning aims to extract dense and effective features from unlabeled urban data. While some efforts have been made for solving this problem based on multiple views, existing methods are still insufficient…

Computer Vision and Pattern Recognition · Computer Science 2022-11-17 Liang Zhang , Cheng Long , Gao Cong

Learning invariant representations is a critical first step in a number of machine learning tasks. A common approach corresponds to the so-called information bottleneck principle in which an application dependent function of mutual…

Machine Learning · Computer Science 2021-02-17 Aditya Kumar Akash , Vishnu Suresh Lokhande , Sathya N. Ravi , Vikas Singh

Speaker verification system trained on one domain usually suffers performance degradation when applied to another domain. To address this challenge, researchers commonly use feature distribution matching-based methods in unsupervised domain…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-23 Wen Huang , Bing Han , Zhengyang Chen , Shuai Wang , Yanmin Qian

Generally, image-to-image translation (i2i) methods aim at learning mappings across domains with the assumption that the images used for translation share content (e.g., pose) but have their own domain-specific information (a.k.a. style).…

Image and Video Processing · Electrical Eng. & Systems 2023-05-12 Mohamed Abid , Arman Afrasiyabi , Ihsen Hedhli , Jean-François Lalonde , Christian Gagné

Regional dropout strategies have been proposed to enhance the performance of convolutional neural network classifiers. They have proved to be effective for guiding the model to attend on less discriminative parts of objects (e.g. leg as…

Computer Vision and Pattern Recognition · Computer Science 2019-08-11 Sangdoo Yun , Dongyoon Han , Seong Joon Oh , Sanghyuk Chun , Junsuk Choe , Youngjoon Yoo

The state of the art in semantic segmentation is steadily increasing in performance, resulting in more precise and reliable segmentations in many different applications. However, progress is limited by the cost of generating labels for…

Computer Vision and Pattern Recognition · Computer Science 2020-12-01 Viktor Olsson , Wilhelm Tranheden , Juliano Pinto , Lennart Svensson

Semantic segmentation using convolutional neural networks (CNN) is a crucial component in image analysis. Training a CNN to perform semantic segmentation requires a large amount of labeled data, where the production of such labeled data is…

Computer Vision and Pattern Recognition · Computer Science 2021-01-26 Ying Chen , Xu Ouyang , Kaiyue Zhu , Gady Agam

Recent self-supervised models have demonstrated equal or better performance than supervised methods, opening for AI systems to learn visual representations from practically unlimited data. However, these methods are typically…

Computer Vision and Pattern Recognition · Computer Science 2022-10-10 Robin Karlsson , Tomoki Hayashi , Keisuke Fujii , Alexander Carballo , Kento Ohtani , Kazuya Takeda

Inspired by the idea of Positive-incentive Noise (Pi-Noise or $\pi$-Noise) that aims at learning the reliable noise beneficial to tasks, we scientifically investigate the connection between contrastive learning and $\pi$-noise in this…

Machine Learning · Computer Science 2026-05-11 Hongyuan Zhang , Yanchen Xu , Sida Huang , Xuelong Li

In the field of vision-language contrastive learning, models such as CLIP capitalize on matched image-caption pairs as positive examples and leverage within-batch non-matching pairs as negatives. This approach has led to remarkable outcomes…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Maxwell Aladago , Lorenzo Torresani , Soroush Vosoughi

We propose a method for unsupervised domain adaptation that trains a shared embedding to align the joint distributions of inputs (domain) and outputs (classes), making any classifier agnostic to the domain. Joint alignment ensures that not…

Machine Learning · Computer Science 2019-05-28 Safa Cicek , Stefano Soatto

Radiance Fields have become a powerful tool for modeling 3D scenes from multiple images. However, they remain difficult to segment into semantically meaningful regions. Some methods work well using 2D semantic masks, but they generalize…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Corentin Dumery , Aoxiang Fan , Ren Li , Nicolas Talabot , Pascal Fua

A complex combination of simultaneous supervised-unsupervised learning is believed to be the key to humans performing tasks seamlessly across multiple domains or tasks. This phenomenon of cross-domain learning has been very well studied in…

Machine Learning · Computer Science 2021-04-14 Sourabh Balgi , Ambedkar Dukkipati

Semantic search is an important task which objective is to find the relevant index from a database for query. It requires a retrieval model that can properly learn the semantics of sentences. Transformer-based models are widely used as…

Machine Learning · Computer Science 2022-09-28 Mingxi Tan , Alexis Rolland , Andong Tian

CutMix is a popular augmentation technique commonly used for training modern convolutional and transformer vision networks. It was originally designed to encourage Convolution Neural Networks (CNNs) to focus more on an image's global…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Jihao Liu , Boxiao Liu , Hang Zhou , Hongsheng Li , Yu Liu