English
Related papers

Related papers: A simple framework for contrastive learning phases…

200 papers

Place recognition is an essential and challenging task in loop closing and global localization for robotics and autonomous driving applications. Benefiting from the recent advances in deep learning techniques, the performance of LiDAR place…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Jiafeng Cui , Xieyuanli Chen

Continual Learning (CL) enables machine learning models to learn from continuously shifting new training data in absence of data from old tasks. Recently, pretrained vision transformers combined with prompt tuning have shown promise for…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Anurag Roy , Riddhiman Moulick , Vinay K. Verma , Saptarshi Ghosh , Abir Das

Learning permutations is fundamental to sorting, ranking, and matching, but existing differentiable methods based on entropy-regularized Sinkhorn produce a single softened solution and collapse under ambiguity. We present PermFlow, a…

Machine Learning · Computer Science 2026-05-19 Yimeng Min , Carla P. Gomes

We pilot a family of stable contrastive losses for learning pixel-level representations that jointly capture semantic and geometric information. Our approach maps each pixel of an image to an overcomplete descriptor that is both…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Leonid Pogorelyuk , Niels Bracher , Aaron Verkleeren , Lars Kühmichel , Stefan T. Radev

In recent years, machine learning (ML) techniques have emerged as powerful tools for studying many-body complex systems, and encompassing phase transitions in various domains of physics. This mini review provides a concise yet comprehensive…

Nuclear Theory · Physics 2024-01-05 Yu-Gang Ma , Long-Gang Pang , Rui Wang , Kai Zhou

Semantic context is an important and useful cue for scene parsing in complicated natural images with a substantial amount of variations in objects and the environment. This paper proposes Spatially Constrained Location Prior (SCLP) for…

Computer Vision and Pattern Recognition · Computer Science 2018-02-27 Ligang Zhang , Brijesh Verma , David Stockwell , Sujan Chowdhury

In continual learning (CL), a learner is faced with a sequence of tasks, arriving one after the other, and the goal is to remember all the tasks once the continual learning experience is finished. The prior art in CL uses episodic memory,…

Machine Learning · Computer Science 2020-12-09 Arslan Chaudhry , Naeemullah Khan , Puneet K. Dokania , Philip H. S. Torr

Image clustering, which involves grouping images into different clusters without labels, is a key task in unsupervised learning. Although previous deep clustering methods have achieved remarkable results, they only explore the intrinsic…

Computer Vision and Pattern Recognition · Computer Science 2024-09-23 Haixin Zhang , Yongjun Li , Dong Huang

Vision-Language Pretraining (VLP) has shown impressive results on diverse downstream tasks by offline training on large-scale datasets. Regarding the growing nature of real-world data, such an offline training paradigm on ever-expanding…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Hongguang Zhu , Yunchao Wei , Xiaodan Liang , Chunjie Zhang , Yao Zhao

Keypoint detection and description play a central role in computer vision. Most existing methods are in the form of scene-level prediction, without returning the object classes of different keypoints. In this paper, we propose the…

Computer Vision and Pattern Recognition · Computer Science 2022-02-04 Chengliang Zhong , Chao Yang , Jinshan Qi , Fuchun Sun , Huaping Liu , Xiaodong Mu , Wenbing Huang

We investigate contrastive learning in the federated setting through the lens of SimCLR and multi-view mutual information maximization. In doing so, we uncover a connection between contrastive representation learning and user verification;…

Machine Learning · Computer Science 2024-05-06 Christos Louizos , Matthias Reisser , Denis Korzhenkov

Recently, self-supervised learning has attracted attention due to its remarkable ability to acquire meaningful representations for classification tasks without using semantic labels. This paper introduces a self-supervised learning…

Computer Vision and Pattern Recognition · Computer Science 2022-02-09 Hyungtae Lee , Heesung Kwon

Learning representations of stochastic processes is an emerging problem in machine learning with applications from meta-learning to physical object models to time series. Typical methods rely on exact reconstruction of observations, but…

Machine Learning · Statistics 2021-11-01 Emile Mathieu , Adam Foster , Yee Whye Teh

Compressive learning (CL) is an emerging framework that integrates signal acquisition via compressed sensing (CS) and machine learning for inference tasks directly on a small number of measurements. It can be a promising alternative to…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Chong Mou , Jian Zhang

Many contrastive representation learning methods learn a single global representation of an entire image. However, dense contrastive representation learning methods such as DenseCL (Wang et al., 2021) can learn better representations for…

Computer Vision and Pattern Recognition · Computer Science 2023-01-12 Berk Iskender , Zhenlin Xu , Simon Kornblith , En-Hung Chu , Maryam Khademi

Identifying quantum flakes is crucial for scalable quantum hardware; however, automated layer classification from optical microscopy remains challenging due to substantial appearance shifts across different materials. This paper proposes a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Sankalp Pandey , Xuan Bac Nguyen , Nicholas Borys , Hugh Churchill , Khoa Luu

Weakly supervised semantic segmentation (WSSS) methods using class labels often rely on class activation maps (CAMs) to localize objects. However, traditional CAM-based methods struggle with partial activations and imprecise object…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Dewen Zeng , Xinrong Hu , Yu-Jen Chen , Yawen Wu , Xiaowei Xu , Yiyu Shi

Multi-view clustering can explore common semantics from multiple views and has attracted increasing attention. However, existing works punish multiple objectives in the same feature space, where they ignore the conflict between learning…

Machine Learning · Computer Science 2022-03-28 Jie Xu , Huayi Tang , Yazhou Ren , Liang Peng , Xiaofeng Zhu , Lifang He

Self-supervised learning (SSL) has gained remarkable success, for which contrastive learning (CL) plays a key role. However, the recent development of new non-CL frameworks has achieved comparable or better performance with high improvement…

Computer Vision and Pattern Recognition · Computer Science 2023-09-22 Thanh Nguyen , Trung Pham , Chaoning Zhang , Tung Luu , Thang Vu , Chang D. Yoo

Leveraging pre-trained 2D image representations in behavior cloning policies has achieved great success and has become a standard approach for robotic manipulation. However, such representations fail to capture the 3D spatial information…

Robotics · Computer Science 2026-05-07 I-Chun Arthur Liu , Krzysztof Choromanski , Sandy Huang , Connor Schenck