English
Related papers

Related papers: Resilient Contrastive Pre-training under Non-Stati…

200 papers

We propose a learning-based robust predictive control algorithm that compensates for significant uncertainty in the dynamics for a class of discrete-time systems that are nominally linear with an additive nonlinear component. Such systems…

Systems and Control · Electrical Eng. & Systems 2021-10-15 Rohan Sinha , James Harrison , Spencer M. Richards , Marco Pavone

This paper is concerned with contrastive learning (CL) for low-level image restoration and enhancement tasks. We propose a new label-efficient learning paradigm based on residuals, residual contrastive learning (RCL), and derive an…

Computer Vision and Pattern Recognition · Computer Science 2022-04-28 Nanqing Dong , Matteo Maggioni , Yongxin Yang , Eduardo Pérez-Pellitero , Ales Leonardis , Steven McDonagh

Machine learning models achieve state-of-the-art performance on many supervised learning tasks. However, prior evidence suggests that these models may learn to rely on shortcut biases or spurious correlations (intuitively, correlations that…

Machine Learning · Computer Science 2021-08-31 Sindhu C. M. Gowda , Shalmali Joshi , Haoran Zhang , Marzyeh Ghassemi

The integration of visual and textual data in Vision-Language Pre-training (VLP) models is crucial for enhancing vision-language understanding. However, the adversarial robustness of these models, especially in the alignment of image-text…

Multimedia · Computer Science 2025-06-03 Youze Wang , Wenbo Hu , Yinpeng Dong , Hanwang Zhang , Hang Su , Richang Hong

Tremendous breakthroughs have been developed in Semi-Supervised Semantic Segmentation (S4) through contrastive learning. However, due to limited annotations, the guidance on unlabeled images is generated by the model itself, which…

Computer Vision and Pattern Recognition · Computer Science 2024-02-29 Haoyu Xie , Changqi Wang , Jian Zhao , Yang Liu , Jun Dan , Chong Fu , Baigui Sun

Causal Temporal Representation Learning (Ctrl) methods aim to identify the temporal causal dynamics of complex nonstationary temporal sequences. Despite the success of existing Ctrl methods, they require either directly observing the domain…

Machine Learning · Computer Science 2024-09-06 Xiangchen Song , Zijian Li , Guangyi Chen , Yujia Zheng , Yewen Fan , Xinshuai Dong , Kun Zhang

Existing adversarial learning approaches mostly use class labels to generate adversarial samples that lead to incorrect predictions, which are then used to augment the training of the model for improved robustness. While some recent works…

Machine Learning · Computer Science 2020-10-27 Minseon Kim , Jihoon Tack , Sung Ju Hwang

Recently, multimodal contrastive learning (MMCL) approaches, such as CLIP, have achieved a remarkable success in learning representations that are robust against distribution shift and generalize to new domains. Despite the empirical…

Machine Learning · Computer Science 2024-03-19 Yihao Xue , Siddharth Joshi , Dang Nguyen , Baharan Mirzasoleiman

Recently, learning urban region representations utilizing multi-modal data (information views) has become increasingly popular, for deep understanding of the distributions of various socioeconomic features in cities. However, previous…

Machine Learning · Computer Science 2023-12-18 Zechen Li , Weiming Huang , Kai Zhao , Min Yang , Yongshun Gong , Meng Chen

Primate vision depends on recurrent processing for reliable perception. A growing body of literature also suggests that recurrent connections improve the learning efficiency and generalization of vision models on classic computer vision…

Computer Vision and Pattern Recognition · Computer Science 2020-10-26 Drew Linsley , Alekh Karkada Ashok , Lakshmi Narasimhan Govindarajan , Rex Liu , Thomas Serre

Contrastive Language-Image Pre-trained (CLIP) models have zero-shot ability of classifying an image belonging to "[CLASS]" by using similarity between the image and the prompt sentence "a [CONTEXT] of [CLASS]". Based on exhaustive text cues…

Computer Vision and Pattern Recognition · Computer Science 2022-11-30 Xiaofeng Mao , Yuefeng Chen , Xiaojun Jia , Rong Zhang , Hui Xue , Zhao Li

In recent years, self-supervised representation learning for skeleton-based action recognition has advanced with the development of contrastive learning methods. However, most of contrastive paradigms are inherently discriminative and often…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Dang Dinh Nguyen , Decky Aspandi Latif , Titus Zaharia

Recent vision-language foundation models, such as CLIP, have demonstrated superior capabilities in learning representations that can be transferable across diverse range of downstream tasks and domains. With the emergence of such powerful…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Hunmin Yang , Jongoh Jeong , Kuk-Jin Yoon

Conformal Prediction (CP) has recently received a tremendous amount of interest, leading to a wide range of new theoretical and methodological results for predictive inference with formal theoretical guarantees. However, the vast majority…

Statistics Theory · Mathematics 2025-08-22 Manit Paul , Arun Kumar Kuchibhotla , Eric J. Tchetgen Tchetgen

Graph contrastive learning (GCL) has become a powerful tool for learning graph data, but its scalability remains a significant challenge. In this work, we propose a simple yet effective training framework called Structural Compression…

Machine Learning · Computer Science 2024-05-10 Shengzhong Zhang , Wenjie Yang , Xinyuan Cao , Hongwei Zhang , Zengfeng Huang

Ensuring safety of nonlinear systems under model uncertainty and external disturbances is crucial, especially for real-world control tasks. Predictive methods such as robust model predictive control (RMPC) require solving nonconvex…

Systems and Control · Electrical Eng. & Systems 2023-11-14 Zeyang Li , Chuxiong Hu , Weiye Zhao , Changliu Liu

Self supervised contrastive learning based pretraining allows development of robust and generalized deep learning models with small, labeled datasets, reducing the burden of label generation. This paper aims to evaluate the effect of CL…

Image and Video Processing · Electrical Eng. & Systems 2022-08-25 Minhaj Nur Alam , Rikiya Yamashita , Vignav Ramesh , Tejas Prabhune , Jennifer I. Lim , R. V. P. Chan , Joelle Hallak , Theodore Leng , Daniel Rubin

Reinforcement learning has produced remarkable advances in humanoid locomotion, yet a fundamental dilemma persists for real-world deployment: policies must choose between the robustness of reactive proprioceptive control or the proactivity…

Robotics · Computer Science 2025-09-17 Yidan Lu , Rurui Yang , Qiran Kou , Mengting Chen , Tao Fan , Peter Cui , Yinzhao Dong , Peng Lu

Contrastive learning has emerged as a powerful method in deep learning, excelling at learning effective representations through contrasting samples from different distributions. However, neural collapse, where embeddings converge into a…

Machine Learning · Computer Science 2024-10-08 Huanran Li , Manh Nguyen , Daniel Pimentel-Alarcón

Autonomous drifting is a complex and crucial maneuver for safety-critical scenarios like slippery roads and emergency collision avoidance, requiring precise motion planning and control. Traditional motion planning methods often struggle…

Robotics · Computer Science 2025-07-01 Bei Zhou , Baha Zarrouki , Mattia Piccinini , Cheng Hu , Lei Xie , Johannes Betz