English
Related papers

Related papers: WeatherDepth: Curriculum Contrastive Learning for …

200 papers

Self-supervised monocular depth estimation holds significant importance in the fields of autonomous driving and robotics. However, existing methods are typically trained and tested on standard datasets, overlooking the impact of various…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Ziyang Song , Ruijie Zhu , Chuxin Wang , Jiacheng Deng , Jianfeng He , Tianzhu Zhang

Previous deep learning approaches for survival analysis have primarily relied on ranking losses to improve discrimination performance, which often comes at the expense of calibration performance. To address such an issue, we propose a novel…

Machine Learning · Computer Science 2024-11-22 Dongjoon Lee , Hyeryn Park , Changhee Lee

The prior self-supervised learning researches mainly select image-level instance discrimination as pretext task. It achieves a fantastic classification performance that is comparable to supervised learning methods. However, with degraded…

Computer Vision and Pattern Recognition · Computer Science 2022-05-11 Bing Zhao , Jun Li , Hong Zhu

Curriculum learning is a widely adopted training strategy in natural language processing (NLP), where models are exposed to examples organized by increasing difficulty to enhance learning efficiency and performance. However, most existing…

Computation and Language · Computer Science 2025-07-15 Qi Feng , Yihong Liu , Hinrich Schütze

Deep learning models are modern tools for spatio-temporal graph (STG) forecasting. Though successful, we argue that data scarcity is a key factor limiting their recent improvements. Meanwhile, contrastive learning has been an effective…

Machine Learning · Computer Science 2022-11-04 Xu Liu , Yuxuan Liang , Chao Huang , Yu Zheng , Bryan Hooi , Roger Zimmermann

Contrastive learning has shown to be effective to learn representations from time series in a self-supervised way. However, contrasting similar time series instances or values from adjacent timestamps within a time series leads to ignore…

Machine Learning · Computer Science 2026-01-15 Seunghan Lee , Taeyoung Park , Kibok Lee

Point clouds have attracted increasing attention. Significant progress has been made in methods for point cloud analysis, which often requires costly human annotation as supervision. To address this issue, we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2021-08-31 Bi'an Du , Xiang Gao , Wei Hu , Xin Li

Monocular depth estimation is one of the fundamental tasks in environmental perception and has achieved tremendous progress in virtue of deep learning. However, the performance of trained models tends to degrade or deteriorate when employed…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Qiyu Sun , Gary G. Yen , Yang Tang , Chaoqiang Zhao

Multimodal models, such as the Contrastive Language-Image Pre-training (CLIP) model, have demonstrated remarkable success in aligning visual and linguistic representations. However, these models exhibit limitations when applied to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Hiroshi Sasaki

Contrastive learning models have achieved great success in unsupervised visual representation learning, which maximize the similarities between feature representations of different views of the same image, while minimize the similarities…

Computation and Language · Computer Science 2022-01-13 Shusheng Xu , Xingxing Zhang , Yi Wu , Furu Wei

Recent breakthroughs in self-supervised learning show that such algorithms learn visual representations that can be transferred better to unseen tasks than joint-training methods relying on task-specific supervision. In this paper, we found…

Machine Learning · Computer Science 2021-06-29 Hyuntak Cha , Jaeho Lee , Jinwoo Shin

Self-supervised learning of depth map prediction and motion estimation from monocular video sequences is of vital importance -- since it realizes a broad range of tasks in robotics and autonomous vehicles. A large number of research efforts…

Computer Vision and Pattern Recognition · Computer Science 2021-03-24 Ue-Hwan Kim , Jong-Hwan Kim

Detecting anomalies is one fundamental aspect of a safety-critical software system, however, it remains a long-standing problem. Numerous branches of works have been proposed to alleviate the complication and have demonstrated their…

Machine Learning · Computer Science 2023-01-31 Hyunsoo Cho , Jinseok Seol , Sang-goo Lee

The impressive performance of GPT-3 using natural language prompts and in-context learning has inspired work on better fine-tuning of moderately-sized models under this paradigm. Following this line of work, we present a contrastive…

Computation and Language · Computer Science 2022-05-04 Yiren Jian , Chongyang Gao , Soroush Vosoughi

Forecasting faithful trajectories of multivariate time series from practical scopes is essential for reasonable decision-making. Recent methods majorly tailor generative conditional diffusion models to estimate the target temporal…

Machine Learning · Computer Science 2024-10-04 Siyang Li , Yize Chen , Hui Xiong

Contrastive representation learning has been recently proved to be very efficient for self-supervised training. These methods have been successfully used to train encoders which perform comparably to supervised training on downstream…

Machine Learning · Computer Science 2020-12-03 Ibrahim Merad , Yiyang Yu , Emmanuel Bacry , Stéphane Gaïffas

Event cameras can record scene dynamics with high temporal resolution, providing rich scene details for monocular depth estimation (MDE) even at low-level illumination. Therefore, existing complementary learning approaches for MDE fuse…

Computer Vision and Pattern Recognition · Computer Science 2024-03-01 Haotian Liu , Sanqing Qu , Fan Lu , Zongtao Bu , Florian Roehrbein , Alois Knoll , Guang Chen

Self-supervised learning is a machine learning approach that generates implicit labels by learning underlined patterns and extracting discriminative features from unlabeled data without manual labelling. Contrastive learning introduces the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Asifullah Khan , Laiba Asmatullah , Anza Malik , Shahzaib Khan , Hamna Asif

The learning order of semantic classes significantly impacts unsupervised domain adaptation for semantic segmentation, especially under adverse weather conditions. Most existing curricula rely on handcrafted heuristics (e.g., fixed…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Shiqin Wang , Haoyang Chen , Huaizhou Huang , Yinkan He , Dongfang Sun , Xiaoqing Chen , Xingyu Liu , Zheng Wang , Kaiyan Zhao

Contrastive learning is an approach to representation learning that utilizes naturally occurring similar and dissimilar pairs of data points to find useful embeddings of data. In the context of document classification under topic modeling…

Machine Learning · Computer Science 2020-03-05 Christopher Tosh , Akshay Krishnamurthy , Daniel Hsu