English
Related papers

Related papers: WeatherDepth: Curriculum Contrastive Learning for …

200 papers

The introduction of large, foundational models to computer vision has led to drastically improved performance on the task of semantic segmentation. However, these existing methods exhibit a large performance drop when testing on images…

Computer Vision and Pattern Recognition · Computer Science 2023-12-18 Blake Gella , Howard Zhang , Rishi Upadhyay , Tiffany Chang , Matthew Waliman , Yunhao Ba , Alex Wong , Achuta Kadambi

Neural predictors have shown great potential in the evaluation process of neural architecture search (NAS). However, current predictor-based approaches overlook the fact that training a predictor necessitates a considerable number of…

Machine Learning · Computer Science 2023-12-15 Shenghe Zheng , Hongzhi Wang , Tianyu Mu

Linking sheet music images to audio recordings remains a key problem for the development of efficient cross-modal music retrieval systems. One of the fundamental approaches toward this task is to learn a cross-modal embedding space via deep…

Sound · Computer Science 2023-09-22 Luis Carvalho , Tobias Washüttl , Gerhard Widmer

Curriculum learning techniques are a viable solution for improving the accuracy of automatic models, by replacing the traditional random training with an easy-to-hard strategy. However, the standard curriculum methodology does not…

Computer Vision and Pattern Recognition · Computer Science 2020-09-23 Petru Soviany

WeatherSeg, an advanced semi-supervised segmentation framework, addresses autonomous driving's environmental perception challenges in adverse weather while reducing annotation costs. This framework integrates a Dual Teacher-Student…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Zhang Zhang , Yifeng Zeng , Houshi Jiang , Yinghui Pan

To extract robust deep representations from long sequential modeling of speech data, we propose a self-supervised learning approach, namely Contrastive Separative Coding (CSC). Our key finding is to learn such representations by separating…

Audio and Speech Processing · Electrical Eng. & Systems 2021-03-02 Jun Wang , Max W. Y. Lam , Dan Su , Dong Yu

We propose a unified point cloud video self-supervised learning framework for object-centric and scene-centric data. Previous methods commonly conduct representation learning at the clip or frame level and cannot well capture fine-grained…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Xiaoxiao Sheng , Zhiqiang Shen , Gang Xiao , Longguang Wang , Yulan Guo , Hehe Fan

This paper explores post-disaster analytics using multimodal deep learning models trained with curriculum learning method. Studying post-disaster analytics is important as it plays a crucial role in mitigating the impact of disasters by…

Computer Vision and Pattern Recognition · Computer Science 2023-11-08 Huseyin Fuat Alsan , Taner Arsan

Contrastive learning has revolutionized self-supervised image representation learning field, and recently been adapted to video domain. One of the greatest advantages of contrastive learning is that it allows us to flexibly define powerful…

Computer Vision and Pattern Recognition · Computer Science 2021-08-06 Haofei Kuang , Yi Zhu , Zhi Zhang , Xinyu Li , Joseph Tighe , Sören Schwertfeger , Cyrill Stachniss , Mu Li

Contrastive learning has become a key component of self-supervised learning approaches for computer vision. By learning to embed two augmented versions of the same image close to each other and to push the embeddings of different images…

Computer Vision and Pattern Recognition · Computer Science 2020-12-07 Yannis Kalantidis , Mert Bulent Sariyildiz , Noe Pion , Philippe Weinzaepfel , Diane Larlus

In the era of big data and Artificial Intelligence, an emerging paradigm is to utilize contrastive self-supervised learning to model large-scale heterogeneous data. Many existing foundation models benefit from the generalization capability…

Machine Learning · Computer Science 2024-04-02 Lecheng Zheng , Baoyu Jing , Zihao Li , Hanghang Tong , Jingrui He

We present ConCur, a contrastive video representation learning method that uses curriculum learning to impose a dynamic sampling strategy in contrastive training. More specifically, ConCur starts the contrastive training with easy positive…

Computer Vision and Pattern Recognition · Computer Science 2022-09-05 Shuvendu Roy , Ali Etemad

As a safety critical task, autonomous driving requires accurate predictions of road users' future trajectories for safe motion planning, particularly under challenging conditions. Yet, many recent deep learning methods suffer from a…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Junrui Zhang , Mozhgan Pourkeshavarz , Amir Rasouli

Recent contrastive methods show significant improvement in self-supervised learning in several domains. In particular, contrastive methods are most effective where data augmentation can be easily constructed e.g. in computer vision.…

Machine Learning · Computer Science 2021-12-09 Konstantinos Kallidromitis , Denis Gudovskiy , Kazuki Kozuka , Iku Ohama , Luca Rigazio

Self-supervised monocular depth estimation has shown impressive results in static scenes. It relies on the multi-view consistency assumption for training networks, however, that is violated in dynamic object regions and occlusions.…

Computer Vision and Pattern Recognition · Computer Science 2023-10-06 Libo Sun , Jia-Wang Bian , Huangying Zhan , Wei Yin , Ian Reid , Chunhua Shen

Texture classification is a pivotal task in computer vision, presenting unique challenges due to high inter-class similarity and the sensitivity of structural patterns to scale and illumination changes. While Convolutional Neural Networks…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Joao B Florindo

In this paper we present a world model, which learns causal features using the invariance principle. In particular, we use contrastive unsupervised learning to learn the invariant causal features, which enforces invariance across…

Machine Learning · Computer Science 2022-09-30 Rudra P. K. Poudel , Harit Pandya , Roberto Cipolla

Discriminating the traversability of terrains is a crucial task for autonomous driving in off-road environments. However, it is challenging due to the diverse, ambiguous, and platform-specific nature of off-road traversability. In this…

Robotics · Computer Science 2023-07-07 Hanzhang Xue , Xiaochang Hu , Rui Xie , Hao Fu , Liang Xiao , Yiming Nie , Bin Dai

In this work we present a self-supervised learning framework to simultaneously train two Convolutional Neural Networks (CNNs) to predict depth and surface normals from a single image. In contrast to most existing frameworks which represent…

Computer Vision and Pattern Recognition · Computer Science 2019-03-04 Huangying Zhan , Chamara Saroj Weerasekera , Ravi Garg , Ian Reid

Self-supervised contrastive learning is a powerful tool to learn visual representation without labels. Prior work has primarily focused on evaluating the recognition accuracy of various pre-training algorithms, but has overlooked other…

Computer Vision and Pattern Recognition · Computer Science 2022-06-13 Yuanyi Zhong , Haoran Tang , Junkun Chen , Jian Peng , Yu-Xiong Wang