English
Related papers

Related papers: Learning Depth from Past Selves: Self-Evolution Co…

200 papers

Vast quantities of person-generated health data (wearables) are collected but the process of annotating to feed to machine learning models is impractical. This paper discusses ways in which self-supervised approaches that use contrastive…

Machine Learning · Computer Science 2021-11-16 Kevalee Shah , Dimitris Spathis , Chi Ian Tang , Cecilia Mascolo

Contrastive learning has emerged as a prominent branch of self-supervised learning for several years. Especially, CLIP, which applies contrastive learning to large sets of captioned images, has garnered significant attention. Recently,…

Machine Learning · Computer Science 2024-02-21 Chungpa Lee , Joonhwan Chang , Jy-yong Sohn

Recently, self-supervised representation learning gives further development in multimedia technology. Most existing self-supervised learning methods are applicable to packaged data. However, when it comes to streamed data, they are…

Computer Vision and Pattern Recognition · Computer Science 2022-11-03 Zhiwei Lin , Yongtao Wang , Hongxiang Lin

A deep learning model is presented to nowcast the occurrence of lightning at a five-minute time resolution 60 minutes into the future. The model is based on a recurrent-convolutional architecture that allows it to recognize and predict the…

Atmospheric and Oceanic Physics · Physics 2023-03-16 Jussi Leinonen , Ulrich Hamann , Urs Germann

Monocular depth estimation is an extensively studied computer vision problem with a vast variety of applications. Deep learning-based methods have demonstrated promise for both supervised and unsupervised depth estimation from monocular…

Computer Vision and Pattern Recognition · Computer Science 2019-06-18 Richard Chen , Faisal Mahmood , Alan Yuille , Nicholas J. Durr

Recently, self-supervised methods show remarkable achievements in image-level representation learning. Nevertheless, their image-level self-supervisions lead the learned representation to sub-optimal for dense prediction tasks, such as…

Computer Vision and Pattern Recognition · Computer Science 2021-11-23 Yunsung Lee , Teakgyu Hong , Han-Cheol Cho , Junbum Cha , Seungryong Kim

Underwater environments pose significant challenges due to the selective absorption and scattering of light by water, which affects image clarity, contrast, and color fidelity. To overcome these, we introduce OceanLens, a method that models…

Image and Video Processing · Electrical Eng. & Systems 2024-11-21 Rajini Makam , Dhatri Shankari T M , Sharanya Patil , Suresh Sundram

Learning based methods have shown very promising results for the task of depth estimation in single images. However, most existing approaches treat depth prediction as a supervised regression problem and as a result, require vast quantities…

Computer Vision and Pattern Recognition · Computer Science 2017-04-14 Clément Godard , Oisin Mac Aodha , Gabriel J. Brostow

Self-supervised learning (SSL) has emerged as a powerful technique for learning rich representations from unlabeled data. The data representations are able to capture many underlying attributes of data, and be useful in downstream…

Machine Learning · Computer Science 2023-12-01 Weicheng Zhu , Sheng Liu , Carlos Fernandez-Granda , Narges Razavian

While effective in recommendation tasks, collaborative filtering (CF) techniques face the challenge of data sparsity. Researchers have begun leveraging contrastive learning to introduce additional self-supervised signals to address this.…

Information Retrieval · Computer Science 2024-02-20 Peijie Sun , Le Wu , Kun Zhang , Xiangzhi Chen , Meng Wang

Deep neural networks (DNNs) have achieved remarkable success in computer vision tasks such as image classification, segmentation, and object detection. However, they are vulnerable to adversarial attacks, which can cause incorrect…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Suklav Ghosh , Sonal Kumar , Arijit Sur

Per-pixel ground-truth depth data is challenging to acquire at scale. To overcome this limitation, self-supervised learning has emerged as a promising alternative for training models to perform monocular depth estimation. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Clément Godard , Oisin Mac Aodha , Michael Firman , Gabriel Brostow

In self-supervised monocular depth estimation, the depth discontinuity and motion objects' artifacts are still challenging problems. Existing self-supervised methods usually utilize a single view to train the depth estimation network.…

Computer Vision and Pattern Recognition · Computer Science 2020-06-29 Jianrong Wang , Ge Zhang , Zhenyu Wu , XueWei Li , Li Liu

We investigate a strategy for improving the efficiency of contrastive learning of visual representations by leveraging a small amount of supervised information during pre-training. We propose a semi-supervised loss, SuNCEt, based on…

Machine Learning · Computer Science 2020-12-03 Mahmoud Assran , Nicolas Ballas , Lluis Castrejon , Michael Rabbat

This paper studies a training method to jointly estimate an energy-based model and a flow-based model, in which the two models are iteratively updated based on a shared adversarial value function. This joint training method has the…

Machine Learning · Statistics 2020-04-02 Ruiqi Gao , Erik Nijkamp , Diederik P. Kingma , Zhen Xu , Andrew M. Dai , Ying Nian Wu

Self-supervised contrastive learning is an effective approach for addressing the challenge of limited labelled data. This study builds upon the previously established two-stage patch-level, multi-label classification method for…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Salma Haidar , José Oramas

Previous work on action representation learning focused on global representations for short video clips. In contrast, many practical applications, such as video alignment, strongly demand learning the intensive representation of long…

Computer Vision and Pattern Recognition · Computer Science 2023-03-03 Minghao Chen , Renbo Tu , Chenxi Huang , Yuqi Lin , Boxi Wu , Deng Cai

Existing adversarial learning approaches mostly use class labels to generate adversarial samples that lead to incorrect predictions, which are then used to augment the training of the model for improved robustness. While some recent works…

Machine Learning · Computer Science 2020-10-27 Minseon Kim , Jihoon Tack , Sung Ju Hwang

Knowledge tracing and dropout prediction are crucial for online education to estimate students' knowledge states or to prevent dropout rates. While traditional systems interacting with students suffered from data sparsity and overfitting,…

Computers and Society · Computer Science 2022-10-20 Jungbae Park , Jinyoung Kim , Soonwoo Kwon , Sang Wan Lee

Understanding human motion is crucial for accurate pedestrian trajectory prediction. Conventional methods typically rely on supervised learning, where ground-truth labels are directly optimized against predicted trajectories. This amplifies…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Yizhou Huang , Yihua Cheng , Kezhi Wang