English
Related papers

Related papers: Self-Guided Masked Autoencoders for Domain-Agnosti…

200 papers

Current video-based Masked Autoencoders (MAEs) primarily focus on learning effective spatiotemporal representations from a visual perspective, which may lead the model to prioritize general spatial-temporal patterns but often overlook…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Shihab Aaqil Ahamed , Malitha Gunawardhana , Liel David , Michael Sidorov , Daniel Harari , Muhammad Haris Khan

We are interested in learning scalable agents for reinforcement learning that can learn from large-scale, diverse sequential data similar to current large vision and language models. To this end, this paper presents masked decision…

Machine Learning · Computer Science 2023-05-30 Fangchen Liu , Hao Liu , Aditya Grover , Pieter Abbeel

We develop an algorithm for adapting a semantic segmentation model that is trained using a labeled source domain to generalize well in an unlabeled target domain. A similar problem has been studied extensively in the unsupervised domain…

Machine Learning · Computer Science 2021-01-12 Serban Stan , Mohammad Rostami

Semi-supervised learning is a challenging problem which aims to construct a model by learning from a limited number of labeled examples. Numerous methods have been proposed to tackle this problem, with most focusing on utilizing the…

Computer Vision and Pattern Recognition · Computer Science 2021-07-02 Peng Tu , Yawen Huang , Rongrong Ji , Feng Zheng , Ling Shao

Deep neural networks have achieved promising performance in supervised point cloud applications, but manual annotation is extremely expensive and time-consuming in supervised learning schemes. Unsupervised domain adaptation (UDA) addresses…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 Xiaoyuan Luo , Shaolei Liu , Kexue Fu , Manning Wang , Zhijian Song

Recently, semi-supervised semantic segmentation has achieved promising performance with a small fraction of labeled data. However, most existing studies treat all unlabeled data equally and barely consider the differences and training…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Zhen Zhao , Sifan Long , Jimin Pi , Jingdong Wang , Luping Zhou

Masked image modeling (MIM) has become a leading self-supervised learning strategy. MIMs such as Masked Autoencoder (MAE) learn strong representations by randomly masking input tokens for the encoder to process, with the decoder…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Taekyung Kim , Sanghyuk Chun , Byeongho Heo , Dongyoon Han

In the era of transformer models, masked self-supervised learning (SSL) has become a foundational training paradigm. A defining feature of masked SSL is that training aggregates predictions across many masking patterns, giving rise to a…

Machine Learning · Statistics 2026-02-02 Arie Wortsman Zurich , Federica Gerace , Bruno Loureiro , Yue M. Lu

Autoencoder-based learning has emerged as a staple for disciplining representations in unsupervised and semi-supervised settings. This paper analyzes a framework for improving generalization in a purely supervised setting, where the target…

Machine Learning · Statistics 2020-01-24 Daniel Jarrett , Mihaela van der Schaar

Deep learning-based analysis of high-frequency, high-resolution micro-ultrasound data shows great promise for prostate cancer detection. Previous approaches to analysis of ultrasound data largely follow a supervised learning paradigm.…

Image and Video Processing · Electrical Eng. & Systems 2022-11-02 Paul F. R. Wilson , Mahdi Gilany , Amoon Jamzad , Fahimeh Fooladgar , Minh Nguyen Nhat To , Brian Wodlinger , Purang Abolmaesumi , Parvin Mousavi

Reliably modeling normality and differentiating abnormal appearances from normal cases is a very appealing approach for detecting pathologies in medical images. A plethora of such unsupervised anomaly detection approaches has been made in…

Computer Vision and Pattern Recognition · Computer Science 2019-04-19 Christoph Baur , Benedikt Wiestler , Shadi Albarqouni , Nassir Navab

While fully-supervised deep learning yields good models for urban scene semantic segmentation, these models struggle to generalize to new environments with different lighting or weather conditions for instance. In addition, producing the…

Computer Vision and Pattern Recognition · Computer Science 2020-06-17 Antoine Saporta , Tuan-Hung Vu , Matthieu Cord , Patrick Pérez

Training deep networks for semantic segmentation requires large amounts of labeled training data, which presents a major challenge in practice, as labeling segmentation masks is a highly labor-intensive process. To address this issue, we…

Computer Vision and Pattern Recognition · Computer Science 2021-08-31 Lukas Hoyer , Dengxin Dai , Qin Wang , Yuhua Chen , Luc Van Gool

Autoencoding is a popular method in representation learning. Conventional autoencoders employ symmetric encoding-decoding procedures and a simple Euclidean latent space to detect hidden low-dimensional structures in an unsupervised way.…

Machine Learning · Computer Science 2024-10-07 Stefan C. Schonsheck , Scott Mahan , Timo Klock , Alexander Cloninger , Rongjie Lai

This paper presents the first study on Unsupervised Domain Adaptation (UDA) for multimodal 3D panoptic segmentation (mm-3DPS), aiming to improve generalization under domain shifts commonly encountered in real-world autonomous driving. A…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Yining Pan , Shijie Li , Yuchen Wu , Xulei Yang , Na Zhao

Recent advances in deep learning methods have come to define the state-of-the-art for many medical imaging applications, surpassing even human judgment in several tasks. Those models, however, when trained to reduce the empirical risk on a…

Computer Vision and Pattern Recognition · Computer Science 2019-01-14 Christian S. Perone , Pedro Ballester , Rodrigo C. Barros , Julien Cohen-Adad

Self-supervised learning aims to learn representations from the data itself without explicit manual supervision. Existing efforts ignore a crucial aspect of self-supervised learning - the ability to scale to large amount of data because…

Computer Vision and Pattern Recognition · Computer Science 2019-06-07 Priya Goyal , Dhruv Mahajan , Abhinav Gupta , Ishan Misra

Drawings are powerful means of pictorial abstraction and communication. Understanding diverse forms of drawings, including digital arts, cartoons, and comics, has been a major problem of interest for the computer vision and computer…

Computer Vision and Pattern Recognition · Computer Science 2023-04-26 Barış Batuhan Topal , Deniz Yuret , Tevfik Metin Sezgin

Unsupervised domain adaptation (UDA) focuses on transferring knowledge learned in the labeled source domain to the unlabeled target domain. Despite significant progress that has been achieved in single-target domain adaptation for image…

Computer Vision and Pattern Recognition · Computer Science 2023-09-14 Xiaohu Lu , Hayder Radha

Bioacoustic recognition requires fine-grained acoustic understanding to distinguish similar-sounding species. However, many large-scale data repositories such as iNaturalist are weakly annotated, often with only a single positive species…

Sound · Computer Science 2026-05-15 Wuao Liu , Mustafa Chasmai , Subhransu Maji , Grant Van Horn