English
Related papers

Related papers: JEPAMatch: Geometric Representation Shaping for Se…

200 papers

Joint Embedding Predictive Architectures (JEPAs) learn representations able to solve numerous downstream tasks out-of-the-box. JEPAs combine two objectives: (i) a latent-space prediction term, i.e., the representation of a slightly…

Machine Learning · Computer Science 2025-10-08 Randall Balestriero , Nicolas Ballas , Mike Rabbat , Yann LeCun

Semi-supervised learning (SSL) is a practical challenge in computer vision. Pseudo-label (PL) methods, e.g., FixMatch and FreeMatch, obtain the State Of The Art (SOTA) performances in SSL. These approaches employ a threshold-to-pseudo-label…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Jiaqi Wu , Junbiao Pang , Baochang Zhang , Qingming Huang

Language representation learning has emerged as a promising approach for sequential recommendation, thanks to its ability to learn generalizable representations. However, despite its advantages, this approach still struggles with data…

Information Retrieval · Computer Science 2025-08-08 Minh-Anh Nguyen , Dung D. Le

Semi-supervised Learning (SSL) has witnessed great success owing to the impressive performances brought by various methods based on pseudo labeling and consistency regularization. However, we argue that existing methods might fail to…

Fine-grained image classification has witnessed significant advancements with the advent of deep learning and computer vision technologies. However, the scarcity of detailed annotations remains a major challenge, especially in scenarios…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Bowen Tian , Songning Lai , Lujundong Li , Zhihao Shuai , Runwei Guan , Tian Wu , Yutao Yue

One paradigm for learning from few labeled examples while making best use of a large amount of unlabeled data is unsupervised pretraining followed by supervised fine-tuning. Although this paradigm uses unlabeled data in a task-agnostic way,…

Machine Learning · Computer Science 2020-10-27 Ting Chen , Simon Kornblith , Kevin Swersky , Mohammad Norouzi , Geoffrey Hinton

Semi-supervised learning leverages unlabeled data to enhance model performance, addressing the limitations of fully supervised approaches. Among its strategies, pseudo-supervision has proven highly effective, typically relying on one or…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Negin Ghamsarian , Sahar Nasirihaghighi , Klaus Schoeffmann , Raphael Sznitman

In typical medical image classification problems, labeled data is scarce while unlabeled data is more available. Semi-supervised learning and self-supervised learning are two different research directions that can improve accuracy by…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Zhe Huang , Ruijie Jiang , Shuchin Aeron , Michael C. Hughes

For many practical problems and applications, it is not feasible to create a vast and accurately labeled dataset, which restricts the application of deep learning in many areas. Semi-supervised learning algorithms intend to improve…

Computer Vision and Pattern Recognition · Computer Science 2021-01-12 Mert Kayhan , Okan Köpüklü , Mhd Hasan Sarhan , Mehmet Yigitsoy , Abouzar Eslami , Gerhard Rigoll

The critical challenge of Semi-Supervised Learning (SSL) is how to effectively leverage the limited labeled data and massive unlabeled data to improve the model's generalization performance. In this paper, we first revisit the popular…

Machine Learning · Computer Science 2023-03-16 Hao Chen , Ran Tao , Yue Fan , Yidong Wang , Jindong Wang , Bernt Schiele , Xing Xie , Bhiksha Raj , Marios Savvides

Self-supervision is often used for pre-training to foster performance on a downstream task by constructing meaningful representations of samples. Self-supervised learning (SSL) generally involves generating different views of the same…

Machine Learning · Computer Science 2025-05-06 Hugo Thimonier , José Lucas De Melo Costa , Fabrice Popineau , Arpad Rimmel , Bich-Liên Doan

Two competing paradigms exist for self-supervised learning of data representations. Joint Embedding Predictive Architecture (JEPA) is a class of architectures in which semantically similar inputs are encoded into representations that are…

Machine Learning · Computer Science 2024-07-08 Etai Littwin , Omid Saremi , Madhu Advani , Vimal Thilak , Preetum Nakkiran , Chen Huang , Joshua Susskind

Although data is abundant, data labeling is expensive. Semi-supervised learning methods combine a few labeled samples with a large corpus of unlabeled data to effectively train models. This paper introduces our proposed method LiDAM, a…

Machine Learning · Computer Science 2020-11-25 Qun Liu , Matthew Shreve , Raja Bala

A significant issue in training deep neural networks to solve supervised learning tasks is the need for large numbers of labelled datapoints. The goal of semi-supervised learning is to leverage ubiquitous unlabelled data, together with…

Computer Vision and Pattern Recognition · Computer Science 2019-05-29 Chengxu Zhuang , Xuehao Ding , Divyanshu Murli , Daniel Yamins

Aerodynamic surrogate models are increasingly used to replace repeated high-fidelity CFD evaluations in many-query design settings, but current approaches still face two important limitations: they often scale poorly to the very large…

In recent advancements in unsupervised visual representation learning, the Joint-Embedding Predictive Architecture (JEPA) has emerged as a significant method for extracting visual features from unlabeled imagery through an innovative…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Shentong Mo , Shengbang Tong

Deep learning has had remarkable success at analyzing handheld imagery such as consumer photos due to the availability of large-scale human annotations (e.g., ImageNet). However, remote sensing data lacks such extensive annotation and thus…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Chun-Hsiao Yeh , Xudong Wang , Stella X. Yu , Charles Hill , Zackery Steck , Scott Kangas , Aaron Reite

The Joint-Embedding Predictive Architecture (JEPA) is often seen as a non-generative alternative to likelihood-based self-supervised learning, emphasizing prediction in representation space rather than reconstruction in observation space.…

Machine Learning · Computer Science 2026-03-23 Moritz Gögl , Christopher Yau

Semi-supervised pose estimation is a practically challenging task for computer vision. Although numerous excellent semi-supervised classification methods have emerged, these methods typically use confidence to evaluate the quality of…

Computer Vision and Pattern Recognition · Computer Science 2023-11-06 Jiaqi Wu , Junbiao Pang , Qingming Huang

Many common methods for learning a world model for pixel-based environments use generative architectures trained with pixel-level reconstruction objectives. Recently proposed Joint Embedding Predictive Architectures (JEPA) offer a…

Machine Learning · Computer Science 2022-11-22 Vlad Sobal , Jyothir S , Siddhartha Jalagam , Nicolas Carion , Kyunghyun Cho , Yann LeCun