English
Related papers

Related papers: Self-Supervised Learning via Flow-Guided Neural Op…

200 papers

In recent years, self-supervised learning (SSL) frameworks have been extensively applied to sensor-based Human Activity Recognition (HAR) in order to learn deep representations without data annotations. While SSL frameworks reach…

Machine Learning · Computer Science 2023-08-01 Bulat Khaertdinov , Stylianos Asteriadis

Semi-supervised learning (SSL) has proven to be effective at leveraging large-scale unlabeled data to mitigate the dependency on labeled data in order to learn better models for visual recognition and classification tasks. However, recent…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Hasib Zunair , Yan Gobeil , Samuel Mercier , A. Ben Hamza

Fourier neural operators (FNOs) provide a mesh-independent way to learn solution operators for partial differential equations, yet their efficacy for magnetized turbulence is largely unexplored. Here we train an FNO surrogate for the 2-D…

High Energy Astrophysical Phenomena · Physics 2025-07-03 Roberta Duarte , Rodrigo Nemmen , Reinaldo Santos-Lima

Self-supervised learning (SSL) has empirically shown its data representation learnability in many downstream tasks. There are only a few theoretical works on data representation learnability, and many of those focus on final data…

Machine Learning · Computer Science 2024-01-09 Ruofeng Yang , Xiangyuan Li , Bo Jiang , Shuai Li

Deep models trained in supervised mode have achieved remarkable success on a variety of tasks. When labeled samples are limited, self-supervised learning (SSL) is emerging as a new paradigm for making use of large amounts of unlabeled…

Machine Learning · Computer Science 2022-04-26 Yaochen Xie , Zhao Xu , Jingtun Zhang , Zhengyang Wang , Shuiwang Ji

Solving Singularly Perturbed Differential Equations (SPDEs) poses computational challenges arising from the rapid transitions in their solutions within thin regions. The effectiveness of deep learning in addressing differential equations…

Machine Learning · Computer Science 2024-09-10 Ye Li , Ting Du , Yiwen Pang , Zhongyi Huang

Self-supervised learning (SSL) aims to eliminate one of the major bottlenecks in representation learning - the need for human annotations. As a result, SSL holds the promise to learn representations from data in-the-wild, i.e., without the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Senthil Purushwalkam , Pedro Morgado , Abhinav Gupta

Self-Supervised Learning (SSL) has been shown to learn useful and information-preserving representations. Neural Networks (NNs) are widely applied, yet their weight space is still not fully understood. Therefore, we propose to use SSL to…

Machine Learning · Computer Science 2022-12-15 Konstantin Schürholt , Dimche Kostadinov , Damian Borth

Self-supervised learning (SSL) has emerged as a powerful paradigm for learning representations without labeled data. Most SSL approaches rely on strong, well-established, handcrafted data augmentations to generate diverse views for…

Machine Learning · Computer Science 2026-01-16 Berken Utku Demirel , Christian Holz

Self supervised learning (SSL) is a machine learning paradigm where models learn to understand the underlying structure of data without explicit supervision from labeled samples. The acquired representations from SSL have demonstrated…

Machine Learning · Computer Science 2025-12-11 Yunshan Duan , Sinead Williamson

Objective. Supervised learning paradigms are often limited by the amount of labeled data that is available. This phenomenon is particularly problematic in clinically-relevant data, such as electroencephalography (EEG), where labeling can be…

Machine Learning · Statistics 2020-08-03 Hubert Banville , Omar Chehab , Aapo Hyvärinen , Denis-Alexander Engemann , Alexandre Gramfort

Learning visuomotor policies via behavior cloning typically involves mimicking expert demonstrations collected by human operators. However, natural human demonstrations inherently contain high-frequency noise, such as intermittent jerks,…

Robotics · Computer Science 2026-05-28 Junlin Wang

Self-Supervised Learning (SSL) has become a powerful solution to extract rich representations from unlabeled data. Yet, SSL research is mostly focused on clean, curated and high-quality datasets. As a result, applying SSL on noisy data…

Computer Vision and Pattern Recognition · Computer Science 2025-10-31 Wenquan Lu , Jiaqi Zhang , Hugues Van Assel , Randall Balestriero

Standard modern machine-learning-based imaging methods have faced challenges in medical applications due to the high cost of dataset construction and, thereby, the limited labeled training data available. Additionally, upon deployment,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Amin Karimi Monsefi , Payam Karisani , Mengxi Zhou , Stacey Choi , Nathan Doble , Heng Ji , Srinivasan Parthasarathy , Rajiv Ramnath

Self-supervised learning (SSL) algorithms have emerged as powerful tools that can leverage large quantities of unlabeled audio data to pre-train robust representations that support strong performance on diverse downstream tasks. Up to now…

Audio and Speech Processing · Electrical Eng. & Systems 2025-02-05 Mattson Ogg

We apply Fourier neural operators (FNOs), a state-of-the-art operator learning technique, to forecast the temporal evolution of experimentally measured velocity fields. FNOs are a recently developed machine learning method capable of…

Fluid Dynamics · Physics 2023-01-23 Peter I Renn , Cong Wang , Sahin Lale , Zongyi Li , Anima Anandkumar , Morteza Gharib

Neural operators have emerged as powerful surrogates for dynamical systems due to their grid-invariant properties and computational efficiency. However, the Fourier-based neural operator framework inherently truncates high-frequency…

Machine Learning · Computer Science 2026-04-09 Tianyue Yang , Xiao Xue

Emotion recognition models using audio input data can enable the development of interactive systems with applications in mental healthcare, marketing, gaming, and social media analysis. While the field of affective computing using audio…

Sound · Computer Science 2023-07-25 Peranut Nimitsurachat , Peter Washington

Machine learning has great potential for efficient reconstruction and prediction of flow fields. However, existing datasets may have highly diversified labels for different flow scenarios, which are not applicable for training a model. To…

Fluid Dynamics · Physics 2023-11-28 Bonan Xu , Yuanye Zhou , Xin Bian

Strong semantic representations improve the convergence and generation quality of diffusion and flow models. Existing approaches largely rely on external models, which require separate training, operate on misaligned objectives, and exhibit…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Hila Chefer , Patrick Esser , Dominik Lorenz , Dustin Podell , Vikash Raja , Vinh Tong , Antonio Torralba , Robin Rombach