English
Related papers

Related papers: Equivariant Splitting: Self-supervised learning fr…

200 papers

Unsupervised contrastive learning has gained increasing attention in the latest research and has proven to be a powerful method for learning representations from unlabeled data. However, little theoretical analysis was known for this…

Machine Learning · Computer Science 2021-06-01 Zixin Wen

Reinforcement learning optimizes policies for expected cumulative reward. Need the supervision be so narrow? Reward is delayed and sparse for many tasks, making it a difficult and impoverished signal for end-to-end optimization. To augment…

Machine Learning · Computer Science 2017-03-10 Evan Shelhamer , Parsa Mahmoudieh , Max Argus , Trevor Darrell

Seismic data often contain gaps due to various obstacles in the investigated area and recording instrument failures. Deep learning techniques offer promising solutions for reconstructing missing data parts by leveraging existing…

Geophysics · Physics 2024-04-04 Mohammad Mahdi Abedi , David Pardo , Tariq Alkhalifah

This paper identifies the flaws in existing open-world learning approaches and attempts to provide a complete picture in the form of \textbf{True Open-World Learning}. We accomplish this by proposing a comprehensive generalize-able…

Computer Vision and Pattern Recognition · Computer Science 2021-04-30 Akshay Raj Dhamija , Touqeer Ahmad , Jonathan Schwan , Mohsen Jafarzadeh , Chunchun Li , Terrance E. Boult

Contrastive self-supervised learning has attracted significant research attention recently. It learns effective visual representations from unlabeled data by embedding augmented views of the same image close to each other while pushing away…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Yichen Zhang , Yifang Yin , Ying Zhang , Roger Zimmermann

In this work, we introduce LEAD, an approach to discover landmarks from an unannotated collection of category-specific images. Existing works in self-supervised landmark detection are based on learning dense (pixel-level) feature…

Computer Vision and Pattern Recognition · Computer Science 2022-04-07 Tejan Karmali , Abhinav Atrishi , Sai Sree Harsha , Susmit Agrawal , Varun Jampani , R. Venkatesh Babu

Self-supervised learning in computer vision aims to leverage the inherent structure and relationships within data to learn meaningful representations without explicit human annotation, enabling a holistic understanding of visual scenes.…

Computer Vision and Pattern Recognition · Computer Science 2023-08-14 Prakash Chandra Chhipa , Johan Rodahl Holmgren , Kanjar De , Rajkumar Saini , Marcus Liwicki

Supervised learning demands large amounts of precisely annotated data to achieve promising results. Such data curation is labor-intensive and imposes significant overhead regarding time and costs. Self-supervised learning (SSL) partially…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Thangarajah Akilan , Nusrat Jahan , Wandong Zhang

The demand for high-resolution, non-invasive imaging continues to drive innovation in magnetic resonance imaging (MRI), but long acquisition times remain a major practical limitation. Although deep learning-based reconstruction methods have…

Image and Video Processing · Electrical Eng. & Systems 2026-05-07 Siying Xu , Kerstin Hammernik , Daniel Rueckert , Sergios Gatidis , Thomas Küstner

In this paper, we explore methods of complicating self-supervised tasks for representation learning. That is, we do severe damage to data and encourage a network to recover them. First, we complicate each of three powerful self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2018-02-07 Dahun Kim , Donghyeon Cho , Donggeun Yoo , In So Kweon

In recent studies on MRI reconstruction, advances have shown significant promise for further accelerating the MRI acquisition. Most state-of-the-art methods require a large amount of fully-sampled data to optimise reconstruction models,…

Image and Video Processing · Electrical Eng. & Systems 2023-12-04 Junwei Yang , Pietro Liò

Recent attempts to use deep learning for super-resolution reconstruction of turbulent flows have used supervised learning, which requires paired data for training. This limitation hinders more practical applications of super-resolution…

Fluid Dynamics · Physics 2021-02-03 Hyojin Kim , Junhyuk Kim , Sungjin Won , Changghoon Lee

Reconstructing MR images using deep neural networks from undersampled k-space data without using fully sampled training references offers significant value in practice, which is a self-supervised regression problem calling for effective…

Image and Video Processing · Electrical Eng. & Systems 2025-01-22 Liyan Sun , Shaocong Yu , Chi Zhang , Xinghao Ding

Unsupervised image-to-image translation tasks aim to find a mapping between a source domain X and a target domain Y from unpaired training data. Contrastive learning for Unpaired image-to-image Translation (CUT) yields state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2021-04-19 Junlin Han , Mehrdad Shoeiby , Lars Petersson , Mohammad Ali Armin

Tomographic image reconstruction is relevant for many medical imaging modalities including X-ray, ultrasound (US) computed tomography (CT) and photoacoustics, for which the access to full angular range tomographic projections might be not…

Image and Video Processing · Electrical Eng. & Systems 2019-06-14 Valery Vishnevskiy , Richard Rau , Orcun Goksel

Hyperspectral image (HSI) classification is gaining a lot of momentum in present time because of high inherent spectral information within the images. However, these images suffer from the problem of curse of dimensionality and usually…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Shivam Pande , Nassim Ait Ali Braham , Yi Wang , Conrad M Albrecht , Biplab Banerjee , Xiao Xiang Zhu

This paper studies the unsupervised embedding learning problem, which requires an effective similarity measurement between samples in low-dimensional embedding space. Motivated by the positive concentrated and negative separated properties…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Mang Ye , Xu Zhang , Pong C. Yuen , Shih-Fu Chang

Semi-supervised learning acts as an effective way to leverage massive unlabeled data. In this paper, we propose a novel training strategy, termed as Semi-supervised Contrastive Learning (SsCL), which combines the well-known contrastive loss…

Computer Vision and Pattern Recognition · Computer Science 2021-05-18 Yuhang Zhang , Xiaopeng Zhang , Robert. C. Qiu , Jie Li , Haohang Xu , Qi Tian

Deep learning (DL) has emerged as a powerful tool for accelerated MRI reconstruction, but often necessitates a database of fully-sampled measurements for training. Recent self-supervised and unsupervised learning approaches enable training…

Image and Video Processing · Electrical Eng. & Systems 2023-11-30 Burhaneddin Yaman , Seyed Amir Hossein Hosseini , Mehmet Akçakaya

Deep learning has demonstrated strong potential for MRI reconstruction. However, conventional supervised learning requires high-quality, high-SNR references for network training, which are often difficult or impossible to obtain in…

Image and Video Processing · Electrical Eng. & Systems 2026-01-01 Haoyang Pei , Nikola Janjuvsevic , Renqing Luo , Ding Xia , Xiang Xu , William Moore , Yao Wang , Hersh Chandarana , Li Feng