English
Related papers

Related papers: SEL-CIE: Knowledge-Guided Self-Supervised Learning…

200 papers

This paper shows that when applying machine learning to digital zoom for photography, it is beneficial to use real, RAW sensor data for training. Existing learning-based super-resolution methods do not use real sensor data, instead…

Computer Vision and Pattern Recognition · Computer Science 2019-05-14 Xuaner Cecilia Zhang , Qifeng Chen , Ren Ng , Vladlen Koltun

This paper introduces MixDiff, a new self-supervised learning (SSL) pre-training framework that combines real and synthetic images. Unlike traditional SSL methods that predominantly use real images, MixDiff uses a variant of Stable…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Reza Akbarian Bafghi , Nidhin Harilal , Claire Monteleoni , Maziar Raissi

Self-supervised learning (SSL) has delivered superior performance on a variety of downstream vision tasks. Two main-stream SSL frameworks have been proposed, i.e., Instance Discrimination (ID) and Masked Image Modeling (MIM). ID pulls…

Computer Vision and Pattern Recognition · Computer Science 2022-11-17 Chenxin Tao , Xizhou Zhu , Weijie Su , Gao Huang , Bin Li , Jie Zhou , Yu Qiao , Xiaogang Wang , Jifeng Dai

This paper introduces a novel approach to improving the training stability of self-supervised learning (SSL) methods by leveraging a non-parametric memory of seen concepts. The proposed method involves augmenting a neural network with a…

Computer Vision and Pattern Recognition · Computer Science 2024-07-26 Thalles Silva , Helio Pedrini , Adín Ramírez Rivera

This study explores the application of self-supervised learning (SSL) for improved target recognition in synthetic aperture sonar (SAS) imagery. The unique challenges of underwater environments make traditional computer vision techniques,…

Computer Vision and Pattern Recognition · Computer Science 2023-07-31 BW Sheffield

Self-supervised learning (SSL) methods aim to exploit the abundance of unlabelled data for machine learning (ML), however the underlying principles are often method-specific. An SSL framework derived from biological first principles of…

Machine Learning · Computer Science 2023-08-03 Franz Scherr , Qinghai Guo , Timoleon Moraitis

Displaying the large number of bands in a hyper- spectral image (HSI) on a trichromatic monitor is important for HSI processing and analysis system. The visualized image shall convey as much information as possible from the original HSI and…

Computer Vision and Pattern Recognition · Computer Science 2017-12-06 Danping Liao , Yuntao Qian , Yuan Yan Tang

Self-supervised learning (SSL) has had great success in both computer vision. Most of the current mainstream computer vision SSL frameworks are based on Siamese network architecture. These approaches often rely on cleverly crafted loss…

Machine Learning · Computer Science 2024-01-30 Daesoo Lee , Erlend Aune

Supervised learning with a convolutional neural network is recognized as a powerful means of image restoration. However, most such methods have been designed for application to grayscale and/or color images; therefore, they have limited…

Image and Video Processing · Electrical Eng. & Systems 2019-07-02 Ryuji Imamura , Tatsuki Itasaka , Masahiro Okuda

Hyperspectral imaging offers new perspectives for diverse applications, ranging from the monitoring of the environment using airborne or satellite remote sensing, precision farming, food safety, planetary exploration, or astrophysics.…

Image and Video Processing · Electrical Eng. & Systems 2021-11-19 Théo Bodrito , Alexandre Zouaoui , Jocelyn Chanussot , Julien Mairal

While raw images have distinct advantages over sRGB images, e.g., linearity and fine-grained quantization levels, they are not widely adopted by general users due to their substantial storage requirements. Very recent studies propose to…

Computer Vision and Pattern Recognition · Computer Science 2023-06-22 Yufei Wang , Yi Yu , Wenhan Yang , Lanqing Guo , Lap-Pui Chau , Alex C. Kot , Bihan Wen

Recently, deep learning has experienced rapid expansion, contributing significantly to the progress of supervised learning methodologies. However, acquiring labeled data in real-world settings can be costly, labor-intensive, and sometimes…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Jicheng Yuan , Anh Le-Tuan , Ali Ganbarov , Manfred Hauswirth , Danh Le-Phuoc

Self-supervised learning (SSL) aims to eliminate one of the major bottlenecks in representation learning - the need for human annotations. As a result, SSL holds the promise to learn representations from data in-the-wild, i.e., without the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Senthil Purushwalkam , Pedro Morgado , Abhinav Gupta

A non-parametric low-resolution face recognition model for resource-constrained environments with limited networking and computing is proposed in this work. Such environments often demand a small model capable of being effectively trained…

Computer Vision and Pattern Recognition · Computer Science 2020-11-25 Mozhdeh Rouhsedaghat , Yifan Wang , Shuowen Hu , Suya You , C. -C. Jay Kuo

Self-supervised learning (SSL) methods based on Siamese networks learn visual representations by aligning different views of the same image. The multi-crop strategy, which incorporates small local crops to global ones, enhances many SSL…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Pierre-François De Plaen , Abhishek Jha , Luc Van Gool , Tinne Tuytelaars , Marc Proesmans

Self-supervised learning (SSL) has gained widespread attention in the remote sensing (RS) and earth observation (EO) communities owing to its ability to learn task-agnostic representations without human-annotated labels. Nevertheless, most…

Computer Vision and Pattern Recognition · Computer Science 2023-08-07 Dilxat Muhtar , Xueliang Zhang , Pengfeng Xiao , Zhenshi Li , Feng Gu

Deep learning has demonstrated its power in image rectification by leveraging the representation capacity of deep neural networks via supervised training based on a large-scale synthetic dataset. However, the model may overfit the synthetic…

Computer Vision and Pattern Recognition · Computer Science 2021-06-21 Jinlong Fan , Jing Zhang , Dacheng Tao

Fundamental differences between natural and medical images have recently favored the use of self-supervised learning (SSL) over ImageNet transfer learning for medical image applications. Differences between image types are primarily due to…

Quantitative Methods · Quantitative Biology 2022-07-13 Lambert T. Leong , Michael C. Wong , Yannik Glaser , Thomas Wolfgruber , Steven B. Heymsfield , Peter Sadowski , John A. Shepherd

Most existing super-resolution methods do not perform well in real scenarios due to lack of realistic training data and information loss of the model input. To solve the first problem, we propose a new pipeline to generate realistic…

Image and Video Processing · Electrical Eng. & Systems 2019-05-30 Xiangyu Xu , Yongrui Ma , Wenxiu Sun

Self-supervised learning (SSL) has recently shown remarkable results in closing the gap between supervised and unsupervised learning. The idea is to learn robust features that are invariant to distortions of the input data. Despite its…

Sound · Computer Science 2023-03-08 Bac Nguyen , Stefan Uhlich , Fabien Cardinaux