English
Related papers

Related papers: Continual Barlow Twins: continual self-supervised …

200 papers

Remote sensing data has been widely used for various Earth Observation (EO) missions such as land use and cover classification, weather forecasting, agricultural management, and environmental monitoring. Most existing remote sensing…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Xin Zhang , Liangxiu Han

Continual learning (CL) is a new online learning technique over sequentially generated streaming data from different tasks, aiming to maintain a small forgetting loss on previously-learned tasks. Existing work focuses on reducing the…

Machine Learning · Computer Science 2024-12-25 Shugang Hao , Lingjie Duan

Earth Observation (EO) systems are crucial for cartography, disaster surveillance, and resource administration. Nonetheless, they encounter considerable obstacles in the processing and transmission of extensive data, especially in…

We present a self-supervised learning (SSL) method suitable for semi-global tasks such as object detection and semantic segmentation. We enforce local consistency between self-learned features, representing corresponding image locations of…

Computer Vision and Pattern Recognition · Computer Science 2022-12-09 Ashraful Islam , Ben Lundell , Harpreet Sawhney , Sudipta Sinha , Peter Morales , Richard J. Radke

Compressed sensing (CS) is a promising tool for reducing sampling costs. Current deep neural network (NN)-based CS methods face the challenges of collecting labeled measurement-ground truth (GT) data and generalizing to real applications.…

Signal Processing · Electrical Eng. & Systems 2024-08-15 Bin Chen , Xuanyu Zhang , Shuai Liu , Yongbing Zhang , Jian Zhang

Nowadays, modern Earth Observation systems continuously generate huge amounts of data. A notable example is represented by the Sentinel-2 mission, which provides images at high spatial resolution (up to 10m) with high temporal revisit…

Computer Vision and Pattern Recognition · Computer Science 2018-09-21 Roberto Interdonato , Dino Ienco , Raffaele Gaetano , Kenji Ose

This study explores the application of self-supervised learning (SSL) for improved target recognition in synthetic aperture sonar (SAS) imagery. The unique challenges of underwater environments make traditional computer vision techniques,…

Computer Vision and Pattern Recognition · Computer Science 2023-07-31 BW Sheffield

Self-supervised learning (SSL) has attracted much interest in remote sensing and earth observation due to its ability to learn task-agnostic representations without human annotation. While most of the existing SSL works in remote sensing…

Computer Vision and Pattern Recognition · Computer Science 2022-06-15 Yi Wang , Conrad M Albrecht , Xiao Xiang Zhu

The Barlow Twins self-supervised learning objective requires neither negative samples or asymmetric learning updates, achieving results on a par with the current state-of-the-art within Computer Vision. As such, we present Audio Barlow…

Sound · Computer Science 2022-12-26 Jonah Anton , Harry Coppock , Pancham Shukla , Bjorn W. Schuller

Self-supervised learning (SSL) applied to natural images has demonstrated a remarkable ability to learn meaningful, low-dimension representations without labels, resulting in models that are adaptable to many different tasks. Until now,…

Earth observation (EO) plays a crucial role in creating and sustaining a resilient and prosperous society that has far reaching consequences for all life and the planet itself. Remote sensing platforms like satellites, airborne platforms,…

Image and Video Processing · Electrical Eng. & Systems 2024-12-09 Protim Bhattacharjee , PEter Jung

According to Complementary Learning Systems (CLS) theory~\citep{mcclelland1995there} in neuroscience, humans do effective \emph{continual learning} through two complementary systems: a fast learning system centered on the hippocampus for…

Machine Learning · Computer Science 2021-10-04 Quang Pham , Chenghao Liu , Steven Hoi

It is well known that the success of deep neural networks is greatly attributed to large-scale labeled datasets. However, it can be extremely time-consuming and laborious to collect sufficient high-quality labeled data in most practical…

Computer Vision and Pattern Recognition · Computer Science 2022-02-18 Yao Yao , Junyi Shen , Jin Xu , Bin Zhong , Li Xiao

Supervised learning demands large amounts of precisely annotated data to achieve promising results. Such data curation is labor-intensive and imposes significant overhead regarding time and costs. Self-supervised learning (SSL) partially…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Thangarajah Akilan , Nusrat Jahan , Wandong Zhang

Long-tailed semi-supervised learning poses a significant challenge in training models with limited labeled data exhibiting a long-tailed label distribution. Current state-of-the-art LTSSL approaches heavily rely on high-quality…

Machine Learning · Computer Science 2024-10-10 Zi-Hao Zhou , Siyuan Fang , Zi-Jing Zhou , Tong Wei , Yuanyu Wan , Min-Ling Zhang

Inspired by the success of Self-supervised learning (SSL) in learning visual representations from unlabeled data, a few recent works have studied SSL in the context of continual learning (CL), where multiple tasks are learned sequentially,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-15 Li Yang , Sen Lin , Fan Zhang , Junshan Zhang , Deliang Fan

Deep supervised learning algorithms typically require a large volume of labeled data to achieve satisfactory performance. However, the process of collecting and labeling such data can be expensive and time-consuming. Self-supervised…

Machine Learning · Computer Science 2024-07-16 Jie Gui , Tuo Chen , Jing Zhang , Qiong Cao , Zhenan Sun , Hao Luo , Dacheng Tao

Following the success of supervised learning, semi-supervised learning (SSL) is now becoming increasingly popular. SSL is a family of methods, which in addition to a labeled training set, also use a sizable collection of unlabeled data for…

Machine Learning · Computer Science 2022-05-12 Erik Wallin , Lennart Svensson , Fredrik Kahl , Lars Hammarstrand

Semi-Supervised Learning (SSL) is a framework that utilizes both labeled and unlabeled data to enhance model performance. Conventional SSL methods operate under the assumption that labeled and unlabeled data share the same label space.…

Computer Vision and Pattern Recognition · Computer Science 2023-11-16 Noam Fluss , Guy Hacohen , Daphna Weinshall

In recent years, much work has been done on processing of wireless spectrum data involving machine learning techniques in domain-related problems for cognitive radio networks, such as anomaly detection, modulation classification, technology…

Networking and Internet Architecture · Computer Science 2024-08-23 Ljupcho Milosheski , Gregor Cerar , Blaž Bertalanič , Carolina Fortuna , Mihael Mohorčič