English
Related papers

Related papers: Self-supervised Vision Transformers for Joint SAR-…

200 papers

Computer vision in agriculture is game-changing with its ability to transform farming into a data-driven, precise, and sustainable industry. Deep learning has empowered agriculture vision to analyze vast, complex visual data, but heavily…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Sudhir Sornapudi , Rajhans Singh

Recent progress in self-supervised (SSL) visual representation learning has led to the development of several different proposed frameworks that rely on augmentations of images but use different loss functions. However, there are few…

Machine Learning · Computer Science 2025-01-20 Kumar Krishna Agrawal , Arna Ghosh , Shagun Sodhani , Adam Oberman , Blake Richards

Discovering what is learned by neural networks remains a challenge. In self-supervised learning, classification is the most common task used to evaluate how good a representation is. However, relying only on such downstream task can limit…

Machine Learning · Computer Science 2022-08-17 Florian Bordes , Randall Balestriero , Pascal Vincent

We present a self-supervised learning (SSL) method suitable for semi-global tasks such as object detection and semantic segmentation. We enforce local consistency between self-learned features, representing corresponding image locations of…

Computer Vision and Pattern Recognition · Computer Science 2022-12-09 Ashraful Islam , Ben Lundell , Harpreet Sawhney , Sudipta Sinha , Peter Morales , Richard J. Radke

In the field of Earth Observation (EO), Continual Learning (CL) algorithms have been proposed to deal with large datasets by decomposing them into several subsets and processing them incrementally. The majority of these algorithms assume…

Computer Vision and Pattern Recognition · Computer Science 2023-01-10 Valerio Marsocci , Simone Scardapane

With the current ubiquity of deep learning methods to solve computer vision and remote sensing specific tasks, the need for labelled data is growing constantly. However, in many cases, the annotation process can be long and tedious…

Computer Vision and Pattern Recognition · Computer Science 2023-06-19 Paul Berg , Minh-Tan Pham , Nicolas Courty

The few-shot learning ability of vision transformers (ViTs) is rarely investigated though heavily desired. In this work, we empirically find that with the same few-shot learning frameworks, \eg~Meta-Baseline, replacing the widely used CNN…

Computer Vision and Pattern Recognition · Computer Science 2022-06-10 Bowen Dong , Pan Zhou , Shuicheng Yan , Wangmeng Zuo

3D object representation learning is a fundamental challenge in computer vision to infer about the 3D world. Recent advances in deep learning have shown their efficiency in 3D object recognition, among which view-based methods have…

Computer Vision and Pattern Recognition · Computer Science 2021-03-02 Xiang Gao , Wei Hu , Guo-Jun Qi

Most recent self-supervised learning methods learn visual representation by contrasting different augmented views of images. Compared with supervised learning, more aggressive augmentations have been introduced to further improve the…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Yingbin Bai , Erkun Yang , Zhaoqing Wang , Yuxuan Du , Bo Han , Cheng Deng , Dadong Wang , Tongliang Liu

Machine learning for differential equations paves the way for computationally efficient alternatives to numerical solvers, with potentially broad impacts in science and engineering. Though current algorithms typically require simulated…

Machine Learning · Computer Science 2024-02-15 Grégoire Mialon , Quentin Garrido , Hannah Lawrence , Danyal Rehman , Yann LeCun , Bobak T. Kiani

Recent advances in self-supervised learning (SSL) have revolutionized computer vision through innovative architectures and learning objectives, yet they have not fully leveraged insights from biological visual processing systems. Recently,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-19 Makoto Yamada , Kian Ming A. Chai , Ayoub Rhim , Satoki Ishikawa , Mohammad Sabokrou , Yao-Hung Hubert Tsai

In self-supervised learning (SSL), representations are learned via an auxiliary task without annotated labels. A common task is to classify augmentations or different modalities of the data, which share semantic content (e.g. an object in…

Machine Learning · Computer Science 2024-10-16 Alice Bizeul , Bernhard Schölkopf , Carl Allen

Self-supervised learning (SSL) is an emerging technique that has been successfully employed to train convolutional neural networks (CNNs) and graph neural networks (GNNs) for more transferable, generalizable, and robust representation…

Computer Vision and Pattern Recognition · Computer Science 2022-09-13 Prarthana Bhattacharyya , Chengjie Huang , Krzysztof Czarnecki

A large-scale labeled dataset is a key factor for the success of supervised deep learning in computer vision. However, a limited number of annotated data is very common, especially in ophthalmic image analysis, since manual annotation is…

Image and Video Processing · Electrical Eng. & Systems 2022-03-15 Zhiyuan Cai , Li Lin , Huaqing He , Xiaoying Tang

Synthetic Aperture Radar (SAR) imagery has diverse applications in land and marine surveillance. Unlike electro-optical (EO) systems, these systems are not affected by weather conditions and can be used in the day and night times. With the…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Abu Md Niamul Taufique , Navya Nagananda , Andreas Savakis

Vision-language models (VLMs) have shown remarkable abilities by integrating large language models with visual inputs. However, they often fail to utilize visual evidence adequately, either depending on linguistic priors in vision-centric…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Xiaojun Guo , Runyu Zhou , Yifei Wang , Qi Zhang , Chenheng Zhang , Stefanie Jegelka , Xiaohan Wang , Jiajun Chai , Guojun Yin , Wei Lin , Yisen Wang

We attempt to reduce the computational costs in vision transformers (ViTs), which increase quadratically in the token number. We present a novel training paradigm that trains only one ViT model at a time, but is capable of providing…

Computer Vision and Pattern Recognition · Computer Science 2023-07-20 Mingbao Lin , Mengzhao Chen , Yuxin Zhang , Chunhua Shen , Rongrong Ji , Liujuan Cao

Vision Transformers (ViTs) have attracted a lot of popularity in recent years, due to their exceptional capabilities in modeling long-range spatial dependencies and scalability for large scale training. Although the training parallelism of…

Computer Vision and Pattern Recognition · Computer Science 2024-01-29 Ali Hatamizadeh , Michael Ranzinger , Shiyi Lan , Jose M. Alvarez , Sanja Fidler , Jan Kautz

The rapid advancement in self-supervised representation learning has highlighted its potential to leverage unlabeled data for learning rich visual representations. However, the existing techniques, particularly those employing different…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Sana Ayromlou , Vahid Reza Khazaie , Fereshteh Forghani , Arash Afkanpour

Deep supervised learning algorithms typically require a large volume of labeled data to achieve satisfactory performance. However, the process of collecting and labeling such data can be expensive and time-consuming. Self-supervised…

Machine Learning · Computer Science 2024-07-16 Jie Gui , Tuo Chen , Jing Zhang , Qiong Cao , Zhenan Sun , Hao Luo , Dacheng Tao