English
Related papers

Related papers: Self-supervised Audiovisual Representation Learnin…

200 papers

This paper presents to the best of our knowledge the first end-to-end object tracking approach which directly maps from raw sensor input to object tracks in sensor space without requiring any feature engineering or system identification in…

Machine Learning · Computer Science 2016-03-10 Peter Ondruska , Ingmar Posner

Practical natural language processing (NLP) tasks are commonly long-tailed with noisy labels. Those problems challenge the generalization and robustness of complex models such as Deep Neural Networks (DNNs). Some commonly used resampling…

Computation and Language · Computer Science 2023-05-04 Sunyi Chi , Bo Dong , Yiming Xu , Zhenyu Shi , Zheng Du

Most of the achievements in artificial intelligence so far were accomplished by supervised learning which requires numerous annotated training data and thus costs innumerable manpower for labeling. Unsupervised learning is one of the…

Computer Vision and Pattern Recognition · Computer Science 2021-06-14 Mingxiang Chen , Zhanguo Chang , Haonan Lu , Bitao Yang , Zhuang Li , Liufang Guo , Zhecheng Wang

Large-scale ''foundation models'' have gained traction as a way to leverage the vast amounts of unlabeled remote sensing data collected every day. However, due to the multiplicity of Earth Observation satellites, these models should learn…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Valerio Marsocci , Nicolas Audebert

Deep residual learning (ResNet) is a new method for training very deep neural networks using identity map-ping for shortcut connections. ResNet has won the ImageNet ILSVRC 2015 classification task, and achieved state-of-the-art performances…

Computation and Language · Computer Science 2017-07-28 Yi Yao Huang , William Yang Wang

The proliferation of remote sensing satellites has resulted in a massive amount of remote sensing images. However, due to human and material resource constraints, the vast majority of remote sensing images remain unlabeled. As a result, it…

Computer Vision and Pattern Recognition · Computer Science 2022-02-16 Wenyuan Li , Keyan Chen , Hao Chen , Zhenwei Shi

Self-supervised learning enables the training of large neural models without the need for large, labeled datasets. It has been generating breakthroughs in several fields, including computer vision, natural language processing, biology, and…

Computation and Language · Computer Science 2023-12-19 Luis Lugo , Valentin Vielzeuf

In training machine learning models for land cover semantic segmentation there is a stark contrast between the availability of satellite imagery to be used as inputs and ground truth data to enable supervised learning. While thousands of…

Computer Vision and Pattern Recognition · Computer Science 2022-03-14 Michail Tarasiou , Stefanos Zafeiriou

Learning general-purpose representations from multisensor data produced by the omnipresent sensing systems (or IoT in general) has numerous applications in diverse use cases. Existing purely supervised end-to-end deep learning techniques…

Machine Learning · Computer Science 2021-09-07 Aaqib Saeed , Victor Ungureanu , Beat Gfeller

Transformers have gained increasing popularity in a wide range of applications, including Natural Language Processing (NLP), Computer Vision and Speech Recognition, because of their powerful representational capacity. However, harnessing…

Unsupervised learning and supervised learning are key research topics in deep learning. However, as high-capacity supervised neural networks trained with a large amount of labels have achieved remarkable success in many computer vision…

Machine Learning · Computer Science 2017-04-18 Yuting Zhang , Kibok Lee , Honglak Lee

Recently proposed self-supervised learning approaches have been successful for pre-training speech representation models. The utility of these learned representations has been observed empirically, but not much has been studied about the…

Computation and Language · Computer Science 2022-12-06 Ankita Pasad , Ju-Chieh Chou , Karen Livescu

Recent supervised multi-view depth estimation networks have achieved promising results. Similar to all supervised approaches, these networks require ground-truth data during training. However, collecting a large amount of multi-view depth…

Computer Vision and Pattern Recognition · Computer Science 2021-04-08 Jiayu Yang , Jose M. Alvarez , Miaomiao Liu

Recent self-supervised video representation learning methods have found significant success by exploring essential properties of videos, e.g. speed, temporal order, etc. This work exploits an essential yet under-explored property of videos,…

Computer Vision and Pattern Recognition · Computer Science 2022-01-13 Hanwen Liang , Niamul Quader , Zhixiang Chi , Lizhe Chen , Peng Dai , Juwei Lu , Yang Wang

While deep learning has been incredibly successful in modeling tasks with large, carefully curated labeled datasets, its application to problems with limited labeled data remains a challenge. The aim of the present work is to improve the…

Audio and Speech Processing · Electrical Eng. & Systems 2019-10-29 Tyler Lee , Ting Gong , Suchismita Padhy , Andrew Rouditchenko , Anthony Ndirango

Audio self-supervised learning (SSL) pre-training, which aims to learn good representations from unlabeled audio, has made remarkable progress. However, the extensive computational demands during pre-training pose a significant barrier to…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-09 Wenxi Chen , Yuzhe Liang , Ziyang Ma , Zhisheng Zheng , Xie Chen

Land cover maps are a pivotal element in a wide range of Earth Observation (EO) applications. However, annotating large datasets to develop supervised systems for remote sensing (RS) semantic segmentation is costly and time-consuming.…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Valerio Marsocci , Nicolas Gonthier , Anatol Garioud , Simone Scardapane , Clément Mallet

Sequential sensor data is generated in a wide variety of practical applications. A fundamental challenge involves learning effective classifiers for such sequential data. While deep learning has led to impressive performance gains in recent…

Machine Learning · Computer Science 2020-10-07 Nauman Ahad , Mark A. Davenport

Multi-spectral imagery is invaluable for remote sensing due to different spectral signatures exhibited by materials that often appear identical in greyscale and RGB imagery. Paired with modern deep learning methods, this modality has great…

Computer Vision and Pattern Recognition · Computer Science 2022-11-23 Utkarsh Singhal , Stella X. Yu , Zackery Steck , Scott Kangas , Aaron A. Reite

This paper investigates the impact of sampling and pretraining using datasets with different image characteristics on the performance of self-supervised learning (SSL) models for object classification. To do this, we sample two apartment…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Raynor Kirkson E. Chavez , Kyle Gabriel M. Reynoso