English
Related papers

Related papers: An Investigation into Whitening Loss for Self-supe…

200 papers

When training samples are scarce, the semantic embedding technique, ie, describing class labels with attributes, provides a condition to generate visual features for unseen objects by transferring the knowledge from seen objects. However,…

Computer Vision and Pattern Recognition · Computer Science 2022-03-23 Liangjun Feng , Chunhui Zhao , Xi Li

Photometric differences are widely used as supervision signals to train neural networks for estimating depth and camera pose from unlabeled monocular videos. However, this approach is detrimental for model optimization because occlusions…

Computer Vision and Pattern Recognition · Computer Science 2023-03-06 Fei Wang , Jun Cheng , Penglei Liu

Self-supervised learning (SSL) offers a powerful way to learn robust, generalizable representations without labeled data. In music, where labeled data is scarce, existing SSL methods typically use generated supervision and multi-view…

Sound · Computer Science 2024-11-06 Julia Wilkins , Sivan Ding , Magdalena Fuentes , Juan Pablo Bello

As advanced image manipulation techniques emerge, detecting the manipulation becomes increasingly important. Despite the success of recent learning-based approaches for image manipulation detection, they typically require expensive…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Yuanhao Zhai , Tianyu Luan , David Doermann , Junsong Yuan

We are interested in representation learning from labeled or unlabeled data. Inspired by recent success of self-supervised learning (SSL), we develop a non-contrastive representation learning method that can exploit additional knowledge.…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Ajinkya Tejankar , Soroush Abbasi Koohpayegani , Hamed Pirsiavash

Deep neural networks are efficient at learning the data distribution if it is sufficiently sampled. However, they can be strongly biased by non-relevant factors implicitly incorporated in the training data. These include operational biases,…

Computer Vision and Pattern Recognition · Computer Science 2022-03-04 Kirill Sirotkin , Pablo Carballeira , Marcos Escudero-Viñolo

The pursuit of learning robust representations without human supervision is a longstanding challenge. The recent advancements in self-supervised contrastive learning approaches have demonstrated high performance across various…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Ozgu Goksu , Nicolas Pugeault

Self supervised learning (SSL) has become a very successful technique to harness the power of unlabeled data, with no annotation effort. A number of developed approaches are evolving with the goal of outperforming supervised alternatives,…

Computer Vision and Pattern Recognition · Computer Science 2022-10-31 Salman Mohamadi , Gianfranco Doretto , Donald A. Adjeroh

Self-supervised learning (SSL) has emerged as a powerful paradigm for representation learning by optimizing geometric objectives, such as invariance to augmentations, variance preservation, and feature decorrelation, without requiring…

Machine Learning · Statistics 2026-03-09 M. Hadi Sepanj , Benyamin Ghojogh , Saed Moradi , Paul Fieguth

In recent years, much work has been done on processing of wireless spectrum data involving machine learning techniques in domain-related problems for cognitive radio networks, such as anomaly detection, modulation classification, technology…

Networking and Internet Architecture · Computer Science 2024-08-23 Ljupcho Milosheski , Gregor Cerar , Blaž Bertalanič , Carolina Fortuna , Mihael Mohorčič

We consider the multiple-input multiple-output (MIMO) communication channel impaired by phase noises at both the transmitter and receiver. We focus on the maximum likelihood (ML) detection problem for uncoded single-carrier transmission. We…

Information Theory · Computer Science 2017-08-09 Richard Combes , Sheng Yang

Semi-supervised learning (SSL) has demonstrated high performance in image classification tasks by effectively utilizing both labeled and unlabeled data. However, existing SSL methods often suffer from poor calibration, with models yielding…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Mehrab Mustafy Rahman , Jayanth Mohan , Tiberiu Sosea , Cornelia Caragea

With sufficient paired training samples, the supervised deep learning methods have attracted much attention in image denoising because of their superior performance. However, it is still very challenging to widely utilize the supervised…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Yizhong Pan , Xiao Liu , Xiangyu Liao , Yuanzhouhan Cao , Chao Ren

The rapid advancement of deep neural networks (DNNs) heavily relies on large-scale, high-quality datasets. However, unauthorized commercial use of these datasets severely violates the intellectual property rights of dataset owners. Existing…

Cryptography and Security · Computer Science 2025-10-31 Yingjia Wang , Ting Qiao , Xing Liu , Chongzuo Li , Sixing Wu , Jianbin Li

Although supervised learning has enabled high performance for image segmentation, it requires a large amount of labeled training data, which can be difficult to obtain in the medical imaging field. Self-supervised learning (SSL) methods…

While self-supervised representation learning (SSL) has received widespread attention from the community, recent research argue that its performance will suffer a cliff fall when the model size decreases. The current method mainly relies on…

Computer Vision and Pattern Recognition · Computer Science 2022-07-05 Yuting Gao , Jia-Xin Zhuang , Shaohui Lin , Hao Cheng , Xing Sun , Ke Li , Chunhua Shen

Self-supervised learning (SSL) is an effective method for exploiting unlabelled data to learn a high-level embedding space that can be used for various downstream tasks. However, existing methods to monitor the quality of the encoder --…

Machine Learning · Computer Science 2024-09-11 Isaac Xu , Scott Lowe , Thomas Trappenberg

Collecting large-scale medical datasets with fully annotated samples for training of deep networks is prohibitively expensive, especially for 3D volume data. Recent breakthroughs in self-supervised learning (SSL) offer the ability to…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Duy M. H. Nguyen , Hoang Nguyen , Mai T. N. Truong , Tri Cao , Binh T. Nguyen , Nhat Ho , Paul Swoboda , Shadi Albarqouni , Pengtao Xie , Daniel Sonntag

Self-supervised learning (SSL) is recognized as an essential tool for building foundation models for Artificial Intelligence applications. The advances in SSL have been made thanks to vigorous arguments about the principles of SSL and…

Machine Learning · Computer Science 2026-05-13 Josef Kittler , Sara Atito , Muhammad Awais

Self-supervised learning has driven significant progress in learning from single-subject, iconic images. However, there are still unanswered questions about the use of minimally-curated, naturalistic video data, which contain dense scenes…

Computer Vision and Pattern Recognition · Computer Science 2025-04-24 Alex N. Wang , Christopher Hoang , Yuwen Xiong , Yann LeCun , Mengye Ren
‹ Prev 1 8 9 10 Next ›