English
Related papers

Related papers: Direct Coloring for Self-Supervised Enhanced Featu…

200 papers

Deep networks have shown impressive performance in the image restoration tasks, such as image colorization. However, we find that previous approaches rely on the digital representation from single color model with a specific mapping…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Xiangcheng Du , Zhao Zhou , Yanlong Wang , Zhuoyao Wang , Yingbin Zheng , Cheng Jin

Although supervised learning has been highly successful in improving the state-of-the-art in the domain of image-based computer vision in the past, the margin of improvement has diminished significantly in recent years, indicating that a…

Computer Vision and Pattern Recognition · Computer Science 2023-05-24 Utku Ozbulak , Hyun Jung Lee , Beril Boga , Esla Timothy Anzaku , Homin Park , Arnout Van Messem , Wesley De Neve , Joris Vankerschaver

Despite the empirical successes of self-supervised learning (SSL) methods, it is unclear what characteristics of their representations lead to high downstream accuracies. In this work, we characterize properties that SSL representations…

Machine Learning · Computer Science 2022-12-13 Yann Dubois , Tatsunori Hashimoto , Stefano Ermon , Percy Liang

Contrastive learning is among the most successful methods for visual representation learning, and its performance can be further improved by jointly performing clustering on the learned representations. However, existing methods for joint…

Computer Vision and Pattern Recognition · Computer Science 2022-09-16 Shunjie-Fabian Zheng , JaeEun Nam , Emilio Dorigatti , Bernd Bischl , Shekoofeh Azizi , Mina Rezaei

Image colorization methods have shown prominent performance on natural images. However, since humans are more sensitive to faces, existing methods are insufficient to meet the demands when applied to facial images, typically showing…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Hangyan Zhu , Ming Liu , Chao Zhou , Zifei Yan , Kuanquan Wang , Wangmeng Zuo

Self-Supervised Learning (SSL) methods operate on unlabeled data to learn robust representations useful for downstream tasks. Most SSL methods rely on augmentations obtained by transforming the 2D image pixel map. These augmentations ignore…

Computer Vision and Pattern Recognition · Computer Science 2023-01-30 Sumukh Aithal , Anirudh Goyal , Alex Lamb , Yoshua Bengio , Michael Mozer

Existing self-supervised learning methods learn representation by means of pretext tasks which are either (1) discriminating that explicitly specify which features should be separated or (2) aligning that precisely indicate which features…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Anjan Dutta , Massimiliano Mancini , Zeynep Akata

Self-supervised learning (SSL) methods have achieved remarkable success in learning image representations allowing invariances in them - but therefore discarding transformation information that some computer vision tasks actually require.…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Qin Wang , Alessio Quercia , Benjamin Bruns , Abigail Morrison , Hanno Scharr , Kai Krajsek

Decentralized learning has been advocated and widely deployed to make efficient use of distributed datasets, with an extensive focus on supervised learning (SL) problems. Unfortunately, the majority of real-world data are unlabeled and can…

Machine Learning · Computer Science 2023-03-01 Lirui Wang , Kaiqing Zhang , Yunzhu Li , Yonglong Tian , Russ Tedrake

Self-Supervised Learning (SSL) methods harness the concept of semantic invariance by utilizing data augmentation strategies to produce similar representations for different deformations of the same input. Essentially, the model captures the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Huijie Guo , Ying Ba , Jie Hu , Lingyu Si , Wenwen Qiang , Lei Shi

Self-supervised learning (SSL) has emerged as a promising solution for addressing the challenge of limited labeled data in deep neural networks (DNNs), offering scalability potential. However, the impact of design dependencies within the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Shruthi Gowda , Elahe Arani , Bahram Zonooz

Image colorization is a challenging problem due to multi-modal uncertainty and high ill-posedness. Directly training a deep neural network usually leads to incorrect semantic colors and low color richness. While transformer-based methods…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Xiaoyang Kang , Tao Yang , Wenqi Ouyang , Peiran Ren , Lingzhi Li , Xuansong Xie

In the field of visual representation learning, performance of contrastive learning has been catching up with the supervised method which is commonly a classification convolutional neural network. However, most of the research work focuses…

Computer Vision and Pattern Recognition · Computer Science 2023-01-31 Xiaoqi Zhuang

Contrastive self-supervised learning (CSL) has attracted increasing attention for model pre-training via unlabeled data. The resulted CSL models provide instance-discriminative visual features that are uniformly scattered in the feature…

Computer Vision and Pattern Recognition · Computer Science 2021-10-15 Yifan Zhang , Bryan Hooi , Dapeng Hu , Jian Liang , Jiashi Feng

Contrastive learning (CL) has emerged as a powerful technique for representation learning, with or without label supervision. However, supervised CL is prone to collapsing representations of subclasses within a class by not capturing all…

Machine Learning · Computer Science 2023-05-30 Yihao Xue , Siddharth Joshi , Eric Gan , Pin-Yu Chen , Baharan Mirzasoleiman

The fundamental goal of self-supervised learning (SSL) is to produce useful representations of data without access to any labels for classifying the data. Modern methods in SSL, which form representations based on known or constructed…

Machine Learning · Computer Science 2022-09-30 Bobak T. Kiani , Randall Balestriero , Yubei Chen , Seth Lloyd , Yann LeCun

Self-supervised learning (SSL) has gained remarkable success, for which contrastive learning (CL) plays a key role. However, the recent development of new non-CL frameworks has achieved comparable or better performance with high improvement…

Computer Vision and Pattern Recognition · Computer Science 2023-09-22 Thanh Nguyen , Trung Pham , Chaoning Zhang , Tung Luu , Thang Vu , Chang D. Yoo

Self-supervised Learning (SSL) including the mainstream contrastive learning has achieved great success in learning visual representations without data annotations. However, most of methods mainly focus on the instance level information…

Computer Vision and Pattern Recognition · Computer Science 2021-07-26 Mingkai Zheng , Shan You , Fei Wang , Chen Qian , Changshui Zhang , Xiaogang Wang , Chang Xu

Recent successes in self-supervised learning (SSL) model spatial co-occurrences of visual features either by masking portions of an image or by aggressively cropping it. Here, we propose a new way to model spatial co-occurrences by aligning…

Machine Learning · Computer Science 2025-01-07 Arthur Aubret , Céline Teulière , Jochen Triesch

Self-supervised Learning (SSL) including the mainstream contrastive learning has achieved great success in learning visual representations without data annotations. However, most methods mainly focus on the instance level information (\ie,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Mingkai Zheng , Shan You , Fei Wang , Chen Qian , Changshui Zhang , Xiaogang Wang , Chang Xu