English
Related papers

Related papers: Color-$S^{4}L$: Self-supervised Semi-supervised Le…

200 papers

Image colorization aims to bring colors back to grayscale images. Automatic image colorization methods, which requires no additional guidance, struggle to generate high-quality images due to color ambiguity, and provides limited user…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Yifan Li , Shuai Yang , Jiaying Liu

Recent algorithms for image manipulation detection almost exclusively use deep network models. These approaches require either dense pixelwise groundtruth masks, camera ids, or image metadata to train the networks. On one hand, constructing…

Computer Vision and Pattern Recognition · Computer Science 2022-03-16 Susmit Agrawal , Prabhat Kumar , Siddharth Seth , Toufiq Parag , Maneesh Singh , Venkatesh Babu

In this paper, we consider a problem of self-supervised learning for small-scale datasets based on contrastive loss between multiple views of the data, which demonstrates the state-of-the-art performance in classification task. Despite the…

Computer Vision and Pattern Recognition · Computer Science 2021-09-01 Vitaliy Kinakh , Olga Taran , Svyatoslav Voloshynovskiy

As the adoption of deep learning techniques in industrial applications grows with increasing speed and scale, successful deployment of deep learning models often hinges on the availability, volume, and quality of annotated data. In this…

Computer Vision and Pattern Recognition · Computer Science 2021-11-23 Haoping Bai , Meng Cao , Ping Huang , Jiulong Shan

We consider the problem of complementary fashion prediction. Existing approaches focus on learning an embedding space where fashion items from different categories that are visually compatible are closer to each other. However, creating…

Computer Vision and Pattern Recognition · Computer Science 2021-09-17 Ambareesh Revanur , Vijay Kumar , Deepthi Sharma

Semi-supervised learning through deep generative models and multi-lingual pretraining techniques have orchestrated tremendous success across different areas of NLP. Nonetheless, their development has happened in isolation, while the…

Computation and Language · Computer Science 2021-01-27 Yi Zhu , Ehsan Shareghi , Yingzhen Li , Roi Reichart , Anna Korhonen

Deep clustering against self-supervised learning is a very important and promising direction for unsupervised visual representation learning since it requires little domain knowledge to design pretext tasks. However, the key component,…

Computer Vision and Pattern Recognition · Computer Science 2020-08-21 Weijie Chen , Shiliang Pu , Di Xie , Shicai Yang , Yilu Guo , Luojun Lin

In this work, we propose a novel methodology for self-supervised learning for generating global and local attention-aware visual features. Our approach is based on training a model to differentiate between specific image transformations of…

Computer Vision and Pattern Recognition · Computer Science 2021-08-03 Trung X. Pham , Rusty John Lloyd Mina , Dias Issa , Chang D. Yoo

Semi-supervised learning (SSL) has achieved great success in leveraging a large amount of unlabeled data to learn a promising classifier. A popular approach is pseudo-labeling that generates pseudo labels only for those unlabeled data with…

Computer Vision and Pattern Recognition · Computer Science 2022-12-29 Qinyi Deng , Yong Guo , Zhibang Yang , Haolin Pan , Jian Chen

Self-supervised heterogeneous graph learning (SHGL) has shown promising potential in diverse scenarios. However, while existing SHGL methods share a similar essential with clustering approaches, they encounter two significant limitations:…

Artificial Intelligence · Computer Science 2024-12-03 Yujie Mo , Zhihe Lu , Runpeng Yu , Xiaofeng Zhu , Xinchao Wang

Self-supervised learning is currently gaining a lot of attention, as it allows neural networks to learn robust representations from large quantities of unlabeled data. Additionally, multi-task learning can further improve representation…

Machine Learning · Computer Science 2020-12-07 Franco Manessi , Alessandro Rozza

Convolutional neural networks perform well on object recognition because of a number of recent advances: rectified linear units (ReLUs), data augmentation, dropout, and large labelled datasets. Unsupervised data has been proposed as another…

Computer Vision and Pattern Recognition · Computer Science 2015-04-14 Tom Le Paine , Pooya Khorrami , Wei Han , Thomas S. Huang

Confocal microscopy has long been a cornerstone technique for visualizing complex interactions and processes within cellular structures. However, achieving super-resolution imaging of multiple organelles and their interactions…

Optics · Physics 2025-08-19 Qinglin Chen , Luwei Wang , Jia Li , Dan Shao , Xiaoyu Weng , Liwei Liu , Dayong Jin , Junle Qu

Self-supervised learning allows AI systems to learn effective representations from large amounts of data using tasks that do not require costly labeling. Mode collapse, i.e., the model producing identical representations for all inputs, is…

Machine Learning · Computer Science 2022-09-19 Serdar Ozsoy , Shadi Hamdan , Sercan Ö. Arik , Deniz Yuret , Alper T. Erdogan

In this paper we propose a strategy for semi-supervised image classification that leverages unsupervised representation learning and co-training. The strategy, that is called CURL from Co-trained Unsupervised Representation Learning,…

Machine Learning · Computer Science 2015-09-14 Simone Bianco , Gianluigi Ciocca , Claudio Cusano

We combine supervised learning with unsupervised learning in deep neural networks. The proposed model is trained to simultaneously minimize the sum of supervised and unsupervised cost functions by backpropagation, avoiding the need for…

Neural and Evolutionary Computing · Computer Science 2015-11-25 Antti Rasmus , Harri Valpola , Mikko Honkala , Mathias Berglund , Tapani Raiko

Image recognition techniques heavily rely on abundant labeled data, particularly in medical contexts. Addressing the challenges associated with obtaining labeled data has led to the prominence of self-supervised learning and semi-supervised…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Hao Feng , Yuanzhe Jia , Ruijia Xu , Mukesh Prasad , Ali Anaissi , Ali Braytee

We present a scalable approach for semi-supervised learning on graph-structured data that is based on an efficient variant of convolutional neural networks which operate directly on graphs. We motivate the choice of our convolutional…

Machine Learning · Computer Science 2017-02-23 Thomas N. Kipf , Max Welling

Self-supervised representation learning solves auxiliary prediction tasks (known as pretext tasks) without requiring labeled data to learn useful semantic representations. These pretext tasks are created solely using the input features,…

Machine Learning · Computer Science 2021-11-16 Jason D. Lee , Qi Lei , Nikunj Saunshi , Jiacheng Zhuo

Deep neural networks have been widely used in communication signal recognition and achieved remarkable performance, but this superiority typically depends on using massive examples for supervised learning, whereas training a deep neural…

Signal Processing · Electrical Eng. & Systems 2023-11-15 Weidong Wang , Hongshu Liao , Lu Gan