English
Related papers

Related papers: Transformer-CNN Cohort: Semi-supervised Semantic S…

200 papers

We propose a novel weakly-supervised semantic segmentation algorithm based on Deep Convolutional Neural Network (DCNN). Contrary to existing weakly-supervised approaches, our algorithm exploits auxiliary segmentation annotations available…

Computer Vision and Pattern Recognition · Computer Science 2015-12-29 Seunghoon Hong , Junhyuk Oh , Bohyung Han , Honglak Lee

The current success of deep neural networks (DNNs) in an increasingly broad range of tasks involving artificial intelligence strongly depends on the quality and quantity of labeled training data. In general, the scarcity of labeled data,…

Computation and Language · Computer Science 2018-11-21 Shun Kiyono , Jun Suzuki , Kentaro Inui

Connectionist temporal classification (CTC) is a popular sequence prediction approach for automatic speech recognition that is typically used with models based on recurrent neural networks (RNNs). We explore whether deep convolutional…

Computation and Language · Computer Science 2018-02-16 Kalpesh Krishna , Liang Lu , Kevin Gimpel , Karen Livescu

The ability to understand visual information from limited labeled data is an important aspect of machine learning. While image-level classification has been extensively studied in a semi-supervised setting, dense pixel-level classification…

Computer Vision and Pattern Recognition · Computer Science 2019-08-19 Sudhanshu Mittal , Maxim Tatarchenko , Thomas Brox

As data volumes continue to grow, the labelling process increasingly becomes a bottleneck, creating demand for methods that leverage information from unlabelled data. Impressive results have been achieved in semi-supervised learning (SSL)…

Machine Learning · Computer Science 2020-07-07 Ivana Balažević , Carl Allen , Timothy Hospedales

We present a novel clustering objective that learns a neural network classifier from scratch, given only unlabelled data samples. The model discovers clusters that accurately match semantic classes, achieving state-of-the-art results in…

Computer Vision and Pattern Recognition · Computer Science 2019-08-23 Xu Ji , João F. Henriques , Andrea Vedaldi

Consistency learning plays a crucial role in semi-supervised medical image segmentation as it enables the effective utilization of limited annotated data while leveraging the abundance of unannotated data. The effectiveness and efficiency…

Computer Vision and Pattern Recognition · Computer Science 2023-05-26 Zhenxi Zhang , Ran Ran , Chunna Tian , Heng Zhou , Xin Li , Fan Yang , Zhicheng Jiao

Semi-supervised learning has gained considerable popularity in medical image segmentation tasks due to its capability to reduce reliance on expert-examined annotations. Several mean-teacher (MT) based semi-supervised methods utilize…

Computer Vision and Pattern Recognition · Computer Science 2025-08-13 Kaiwen Huang , Tao Zhou , Huazhu Fu , Yizhe Zhang , Yi Zhou , Xiao-Jun Wu

Explaining deep learning models is of vital importance for understanding artificial intelligence systems, improving safety, and evaluating fairness. To better understand and control the CNN model, many methods for…

Machine Learning · Computer Science 2022-11-24 Zhihao Wang , Chuang Zhu

Recent work on curvilinear structure segmentation has mostly focused on backbone network design and loss engineering. The challenge of collecting labelled data, an expensive and labor intensive process, has been overlooked. While labelled…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Xun Xu , Manh Cuong Nguyen , Yasin Yazici , Kangkang Lu , Hlaing Min , Chuan-Sheng Foo

Supervised learning in large discriminative models is a mainstay for modern computer vision. Such an approach necessitates investing in large-scale human-annotated datasets for achieving state-of-the-art results. In turn, the efficacy of…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Liang-Chieh Chen , Raphael Gontijo Lopes , Bowen Cheng , Maxwell D. Collins , Ekin D. Cubuk , Barret Zoph , Hartwig Adam , Jonathon Shlens

We present an approach to learn a dense pixel-wise labeling from image-level tags. Each image-level tag imposes constraints on the output labeling of a Convolutional Neural Network (CNN) classifier. We propose Constrained CNN (CCNN), a…

Computer Vision and Pattern Recognition · Computer Science 2015-10-20 Deepak Pathak , Philipp Krähenbühl , Trevor Darrell

Existing semi-supervised learning (SSL) methods assume that labeled and unlabeled data share the same class space. However, in real-world applications, unlabeled data always contain classes not present in the labeled set, which may cause…

Machine Learning · Computer Science 2024-01-17 Wenjuan Xi , Xin Song , Weili Guo , Yang Yang

The hybrid architecture of convolutional neural networks (CNNs) and Transformer are very popular for medical image segmentation. However, it suffers from two challenges. First, although a CNNs branch can capture the local image features…

Image and Video Processing · Electrical Eng. & Systems 2023-12-21 Tao Lei , Rui Sun , Xuan Wang , Yingbo Wang , Xi He , Asoke Nandi

High annotation costs are a major bottleneck for the training of semantic segmentation systems. Therefore, methods working with less annotation effort are of special interest. This paper studies the problem of semi-supervised semantic…

Computer Vision and Pattern Recognition · Computer Science 2021-03-22 Olga Zatsarynna , Johann Sawatzky , Juergen Gall

Graph convolutional network (GCN) provides a powerful means for graph-based semi-supervised tasks. However, as a localized first-order approximation of spectral graph convolution, the classic GCN can not take full advantage of unlabeled…

Machine Learning · Computer Science 2018-09-27 Yawei Luo , Tao Guan , Junqing Yu , Ping Liu , Yi Yang

The hybrid architecture of convolution neural networks (CNN) and Transformer has been the most popular method for medical image segmentation. However, the existing networks based on the hybrid architecture suffer from two problems. First,…

Image and Video Processing · Electrical Eng. & Systems 2023-12-21 Rui Sun , Tao Lei , Weichuan Zhang , Yong Wan , Yong Xia , Asoke K. Nandi

In this paper we propose a strategy for semi-supervised image classification that leverages unsupervised representation learning and co-training. The strategy, that is called CURL from Co-trained Unsupervised Representation Learning,…

Machine Learning · Computer Science 2015-09-14 Simone Bianco , Gianluigi Ciocca , Claudio Cusano

Self-Supervised Learning (SSL) methods harness the concept of semantic invariance by utilizing data augmentation strategies to produce similar representations for different deformations of the same input. Essentially, the model captures the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Huijie Guo , Ying Ba , Jie Hu , Lingyu Si , Wenwen Qiang , Lei Shi

Semi-supervised semantic segmentation aims to learn from a small amount of labeled data and plenty of unlabeled ones for the segmentation task. The most common approach is to generate pseudo-labels for unlabeled images to augment the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Rui Chen , Tao Chen , Qiong Wang , Yazhou Yao