English
Related papers

Related papers: DeepMimic: Mentor-Student Unlabeled Data Based Tra…

200 papers

Recent semi-supervised learning methods use pseudo supervision as core idea, especially self-training methods that generate pseudo labels. However, pseudo labels are unreliable. Self-training methods usually rely on single model prediction…

Computer Vision and Pattern Recognition · Computer Science 2022-05-12 Zhengyang Feng , Qianyu Zhou , Qiqi Gu , Xin Tan , Guangliang Cheng , Xuequan Lu , Jianping Shi , Lizhuang Ma

Deep neural networks produce state-of-the-art results when trained on a large number of labeled examples but tend to overfit when small amounts of labeled examples are used for training. Creating a large number of labeled examples requires…

Computer Vision and Pattern Recognition · Computer Science 2021-09-13 Attaullah Sahito , Eibe Frank , Bernhard Pfahringer

Deep neural networks often struggle to learn robust representations in the presence of dataset biases, leading to suboptimal generalization on unbiased datasets. This limitation arises because the models heavily depend on peripheral and…

Machine Learning · Computer Science 2024-12-11 Carlo Alberto Barbano , Enzo Tartaglione , Marco Grangetto

Deep learning has revolutionized medical imaging, but its effectiveness is severely limited by insufficient labeled training data. This paper introduces a novel GAN-based semi-supervised learning framework specifically designed for low…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Guido Manni , Clemente Lauretti , Loredana Zollo , Paolo Soda

Large amounts of labeled data are typically required to train deep learning models. For many real-world problems, however, acquiring additional data can be expensive or even impossible. We present semi-supervised deep kernel learning…

Machine Learning · Computer Science 2019-03-05 Neal Jean , Sang Michael Xie , Stefano Ermon

Numerous researches have proved that deep neural networks (DNNs) can fit everything in the end even given data with noisy labels, and result in poor generalization performance. However, recent studies suggest that DNNs tend to gradually…

Machine Learning · Computer Science 2021-04-07 Hao Yang , Youzhi Jin , Ziyin Li , Deng-Bao Wang , Lei Miao , Xin Geng , Min-Ling Zhang

We propose a method for channel training and precoding in FDD massive MIMO based on deep neural networks (DNNs), exploiting Downlink (DL) channel covariance knowledge. The DNN is optimized to maximize the DL multi-user sum-rate, by…

Information Theory · Computer Science 2023-03-21 Yi Song , Tianyu Yang , Mahdi Barzegar Khalilsarai , Giuseppe Caire

We present a novel self-taught framework for unsupervised metric learning, which alternates between predicting class-equivalence relations between data through a moving average of an embedding model and learning the model with the predicted…

Computer Vision and Pattern Recognition · Computer Science 2022-05-05 Sungyeon Kim , Dongwon Kim , Minsu Cho , Suha Kwak

Deep learning methods show promising results for overlapping cervical cell instance segmentation. However, in order to train a model with good generalization ability, voluminous pixel-level annotations are demanded which is quite expensive…

Computer Vision and Pattern Recognition · Computer Science 2020-07-22 Yanning Zhou , Hao Chen , Huangjing Lin , Pheng-Ann Heng

In this paper, we present a semi-supervised training technique using pseudo-labeling for end-to-end neural diarization (EEND). The EEND system has shown promising performance compared with traditional clustering-based methods, especially in…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-10 Yuki Takashima , Yusuke Fujita , Shota Horiguchi , Shinji Watanabe , Paola García , Kenji Nagamatsu

Deep neural networks have gained tremendous success in a broad range of machine learning tasks due to its remarkable capability to learn semantic-rich features from high-dimensional data. However, they often require large-scale labelled…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Hu Wang , Guansong Pang , Chunhua Shen , Congbo Ma

Multi-label classification is a widely encountered problem in daily life, where an instance can be associated with multiple classes. In theory, this is a supervised learning method that requires a large amount of labeling. However,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-02 XIn Zhang , Yuqi Song , Fei Zuo , Xiaofeng Wang

Self-training is an important technique for solving semi-supervised learning problems. It leverages unlabeled data by generating pseudo-labels and combining them with a limited labeled dataset for training. The effectiveness of…

Machine Learning · Computer Science 2023-11-06 Banghua Zhu , Mingyu Ding , Philip Jacobson , Ming Wu , Wei Zhan , Michael Jordan , Jiantao Jiao

Identifying breakdowns in ongoing dialogues helps to improve communication effectiveness. Most prior work on this topic relies on human annotated data and data augmentation to learn a classification model. While quality labeled dialogue…

Computation and Language · Computer Science 2022-04-20 Qian Lin , Hwee Tou Ng

Neural network compression has recently received much attention due to the computational requirements of modern deep models. In this work, our objective is to transfer knowledge from a deep and accurate model to a smaller one. Our…

Computer Vision and Pattern Recognition · Computer Science 2018-11-15 Vasileios Belagiannis , Azade Farshad , Fabio Galasso

The memorization effect of deep neural networks (DNNs) plays a pivotal role in recent label noise learning methods. To exploit this effect, the model prediction-based methods have been widely adopted, which aim to exploit the outputs of…

Machine Learning · Computer Science 2022-06-28 Chuang Zhang , Li Shen , Jian Yang , Chen Gong

Active Learning methods create an optimized labeled training set from unlabeled data. We introduce a novel Online Active Deep Learning method for Medical Image Analysis. We extend our MedAL active learning framework to present new results…

While making a tremendous impact in various fields, deep neural networks usually require large amounts of labeled data for training which are expensive to collect in many applications, especially in the medical domain. Unlabeled data, on…

Computer Vision and Pattern Recognition · Computer Science 2020-02-25 Yingda Xia , Fengze Liu , Dong Yang , Jinzheng Cai , Lequan Yu , Zhuotun Zhu , Daguang Xu , Alan Yuille , Holger Roth

Deep neural networks have established as a powerful tool for large scale supervised classification tasks. The state-of-the-art performances of deep neural networks are conditioned to the availability of large number of accurately labeled…

Computer Vision and Pattern Recognition · Computer Science 2021-06-22 Bharath Bhushan Damodaran , Rémi Flamary , Viven Seguy , Nicolas Courty

In the 21st-century information age, with the development of big data technology, effectively extracting valuable information from massive data has become a key issue. Traditional data mining methods are inadequate when faced with…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Aoran Shen , Minghao Dai , Jiacheng Hu , Yingbin Liang , Shiru Wang , Junliang Du