English
Related papers

Related papers: Inception Score, Label Smoothing, Gradient Vanishi…

200 papers

The acquisition of labels for supervised learning can be expensive. To improve the sample efficiency of neural network regression, we study active learning methods that adaptively select batches of unlabeled data for labeling. We present a…

Machine Learning · Statistics 2023-08-02 David Holzmüller , Viktor Zaverkin , Johannes Kästner , Ingo Steinwart

Semantic layouts based Image synthesizing, which has benefited from the success of Generative Adversarial Network (GAN), has drawn much attention in these days. How to enhance the synthesis image equality while keeping the stochasticity of…

Computer Vision and Pattern Recognition · Computer Science 2018-01-11 Ziqiang Zheng , Chao Wang , Zhibin Yu , Haiyong Zheng , Bing Zheng

Class imbalance is a challenging issue in practical classification problems for deep learning models as well as for traditional models. Traditionally successful countermeasures such as synthetic over-sampling have had limited success with…

Computer Vision and Pattern Recognition · Computer Science 2020-12-10 Kumari Deepshikha , Anugunj Naman

Generative adversarial network (GAN) has attracted increasing attention recently owing to its impressive ability to generate realistic samples with high privacy protection. Without directly interactive with training examples, the generative…

Machine Learning · Computer Science 2020-07-07 Chuan Ma , Jun Li , Ming Ding , Bo Liu , Kang Wei , Jian Weng , H. Vincent Poor

The objective of machine unlearning (MU) is to eliminate previously learned data from a model. However, it is challenging to strike a balance between computation cost and performance when using existing MU techniques. Taking inspiration…

Machine Learning · Computer Science 2024-06-13 Zonglin Di , Zhaowei Zhu , Jinghan Jia , Jiancheng Liu , Zafar Takhirov , Bo Jiang , Yuanshun Yao , Sijia Liu , Yang Liu

Disentanglement, a critical concern in interpretable machine learning, has also garnered significant attention from the computer vision community. Many existing GAN-based class disentanglement (unsupervised) approaches, such as InfoGAN and…

Computer Vision and Pattern Recognition · Computer Science 2024-06-03 Jiangwei Zhao , Zejia Liu , Xiaohan Guo , Lili Pan

A deep neural network trained on noisy labels is known to quickly lose its power to discriminate clean instances from noisy ones. After the early learning phase has ended, the network memorizes the noisy instances, which leads to a…

Machine Learning · Computer Science 2021-09-03 Jason Z. Lin , Jelena Bradic

Distant supervision has been widely used for relation extraction but suffers from noise labeling problem. Neural network models are proposed to denoise with attention mechanism but cannot eliminate noisy data due to its non-zero weights.…

Computation and Language · Computer Science 2020-10-01 Guoqing Luo , Jiaxin Pan , Min Peng

We propose a novel GAN training scheme that can handle any level of labeling in a unified manner. Our scheme introduces a form of artificial labeling that can incorporate manually defined labels, when available, and induce an alignment…

Machine Learning · Computer Science 2021-06-21 Tomoki Watanabe , Paolo Favaro

We propose Disentanglement based Active Learning (DAL), a new active learning technique based on self-supervision which leverages the concept of disentanglement. Instead of requesting labels from human oracle, our method automatically…

Machine Learning · Computer Science 2021-09-28 Silpa Vadakkeeveetil Sreelatha , Adarsh Kappiyath , Sumitra S

Label smoothing is widely used in deep neural networks for multi-class classification. While it enhances model generalization and reduces overconfidence by aiming to lower the probability for the predicted class, it distorts the predicted…

Machine Learning · Computer Science 2021-10-12 Mohamed Maher , Meelis Kull

Labeling cost is often expensive and is a fundamental limitation of supervised learning. In this paper, we study importance labeling problem, in which we are given many unlabeled data and select a limited number of data to be labeled from…

Machine Learning · Computer Science 2021-04-13 Tomoya Murata , Taiji Suzuki

Multi-domain image-to-image translation with conditional Generative Adversarial Networks (GANs) can generate highly photo realistic images with desired target classes, yet these synthetic images have not always been helpful to improve…

Computer Vision and Pattern Recognition · Computer Science 2021-05-13 Suman Sapkota , Bidur Khanal , Binod Bhattarai , Bishesh Khanal , Tae-Kyun Kim

Label smoothing (LS) is a popular regularisation method for training neural networks as it is effective in improving test accuracy and is simple to implement. ``Hard'' one-hot labels are ``smoothed'' by uniformly distributing probability…

Machine Learning · Computer Science 2025-02-21 Guoxuan Xia , Olivier Laurent , Gianni Franchi , Christos-Savvas Bouganis

Most deep learning classification studies assume clean data. However, when dealing with the real world data, we encounter three problems such as 1) missing data, 2) class imbalance, and 3) missing label problems. These problems undermine…

Machine Learning · Computer Science 2019-05-29 Uiwon Hwang , Dahuin Jung , Sungroh Yoon

LLM unlearning has emerged as a promising approach, aiming to enable models to forget hazardous/undesired knowledge at low cost while preserving as much model utility as possible. Among existing techniques, the most straightforward method…

Machine Learning · Computer Science 2025-10-28 Zirui Pang , Hao Zheng , Zhijie Deng , Ling Li , Zixin Zhong , Jiaheng Wei

Log-loss (also known as cross-entropy loss) metric is ubiquitously used across machine learning applications to assess the performance of classification algorithms. In this paper, we investigate the problem of inferring the labels of a…

Machine Learning · Computer Science 2021-06-15 Abhinav Aggarwal , Shiva Prasad Kasiviswanathan , Zekun Xu , Oluwaseyi Feyisetan , Nathanael Teissier

Diffusion models have become a leading paradigm in generative AI, with score estimation via denoising score matching as a central component. While recent theory provides strong statistical guarantees, it typically relies on…

Machine Learning · Computer Science 2026-04-21 Yinbin Han , Meisam Razaviyayn , Renyuan Xu

State-of-the-art methods for retinal vessel segmentation mainly rely on manually labeled vessels as the ground truth for supervised training. The quality of manual labels plays an essential role in the segmentation accuracy, while in…

Image and Video Processing · Electrical Eng. & Systems 2019-12-06 Yunqiao Yang , Zhiwei Wang , Jingen Liu , Kwang-Ting Cheng , Xin Yang

There is an emerging trend to leverage noisy image datasets in many visual recognition tasks. However, the label noise among the datasets severely degenerates the \mbox{performance of deep} learning approaches. Recently, one mainstream is…

Computer Vision and Pattern Recognition · Computer Science 2017-11-03 Jiangchao Yao , Jiajie Wang , Ivor Tsang , Ya Zhang , Jun Sun , Chengqi Zhang , Rui Zhang