中文
相关论文

相关论文: Towards Understanding the Effect of Pretraining La…

200 篇论文

Constructing fine-grained image datasets typically requires domain-specific expert knowledge, which is not always available for crowd-sourcing platform annotators. Accordingly, learning directly from web images becomes an alternative method…

计算机视觉与模式识别 · 计算机科学 2020-08-07 Chuanyi Zhang , Yazhou Yao , Xiangbo Shu , Zechao Li , Zhenmin Tang , Qi Wu

In recent years, Fine-Grained Visual Classification (FGVC) has achieved impressive recognition accuracy, despite minimal inter-class variations. However, existing methods heavily rely on instance-level labels, making them impractical in…

计算机视觉与模式识别 · 计算机科学 2025-05-30 Jinyi Chang , Dongliang Chang , Lei Chen , Bingyao Yu , Zhanyu Ma

Large scale image classification datasets often contain noisy labels. We take a principled probabilistic approach to modelling input-dependent, also known as heteroscedastic, label noise in these datasets. We place a multivariate Normal…

机器学习 · 计算机科学 2021-05-24 Mark Collier , Basil Mustafa , Efi Kokiopoulou , Rodolphe Jenatton , Jesse Berent

Graph neural networks (GNNs) build on the success of deep learning models by extending them for use in graph spaces. Transfer learning has proven extremely successful for traditional deep learning problems: resulting in faster training and…

机器学习 · 计算机科学 2022-02-03 Nishai Kooverjee , Steven James , Terence van Zyl

Existing text classification methods mainly focus on a fixed label set, whereas many real-world applications require extending to new fine-grained classes as the number of samples per label increases. To accommodate such requirements, we…

计算与语言 · 计算机科学 2021-09-23 Dheeraj Mekala , Varun Gangal , Jingbo Shang

Collecting large-scale data with clean labels for supervised training of neural networks is practically challenging. Although noisy labels are usually cheap to acquire, existing methods suffer a lot from label noise. This paper targets at…

机器学习 · 计算机科学 2020-06-16 Zizhao Zhang , Han Zhang , Sercan O. Arik , Honglak Lee , Tomas Pfister

When random label noise is added to a training dataset, the prediction error of a neural network on a label-noise-free test dataset initially improves during early training but eventually deteriorates, following a U-shaped dependence on…

机器学习 · 计算机科学 2023-06-06 Chaoyue Liu , Amirhesam Abedsoltan , Mikhail Belkin

Multi-label networks with branches are proved to perform well in both accuracy and speed, but lacks flexibility in providing dynamic extension onto new labels due to the low efficiency of re-work on annotating and training. For multi-label…

计算机视觉与模式识别 · 计算机科学 2020-04-28 Chunhua Jia , Lei Zhang , Hui Huang , Weiwei Cai , Hao Hu , Rohan Adivarekar

Large training datasets almost always contain examples with inaccurate or incorrect labels. Deep Neural Networks (DNNs) tend to overfit training label noise, resulting in poorer model performance in practice. To address this problem, we…

计算机视觉与模式识别 · 计算机科学 2022-03-01 Chen Gong , Kong Bin , Eric J. Seibel , Xin Wang , Youbing Yin , Qi Song

Deep artificial neural networks have made remarkable progress in different tasks in the field of computer vision. However, the empirical analysis of these models and investigation of their failure cases has received attention recently. In…

计算机视觉与模式识别 · 计算机科学 2016-02-10 Babak Saleh , Ahmed Elgammal , Jacob Feldman

As machine learning has been deployed ubiquitously across applications in modern data science, algorithmic fairness has become a great concern. Among them, imposing fairness constraints during learning, i.e. in-processing fair training, has…

机器学习 · 计算机科学 2023-07-18 Yuzhen Mao , Zhun Deng , Huaxiu Yao , Ting Ye , Kenji Kawaguchi , James Zou

Domain Generalization aims to develop models that can generalize to novel and unseen data distributions. In this work, we study how model architectures and pre-training objectives impact feature richness and propose a method to effectively…

机器学习 · 计算机科学 2025-04-30 Xavier Thomas , Deepti Ghadiyaram

In real-world classification tasks, each class often comprises multiple finer-grained "subclasses." As the subclass labels are frequently unavailable, models trained using only the coarser-grained class labels often exhibit highly variable…

机器学习 · 计算机科学 2022-04-12 Nimit S. Sohoni , Jared A. Dunnmon , Geoffrey Angus , Albert Gu , Christopher Ré

Pre-training convolutional neural networks with weakly-supervised and self-supervised strategies is becoming increasingly popular for several computer vision tasks. However, due to the lack of strong discriminative signals, these learned…

计算机视觉与模式识别 · 计算机科学 2019-12-10 Xueting Yan , Ishan Misra , Abhinav Gupta , Deepti Ghadiyaram , Dhruv Mahajan

We consider the problem of semantic image segmentation using deep convolutional neural networks. We propose a novel network architecture called the label refinement network that predicts segmentation labels in a coarse-to-fine fashion at…

计算机视觉与模式识别 · 计算机科学 2017-03-03 Md Amirul Islam , Shujon Naha , Mrigank Rochan , Neil Bruce , Yang Wang

Hyper-spectral images are images captured from a satellite that gives spatial and spectral information of specific region.A Hyper-spectral image contains much more number of channels as compared to a RGB image, hence containing more…

计算机视觉与模式识别 · 计算机科学 2022-06-22 Uphar Singh , Tushar Musale , Ranjana Vyas , O. P. Vyas

Deep neural networks have shown impressive performance in supervised learning, enabled by their ability to fit well to the provided training data. However, their performance is largely dependent on the quality of the training data and often…

机器学习 · 计算机科学 2021-11-11 Abhishek Kumar , Ehsan Amid

We address two questions for training a convolutional neural network (CNN) for hyperspectral image classification: i) is it possible to build a pre-trained network? and ii) is the pre-training effective in furthering the performance? To…

计算机视觉与模式识别 · 计算机科学 2019-01-28 Hyungtae Lee , Sungmin Eum , Heesung Kwon

Annotating medical imaging datasets is costly, so fine-tuning (or transfer learning) is the most effective method for digital pathology vision applications such as disease classification and semantic segmentation. However, due to texture…

计算机视觉与模式识别 · 计算机科学 2023-08-23 Tushar Kataria , Beatrice Knudsen , Shireen Elhabian

Pre-training is a dominant paradigm in computer vision. For example, supervised ImageNet pre-training is commonly used to initialize the backbones of object detection and segmentation models. He et al., however, show a surprising result…

计算机视觉与模式识别 · 计算机科学 2020-11-17 Barret Zoph , Golnaz Ghiasi , Tsung-Yi Lin , Yin Cui , Hanxiao Liu , Ekin D. Cubuk , Quoc V. Le