中文
相关论文

相关论文: Towards a Robust Differentiable Architecture Searc…

200 篇论文

Realistic use of neural networks often requires adhering to multiple constraints on latency, energy and memory among others. A popular approach to find fitting networks is through constrained Neural Architecture Search (NAS), however,…

机器学习 · 计算机科学 2021-02-24 Niv Nayman , Yonathan Aflalo , Asaf Noy , Lihi Zelnik-Manor

Deep neural networks (DNNs) are powerful tools in computer vision tasks. However, in many realistic scenarios label noise is prevalent in the training images, and overfitting to these noisy labels can significantly harm the generalization…

计算机视觉与模式识别 · 计算机科学 2019-07-01 Jan M. Köhler , Maximilian Autenrieth , William H. Beluch

Because large, human-annotated datasets suffer from labeling errors, it is crucial to be able to train deep neural networks in the presence of label noise. While training image classification models with label noise have received much…

机器学习 · 计算机科学 2019-03-19 Ishan Jindal , Daniel Pressel , Brian Lester , Matthew Nokleby

Neural Architecture Search (NAS) has proved effective in offering outperforming alternatives to handcrafted neural networks. In this paper we analyse the benefits of NAS for image classification tasks under strict computational constraints.…

计算机视觉与模式识别 · 计算机科学 2020-09-30 Cristian Cioflan , Radu Timofte

Noisy labels are an unavoidable consequence of labeling processes and detecting them is an important step towards preventing performance degradations in Convolutional Neural Networks. Discarding noisy labels avoids a harmful memorization,…

计算机视觉与模式识别 · 计算机科学 2020-07-28 Diego Ortego , Eric Arazo , Paul Albert , Noel E. O'Connor , Kevin McGuinness

Recently, Neural Architecture Search (NAS) methods are introduced and show impressive performance on many benchmarks. Among those NAS studies, Neural Architecture Transformer (NAT) aims to improve the given neural architecture to have…

机器学习 · 计算机科学 2021-10-20 Do-Guk Kim , Heung-Chang Lee

The memorization effect of deep neural networks (DNNs) plays a pivotal role in recent label noise learning methods. To exploit this effect, the model prediction-based methods have been widely adopted, which aim to exploit the outputs of…

机器学习 · 计算机科学 2022-06-28 Chuang Zhang , Li Shen , Jian Yang , Chen Gong

We present a theoretically grounded approach to train deep neural networks, including recurrent networks, subject to class-dependent label noise. We propose two procedures for loss correction that are agnostic to both application domain and…

机器学习 · 统计学 2017-03-23 Giorgio Patrini , Alessandro Rozza , Aditya Menon , Richard Nock , Lizhen Qu

Neural Network-based active learning (NAL) is a cost-effective data selection technique that utilizes neural networks to select and train on a small subset of samples. While existing work successfully develops various effective or…

机器学习 · 计算机科学 2024-06-07 Dake Bu , Wei Huang , Taiji Suzuki , Ji Cheng , Qingfu Zhang , Zhiqiang Xu , Hau-San Wong

We introduce a novel method to combat label noise when training deep neural networks for classification. We propose a loss function that permits abstention during training thereby allowing the DNN to abstain on confusing samples while…

In the past few years, neural architecture search (NAS) has become an increasingly important tool within the deep learning community. Despite the many recent successes of NAS, however, most existing approaches operate within highly…

机器学习 · 计算机科学 2022-11-14 Charles Jin , Phitchaya Mangpo Phothilimthana , Sudip Roy

Label noise in datasets could significantly damage the performance and robustness of deep neural networks (DNNs) trained on these datasets. As the size of modern DNNs grows, there is a growing demand for automated tools for detecting such…

机器学习 · 计算机科学 2025-10-28 Dang Huu-Tien , Minh-Phuong Nguyen , Naoya Inoue

Foundation models (FMs) pretrained on large datasets have become fundamental for various downstream machine learning tasks, in particular in scenarios where obtaining perfectly labeled data is prohibitively expensive. In this paper, we…

机器学习 · 计算机科学 2025-08-04 Ecem Bozkurt , Antonio Ortega

Deep Neural Networks (DNNs) have revolutionized a wide range of industries, from healthcare and finance to automotive, by offering unparalleled capabilities in data analysis and decision-making. Despite their transforming impact, DNNs face…

机器学习 · 计算机科学 2024-02-08 Zhenyu Liu , Garrett Gagnon , Swagath Venkataramani , Liu Liu

Neural architecture search (NAS) has become a key component of AutoML and a standard tool to automate the design of deep neural networks. Recently, training-free NAS as an emerging paradigm has successfully reduced the search costs of…

机器学习 · 计算机科学 2024-03-13 Zhenfeng He , Yao Shu , Zhongxiang Dai , Bryan Kian Hsiang Low

Deep neural networks (DNNs) experience significant performance degradation when processing noisy labels, primarily due to overfitting on mislabeled data. Current mainstream approaches attempt to mitigate this issue by passively filtering…

计算机视觉与模式识别 · 计算机科学 2026-05-21 Ningkang Peng , Jingyang Mao , Xiaoqian Peng , Peirong Ma , Xichen Yang , Weiguang Qu , Yanhui Gu

In the real world, data is often noisy, affecting not only the quality of features but also the accuracy of labels. Current research on mitigating label errors stems primarily from advances in deep learning, and a gap exists in exploring…

机器学习 · 计算机科学 2024-05-29 Lukasz Sztukiewicz , Jack Henry Good , Artur Dubrawski

We demonstrate that learning procedures that rely on aggregated labels, e.g., label information distilled from noisy responses, enjoy robustness properties impossible without data cleaning. This robustness appears in several ways. In the…

机器学习 · 统计学 2026-05-26 Chen Cheng , John Duchi

Active Learning (AL) aims to reduce annotation costs by strategically selecting the most informative samples for labeling. However, most active learning methods struggle in the low-budget regime where only a few labeled examples are…

机器学习 · 计算机科学 2025-04-08 Netta Shafir , Guy Hacohen , Daphna Weinshall

As deep neural networks can easily overfit noisy labels, robust training in the presence of noisy labels is becoming an important challenge in modern deep learning. While existing methods address this problem in various directions, they…

机器学习 · 计算机科学 2022-11-30 Jongwoo Ko , Bongsoo Yi , Se-Young Yun