中文
相关论文

相关论文: Variance-Aware Noisy Training: Hardening DNNs agai…

200 篇论文

Recent research showed that deep neural networks are highly sensitive to so-called adversarial perturbations, which are tiny perturbations of the input data purposely designed to fool a machine learning classifier. Most classification…

机器学习 · 计算机科学 2018-01-15 Akram Erraqabi , Aristide Baratin , Yoshua Bengio , Simon Lacoste-Julien

Deep neural networks (DNNs) have achieved remarkable success in a variety of computer vision tasks, where massive labeled images are routinely required for model optimization. Yet, the data collected from the open world are unavoidably…

计算机视觉与模式识别 · 计算机科学 2023-02-13 Peng Cui , Yang Yue , Zhijie Deng , Jun Zhu

With recent deep learning based approaches showing promising results in removing noise from images, the best denoising performance has been reported in a supervised learning setup that requires a large set of paired noisy images and ground…

图像与视频处理 · 电气工程与系统科学 2022-09-20 Rihuan Ke

While neural networks have made significant strides in many AI tasks, they remain vulnerable to a range of noise types, including natural corruptions, adversarial noise, and low-resolution artifacts. Many existing approaches focus on…

计算机视觉与模式识别 · 计算机科学 2024-09-30 Zhiling Zhou , Zirui Liu , Chengming Xu , Yanwei Fu , Xinwei Sun

Adversarial robustness has proven to be a required property of machine learning algorithms. A key and often overlooked aspect of this problem is to try to make the adversarial noise magnitude as large as possible to enhance the benefits of…

机器学习 · 统计学 2020-03-31 Amirreza Shaeiri , Rozhin Nobahari , Mohammad Hossein Rohban

Stochastic Neural Networks (SNNs) that inject noise into their hidden layers have recently been shown to achieve strong robustness against adversarial attacks. However, existing SNNs are usually heuristically motivated, and often rely on…

机器学习 · 计算机科学 2021-05-27 Panagiotis Eustratiadis , Henry Gouk , Da Li , Timothy Hospedales

Deep neural networks (DNNs) are powerful tools in computer vision tasks. However, in many realistic scenarios label noise is prevalent in the training images, and overfitting to these noisy labels can significantly harm the generalization…

计算机视觉与模式识别 · 计算机科学 2019-07-01 Jan M. Köhler , Maximilian Autenrieth , William H. Beluch

Recently, a generative variational autoencoder (VAE) has been proposed for speech enhancement to model speech statistics. However, this approach only uses clean speech in the training phase, making the estimation particularly sensitive to…

音频与语音处理 · 电气工程与系统科学 2021-05-18 Huajian Fang , Guillaume Carbajal , Stefan Wermter , Timo Gerkmann

The notion of incremental learning is to train an ANN algorithm in stages, as and when newer training data arrives. Incremental learning is becoming widespread in recent times with the advent of deep learning. Noise in the training data…

机器学习 · 计算机科学 2020-05-08 Shovik Ganguly , Atrayee Chatterjee , Debasmita Bhoumik , Ritajit Majumdar

Deep neural networks (DNNs) are state-of-the-art algorithms for multiple applications, spanning from image classification to speech recognition. While providing excellent accuracy, they often have enormous compute and memory requirements.…

机器学习 · 计算机科学 2020-11-12 Ussama Zahid , Giulio Gambardella , Nicholas J. Fraser , Michaela Blott , Kees Vissers

In realistic environments, speech is usually interfered by various noise and reverberation, which dramatically degrades the performance of automatic speech recognition (ASR) systems. To alleviate this issue, the commonest way is to use a…

声音 · 计算机科学 2018-05-04 Bin Liu , Shuai Nie , Yaping Zhang , Dengfeng Ke , Shan Liang , Wenju Liu1

Deep neural networks (DNNs) are vulnerable to adversarial noises. Adversarial training is a general and effective strategy to improve DNN robustness (i.e., accuracy on noisy data) against adversarial noises. However, DNN models trained by…

计算机视觉与模式识别 · 计算机科学 2023-02-13 Linhai Ma , Liang Liang

Analog Compute-In-Memory (CIM) architectures promise significant energy efficiency gains for neural network inference, but suffer from complex hardware-induced noise that poses major challenges for deployment. While noise-aware training…

机器学习 · 计算机科学 2025-08-19 Yuannuo Feng , Wenyong Zhou , Yuexi Lyu , Yixiang Zhang , Zhengwu Liu , Ngai Wong , Wang Kang

Neural Architecture Search (NAS) is the game changer in designing robust neural architectures. Architectures designed by NAS outperform or compete with the best manual network designs in terms of accuracy, size, memory footprint and FLOPs.…

机器学习 · 计算机科学 2021-10-26 Christian Simon , Piotr Koniusz , Lars Petersson , Yan Han , Mehrtash Harandi

Analog electronic and optical computing exhibit tremendous advantages over digital computing for accelerating deep learning when operations are executed at low precision. In this work, we derive a relationship between analog precision,…

机器学习 · 计算机科学 2021-02-15 Sahaj Garg , Joe Lou , Anirudh Jain , Mitchell Nahmias

The current learning process of deep learning, regardless of any deep neural network (DNN) architecture and/or learning algorithm used, is essentially a single resolution training. We explore multiresolution learning and show that…

机器学习 · 计算机科学 2023-09-29 Hongyan Zhou , Yao Liang

Deep neural networks (DNNs) fail to learn effectively under label noise and have been shown to memorize random labels which affect their generalization performance. We consider learning in isolation, using one-hot encoded labels as the sole…

计算机视觉与模式识别 · 计算机科学 2020-09-18 Fahad Sarfraz , Elahe Arani , Bahram Zonooz

While modern machine learning has transformed numerous application domains, its growing computational demands increasingly constrain scalability and efficiency, particularly on embedded and resource-limited platforms. In practice, neural…

机器学习 · 计算机科学 2025-10-30 Bernhard Klein

It has been demonstrated that deep neural networks are prone to noisy examples particular adversarial samples during inference process. The gap between robust deep learning systems in real world applications and vulnerable neural networks…

机器学习 · 计算机科学 2018-07-03 Xinhan Di , Pengqian Yu , Meng Tian

A trend towards energy-efficiency, security and privacy has led to a recent focus on deploying DNNs on microcontrollers. However, limits on compute and memory resources restrict the size and the complexity of the ML models deployable in…

机器学习 · 计算机科学 2020-10-19 Fernando García-Redondo , Shidhartha Das , Glen Rosendale