中文
相关论文

相关论文: Triple Wins: Boosting Accuracy, Robustness and Eff…

200 篇论文

Trajectory prediction using deep neural networks (DNNs) is an essential component of autonomous driving (AD) systems. However, these methods are vulnerable to adversarial attacks, leading to serious consequences such as collisions. In this…

机器学习 · 计算机科学 2022-08-02 Yulong Cao , Danfei Xu , Xinshuo Weng , Zhuoqing Mao , Anima Anandkumar , Chaowei Xiao , Marco Pavone

Despite their success, deep networks have been shown to be highly susceptible to perturbations, often causing significant drops in accuracy. In this paper, we investigate model robustness on perturbed inputs by studying the performance of…

计算机视觉与模式识别 · 计算机科学 2022-07-22 Yong Guo , David Stutz , Bernt Schiele

Deep convolutional neural networks, assisted by architectural design strategies, make extensive use of data augmentation techniques and layers with a high number of feature maps to embed object transformations. That is highly inefficient…

计算机视觉与模式识别 · 计算机科学 2021-12-21 Vittorio Mazzia , Francesco Salvetti , Marcello Chiaberge

While deep learning has led to remarkable results on a number of challenging problems, researchers have discovered a vulnerability of neural networks in adversarial settings, where small but carefully chosen perturbations to the input can…

神经与进化计算 · 计算机科学 2018-11-26 Edward Grefenstette , Robert Stanforth , Brendan O'Donoghue , Jonathan Uesato , Grzegorz Swirszcz , Pushmeet Kohli

Despite remarkable achievements in deep learning across various domains, its inherent vulnerability to adversarial examples still remains a critical concern for practical deployment. Adversarial training has emerged as one of the most…

机器学习 · 计算机科学 2024-11-06 Junhao Dong , Xinghua Qu , Z. Jane Wang , Yew-Soon Ong

Adversarial attacks exploit vulnerabilities in a model's decision boundaries through small, carefully crafted perturbations that lead to significant mispredictions. In 3D vision, the high dimensionality and sparsity of data greatly expand…

计算机视觉与模式识别 · 计算机科学 2024-09-20 Nastaran Darabi , Dinithi Jayasuriya , Devashri Naik , Theja Tulabandhula , Amit Ranjan Trivedi

Alongside the well-publicized accomplishments of deep neural networks there has emerged an apparent bug in their success on tasks such as object recognition: with deep models trained using vanilla methods, input images can be slightly…

机器学习 · 计算机科学 2021-03-04 Jacob Abernethy , Pranjal Awasthi , Satyen Kale

Derivative training is an established method that can significantly increase the accuracy of neural networks in certain low-dimensional tasks. In this paper, we extend this improvement to an illustrative image analysis problem:…

机器学习 · 计算机科学 2025-02-04 Vsevolod I. Avrutskiy

Dynamic DNN optimization techniques such as layer-skipping offer increased adaptability and efficiency gains but can lead to i) a larger memory footprint as in decision gates, ii) increased training complexity (e.g., with non-differentiable…

机器学习 · 计算机科学 2025-05-26 Guilherme Korol , Antonio Carlos Schneider Beck , Jeronimo Castrillon

Deep neural networks (DNNs) are increasingly used in real-world applications (e.g. facial recognition). This has resulted in concerns about the fairness of decisions made by these models. Various notions and measures of fairness have been…

机器学习 · 计算机科学 2021-01-22 Vedant Nanda , Samuel Dooley , Sahil Singla , Soheil Feizi , John P. Dickerson

The last decade has witnessed the breakthrough of deep neural networks (DNNs) in many fields. With the increasing depth of DNNs, hundreds of millions of multiply-and-accumulate (MAC) operations need to be executed. To accelerate such…

硬件体系结构 · 计算机科学 2022-11-29 Amro Eldebiky , Grace Li Zhang , Georg Boecherer , Bing Li , Ulf Schlichtmann

For semantic segmentation of remote sensing images (RSI), trade-off between representation power and location accuracy is quite important. How to get the trade-off effectively is an open question,where current approaches of utilizing very…

计算机视觉与模式识别 · 计算机科学 2022-04-04 Shuang He , Xia Lu , Jason Gu , Haitong Tang , Qin Yu , Kaiyue Liu , Haozhou Ding , Chunqi Chang , Nizhuan Wang

While modern machine learning has transformed numerous application domains, its growing computational demands increasingly constrain scalability and efficiency, particularly on embedded and resource-limited platforms. In practice, neural…

机器学习 · 计算机科学 2025-10-30 Bernhard Klein

With the successful application of deep learning models in many real-world tasks, the model robustness becomes more and more critical. Often, we evaluate the robustness of the deep models by attacking them with purposely generated…

机器学习 · 计算机科学 2020-12-21 Jinyin Chen , Zhen Wang , Haibin Zheng , Jun Xiao , Zhaoyan Ming

From an engineering perspective, a design should not only perform well in an ideal condition, but should also resist noises. Such a design methodology, namely robust design, has been widely implemented in the industry for product quality…

机器学习 · 计算机科学 2021-12-09 Jia-Qi Yang , Ke-Bin Fan , Hao Ma , De-Chuan Zhan

Deep networks are well-known to be fragile to adversarial attacks. We conduct an empirical analysis of deep representations under the state-of-the-art attack method called PGD, and find that the attack causes the internal representation to…

机器学习 · 计算机科学 2019-10-29 Chengzhi Mao , Ziyuan Zhong , Junfeng Yang , Carl Vondrick , Baishakhi Ray

Deep neural networks are easily misled by adversarial examples. Although lots of defense methods are proposed, many of them are demonstrated to lose effectiveness when against properly performed adaptive attacks. How to evaluate the…

密码学与安全 · 计算机科学 2021-01-08 Pengfei Xia , Ziqiang Li , Hongjing Niu , Bin Li

In this paper, we propose a novel algorithm for energy-efficient, low-latency, accurate inference at the wireless edge, in the context of 6G networks endowed with reconfigurable intelligent surfaces (RISs). We consider a scenario where new…

Regression neural networks (NNs) are most commonly trained by minimizing the mean squared prediction error, which is highly sensitive to outliers and data contamination. Existing robust training methods for regression NNs are often limited…

机器学习 · 统计学 2026-02-10 Abhik Ghosh , Suryasis Jana

Built on top of self-attention mechanisms, vision transformers have demonstrated remarkable performance on a variety of vision tasks recently. While achieving excellent performance, they still require relatively intensive computational cost…

计算机视觉与模式识别 · 计算机科学 2021-12-01 Lingchen Meng , Hengduo Li , Bor-Chun Chen , Shiyi Lan , Zuxuan Wu , Yu-Gang Jiang , Ser-Nam Lim