中文
相关论文

相关论文: Triple Wins: Boosting Accuracy, Robustness and Eff…

200 篇论文

While additional training data improves the robustness of deep neural networks against adversarial examples, it presents the challenge of curating a large number of specific real-world samples. We circumvent this challenge by using…

机器学习 · 计算机科学 2022-03-04 Vikash Sehwag , Saeed Mahloujifar , Tinashe Handina , Sihui Dai , Chong Xiang , Mung Chiang , Prateek Mittal

Ensembling a neural network is a widely recognized approach to enhance model performance, estimate uncertainty, and improve robustness in deep supervised learning. However, deep ensembles often come with high computational costs and memory…

Background: When using deep learning models, there are many possible vulnerabilities and some of the most worrying are the adversarial inputs, which can cause wrong decisions with minor perturbations. Therefore, it becomes necessary to…

软件工程 · 计算机科学 2024-01-12 Francisco Durán López , Silverio Martínez-Fernández , Michael Felderer , Xavier Franch

We investigate the topics of sensitivity and robustness in feedforward and convolutional neural networks. Combining energy landscape techniques developed in computational chemistry with tools drawn from formal methods, we produce empirical…

机器学习 · 统计学 2018-12-06 Timothy E. Wang , Yiming Gu , Dhagash Mehta , Xiaojun Zhao , Edgar A. Bernal

We propose a robust elastic net (REN) model for high-dimensional sparse regression and give its performance guarantees (both the statistical error bound and the optimization bound). A simple idea of trimming the inner product is applied to…

机器学习 · 计算机科学 2016-05-03 Weiyang Liu , Rongmei Lin , Meng Yang

Increasing the model capacity is a known approach to enhance the adversarial robustness of deep learning networks. On the other hand, various model compression techniques, including pruning and quantization, can reduce the size of the…

机器学习 · 计算机科学 2023-11-28 Svetlana Pavlitska , Hannes Grolig , J. Marius Zöllner

Recent years have seen the ever-increasing importance of pre-trained models and their downstream training in deep learning research and applications. At the same time, the defense for adversarial examples has been mainly investigated in the…

机器学习 · 计算机科学 2023-03-21 Ziquan Liu , Yi Xu , Xiangyang Ji , Antoni B. Chan

Successful adoption of deep learning (DL) in the wild requires models to be: (1) compact, (2) accurate, and (3) robust to distributional shifts. Unfortunately, efforts towards simultaneously meeting these requirements have mostly been…

机器学习 · 计算机科学 2021-11-09 James Diffenderfer , Brian R. Bartoldson , Shreya Chaganti , Jize Zhang , Bhavya Kailkhura

Deep neural networks are vulnerable to so-called adversarial examples: inputs which are intentionally constructed to cause the model to make incorrect predictions or classifications. Adversarial examples are often visually indistinguishable…

机器学习 · 计算机科学 2024-05-28 Jonathan Peck , Bart Goossens

"Effective robustness" measures the extra out-of-distribution (OOD) robustness beyond what can be predicted from the in-distribution (ID) performance. Existing effective robustness evaluations typically use a single test set such as…

机器学习 · 计算机科学 2023-10-31 Zhouxing Shi , Nicholas Carlini , Ananth Balashankar , Ludwig Schmidt , Cho-Jui Hsieh , Alex Beutel , Yao Qin

Adversarial attacks and defenses are currently active areas of research for the deep learning community. A recent review paper divided the defense approaches into three categories; gradient masking, robust optimization, and adversarial…

机器学习 · 计算机科学 2019-10-24 Leslie N. Smith

Vulnerability to adversarial attacks is a well-known weakness of Deep Neural networks. While most of the studies focus on single-task neural networks with computer vision datasets, very little research has considered complex multi-task…

机器学习 · 计算机科学 2021-10-29 Salah Ghamizi , Maxime Cordy , Mike Papadakis , Yves Le Traon

As deep learning applications, especially programs of computer vision, are increasingly deployed in our lives, we have to think more urgently about the security of these applications.One effective way to improve the security of deep…

计算机视觉与模式识别 · 计算机科学 2022-06-02 Xiao Tan , Jingbo Gao , Ruolin Li

While deep learning has resulted in major breakthroughs in many application domains, the frameworks commonly used in deep learning remain fragile to artificially-crafted and imperceptible changes in the data. In response to this fragility,…

机器学习 · 计算机科学 2020-11-03 Alexander Robey , Hamed Hassani , George J. Pappas

This paper explores the intricate relationship between interpretability and robustness in deep learning models. Despite their remarkable performance across various tasks, deep learning models often exhibit critical vulnerabilities,…

机器学习 · 计算机科学 2024-12-30 Navid Nayyem , Abdullah Rakin , Longwei Wang

Modern deep neural networks are powerful and widely applicable models that extract task-relevant information through multi-level abstraction. Their cross-domain success, however, is often achieved at the expense of computational cost, high…

计算机视觉与模式识别 · 计算机科学 2020-07-31 Wenhan Xia , Hongxu Yin , Xiaoliang Dai , Niraj K. Jha

In this paper, we aim to understand and explain the decisions of deep neural networks by studying the behavior of predicted attributes when adversarial examples are introduced. We study the changes in attributes for clean as well as…

计算机视觉与模式识别 · 计算机科学 2019-10-17 Sadaf Gulshad , Zeynep Akata , Jan Hendrik Metzen , Arnold Smeulders

The deployment of deep neural networks in real-world applications is mostly restricted by their high inference costs. Extensive efforts have been made to improve the accuracy with expert-designed or algorithm-searched architectures.…

机器学习 · 计算机科学 2020-11-10 Shaofeng Cai , Yao Shu , Wei Wang , Beng Chin Ooi

Convolutional and Recurrent, deep neural networks have been successful in machine learning systems for computer vision, reinforcement learning, and other allied fields. However, the robustness of such neural networks is seldom apprised,…

神经与进化计算 · 计算机科学 2018-05-01 Biswa Sengupta , Karl J. Friston

Non-adversarial robustness, also known as natural robustness, is a property of deep learning models that enables them to maintain performance even when faced with distribution shifts caused by natural variations in data. However, achieving…

机器学习 · 计算机科学 2023-05-25 Gorana Gojić , Vladimir Vincan , Ognjen Kundačina , Dragiša Mišković , Dinu Dragan