English
Related papers

Related papers: Retrieval-Augmented Convolutional Neural Networks …

200 papers

A counter-intuitive property of convolutional neural networks (CNNs) is their inherent susceptibility to adversarial examples, which severely hinders the application of CNNs in security-critical fields. Adversarial examples are similar to…

Machine Learning · Computer Science 2022-07-27 Jiebao Zhang , Wenhua Qian , Rencan Nie , Jinde Cao , Dan Xu

Mixtures of classifiers (a.k.a. randomized ensembles) have been proposed as a way to improve robustness against adversarial attacks. However, it has been shown that existing attacks are not well suited for this kind of classifiers. In this…

Machine Learning · Computer Science 2023-07-21 Lucas Gnecco Heredia , Benjamin Negrevergne , Yann Chevaleyre

Deep neural networks (DNNs) are shown to be vulnerable to adversarial examples. A well-trained model can be easily attacked by adding small perturbations to the original data. One of the hypotheses of the existence of the adversarial…

Machine Learning · Computer Science 2022-10-04 Jiancong Xiao , Liusha Yang , Yanbo Fan , Jue Wang , Zhi-Quan Luo

Deep neural networks continue to awe the world with their remarkable performance. Their predictions, however, are prone to be corrupted by adversarial examples that are imperceptible to humans. Current efforts to improve the robustness of…

Machine Learning · Computer Science 2021-08-11 Jisoo Mok , Byunggook Na , Hyeokjun Choe , Sungroh Yoon

Most deep neural networks are trained under fixed network architectures and require retraining when the architecture changes. If expanding the network's size is needed, it is necessary to retrain from scratch, which is expensive. To avoid…

Machine Learning · Computer Science 2023-11-09 Chau Pham , Piotr Teterwak , Soren Nelson , Bryan A. Plummer

Despite the significant advances in deep learning over the past decade, a major challenge that limits the wide-spread adoption of deep learning has been their fragility to adversarial attacks. This sensitivity to making erroneous…

Machine Learning · Computer Science 2021-06-21 Hossein Aboutalebi , Mohammad Javad Shafiee , Michelle Karg , Christian Scharfenberger , Alexander Wong

Convolutional neural networks (CNNs) are known for their good performance and generalization in vision-related tasks and have become state-of-the-art in both application and research-based domains. However, just like other neural network…

Machine Learning · Computer Science 2020-12-03 Mohammed Amer , Tomás Maul

Improving the generalization of deep networks is an important open challenge, particularly in domains without plentiful data. The mixup algorithm improves generalization by linearly interpolating a pair of examples and their corresponding…

Machine Learning · Computer Science 2022-10-13 Huaxiu Yao , Yiping Wang , Linjun Zhang , James Zou , Chelsea Finn

Large capacity deep learning models are often prone to a high generalization gap when trained with a limited amount of labeled training data. A recent class of methods to address this problem uses various ways to construct a new training…

Machine Learning · Computer Science 2023-01-10 Mojtaba Faramarzi , Mohammad Amini , Akilesh Badrinaaraayanan , Vikas Verma , Sarath Chandar

In practice, deep neural networks have been found to be vulnerable to various types of noise, such as adversarial examples and corruption. Various adversarial defense methods have accordingly been developed to improve adversarial robustness…

Machine Learning · Computer Science 2020-12-24 Aishan Liu , Xianglong Liu , Chongzhi Zhang , Hang Yu , Qiang Liu , Dacheng Tao

Deep neural networks have been shown to perform poorly on adversarial examples. To address this, several techniques have been proposed to increase robustness of a model for image classification tasks. However, in video understanding tasks,…

Computer Vision and Pattern Recognition · Computer Science 2021-10-28 Divya Choudhary , Palash Goyal , Saurabh Sahu

There has been great interest in enhancing the robustness of neural network classifiers to defend against adversarial perturbations through adversarial training, while balancing the trade-off between robust accuracy and standard accuracy.…

Machine Learning · Computer Science 2022-10-24 Chester Holtz , Tsui-Wei Weng , Gal Mishne

Human motion prediction aims to predict future 3D skeletal sequences by giving a limited human motion as inputs. Two popular methods, recurrent neural networks and feed-forward deep networks, are able to predict rough motion trend, but…

Computer Vision and Pattern Recognition · Computer Science 2020-11-25 Xianjin Chao , Yanrui Bin , Wenqing Chu , Xuan Cao , Yanhao Ge , Chengjie Wang , Jilin Li , Feiyue Huang , Howard Leung

Recent analysis of deep neural networks has revealed their vulnerability to carefully structured adversarial examples. Many effective algorithms exist to craft these adversarial examples, but performant defenses seem to be far away. In this…

Computer Vision and Pattern Recognition · Computer Science 2018-10-09 Neale Ratzlaff , Li Fuxin

Deep learning based approaches has achieved great performance in single image super-resolution (SISR). However, recent advances in efficient super-resolution focus on reducing the number of parameters and FLOPs, and they aggregate more…

Computer Vision and Pattern Recognition · Computer Science 2022-05-17 Fangyuan Kong , Mingxi Li , Songwei Liu , Ding Liu , Jingwen He , Yang Bai , Fangmin Chen , Lean Fu

With the emergence of large language models, such as LLaMA and OpenAI GPT-3, In-Context Learning (ICL) gained significant attention due to its effectiveness and efficiency. However, ICL is very sensitive to the choice, order, and verbaliser…

Computation and Language · Computer Science 2024-10-10 Simon Yu , Jie He , Pasquale Minervini , Jeff Z. Pan

In this work, we formulate a novel framework for adversarial robustness using the manifold hypothesis. This framework provides sufficient conditions for defending against adversarial examples. We develop an adversarial purification method…

Machine Learning · Computer Science 2023-12-22 Zhaoyuan Yang , Zhiwei Xu , Jing Zhang , Richard Hartley , Peter Tu

Mixup is a data-dependent regularization technique that consists in linearly interpolating input samples and associated outputs. It has been shown to improve accuracy when used to train on standard machine learning datasets. However,…

Machine Learning · Computer Science 2022-01-13 Raphael Baena , Lucas Drumetz , Vincent Gripon

Deep neural networks are susceptible to \emph{adversarial} attacks. In computer vision, well-crafted perturbations to images can cause neural networks to make mistakes such as confusing a cat with a computer. Previous adversarial attacks…

Machine Learning · Computer Science 2019-09-12 Gamaleldin F. Elsayed , Ian Goodfellow , Jascha Sohl-Dickstein

Despite the empirical success of neural architecture search (NAS) in deep learning applications, the optimality, reproducibility and cost of NAS schemes remain hard to assess. In this paper, we propose Generative Adversarial NAS (GA-NAS)…

Machine Learning · Computer Science 2021-06-24 Seyed Saeed Changiz Rezaei , Fred X. Han , Di Niu , Mohammad Salameh , Keith Mills , Shuo Lian , Wei Lu , Shangling Jui