English
Related papers

Related papers: Discovering Robust Convolutional Architecture at T…

200 papers

Neural Architecture Search (NAS) has shown great potentials in finding better neural network designs. Sample-based NAS is the most reliable approach which aims at exploring the search space and evaluating the most promising architectures.…

Machine Learning · Computer Science 2020-11-26 Han Shi , Renjie Pi , Hang Xu , Zhenguo Li , James T. Kwok , Tong Zhang

Adversarial Training is the most effective approach for improving the robustness of Deep Neural Networks (DNNs). However, compared to the large body of research in optimizing the adversarial training process, there are few investigations…

Computer Vision and Pattern Recognition · Computer Science 2023-01-10 ShengYun Peng , Weilin Xu , Cory Cornelius , Kevin Li , Rahul Duggal , Duen Horng Chau , Jason Martin

Artificial neural network (NN) architecture design is a nontrivial and time-consuming task that often requires a high level of human expertise. Neural architecture search (NAS) serves to automate the design of NN architectures and has…

Neural and Evolutionary Computing · Computer Science 2024-09-10 Reinhard Booysen , Anna Sergeevna Bosman

Neural architecture search (NAS) enables finding the best-performing architecture from a search space automatically. Most NAS methods exploit an over-parameterized network (i.e., a supernet) containing all possible architectures (i.e.,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Youngmin Oh , Hyunju Lee , Bumsub Ham

Convolutional neural network (CNN) architectures have traditionally been explored by human experts in a manual search process that is time-consuming and ineffectively explores the massive space of potential solutions. Neural architecture…

Neural and Evolutionary Computing · Computer Science 2019-04-02 Gerard Jacques van Wyk , Anna Sergeevna Bosman

Reinforcement learning (RL)-based neural architecture search (NAS) generally guarantees better convergence yet suffers from the requirement of huge computational resources compared with gradient-based approaches, due to the rollout…

Machine Learning · Computer Science 2021-05-28 Jihao Liu , Ming Zhang , Yangting Sun , Boxiao Liu , Guanglu Song , Yu Liu , Hongsheng Li

Adversarial robustness of deep learning models has gained much traction in the last few years. Various attacks and defenses are proposed to improve the adversarial robustness of modern-day deep learning architectures. While all these…

Machine Learning · Computer Science 2021-08-27 Chaitanya Devaguptapu , Devansh Agarwal , Gaurav Mittal , Pulkit Gopalani , Vineeth N Balasubramanian

Compute In-Memory platforms such as memristive crossbars are gaining focus as they facilitate acceleration of Deep Neural Networks (DNNs) with high area and compute-efficiencies. However, the intrinsic non-idealities associated with the…

Machine Learning · Computer Science 2023-04-18 Abhiroop Bhattacharjee , Abhishek Moitra , Priyadarshini Panda

Neural Architecture Search (NAS) is an important yet challenging task in network design due to its high computational consumption. To address this issue, we propose the Reinforced Evolutionary Neural Architecture Search (RE- NAS), which is…

Neural and Evolutionary Computing · Computer Science 2019-04-11 Yukang Chen , Gaofeng Meng , Qian Zhang , Shiming Xiang , Chang Huang , Lisen Mu , Xinggang Wang

Deep neural networks (DNNs) are vulnerable to adversarial noises, which motivates the benchmark of model robustness. Existing benchmarks mainly focus on evaluating defenses, but there are no comprehensive studies of how architecture design…

Computer Vision and Pattern Recognition · Computer Science 2022-01-17 Shiyu Tang , Ruihao Gong , Yan Wang , Aishan Liu , Jiakai Wang , Xinyun Chen , Fengwei Yu , Xianglong Liu , Dawn Song , Alan Yuille , Philip H. S. Torr , Dacheng Tao

Recent developments in neural architecture search (NAS) emphasize the significance of considering robust architectures against malicious data. However, there is a notable absence of benchmark evaluations and theoretical guarantees for…

Machine Learning · Computer Science 2024-03-21 Yongtao Wu , Fanghui Liu , Carl-Johann Simon-Gabriel , Grigorios G Chrysos , Volkan Cevher

In the past few years, neural architecture search (NAS) has become an increasingly important tool within the deep learning community. Despite the many recent successes of NAS, however, most existing approaches operate within highly…

Machine Learning · Computer Science 2022-11-14 Charles Jin , Phitchaya Mangpo Phothilimthana , Sudip Roy

Resource is an important constraint when deploying Deep Neural Networks (DNNs) on mobile and edge devices. Existing works commonly adopt the cell-based search approach, which limits the flexibility of network patterns in learned cell…

Machine Learning · Computer Science 2020-03-04 Tunhou Zhang , Hsin-Pai Cheng , Zhenwen Li , Feng Yan , Chengyu Huang , Hai Li , Yiran Chen

Though Convolutional Neural Networks (CNNs) have surpassed human-level performance on tasks such as object classification and face verification, they can easily be fooled by adversarial attacks. These attacks add a small perturbation to the…

Machine Learning · Computer Science 2018-03-26 Rajeev Ranjan , Swami Sankaranarayanan , Carlos D. Castillo , Rama Chellappa

The robustness of deep neural networks (DNN) models has attracted increasing attention due to the urgent need for security in many applications. Numerous existing open-sourced tools or platforms are developed to evaluate the robustness of…

Machine Learning · Computer Science 2023-01-18 Jialiang Sun , Wen Yao , Tingsong Jiang , Chao Li , Xiaoqian Chen

Neural architecture search (NAS) approaches aim at automatically finding novel CNN architectures that fit computational constraints while maintaining a good performance on the target platform. We introduce a novel efficient one-shot NAS…

Computer Vision and Pattern Recognition · Computer Science 2020-05-22 Maxim Berman , Leonid Pishchulin , Ning Xu , Matthew B. Blaschko , Gerard Medioni

Many existing deep learning models are vulnerable to adversarial examples that are imperceptible to humans. To address this issue, various methods have been proposed to design network architectures that are robust to one particular type of…

Machine Learning · Computer Science 2021-01-19 Jia Liu , Yaochu Jin

Recent studies on neural architecture search have shown that automatically designed neural networks perform as good as expert-crafted architectures. While most existing works aim at finding architectures that optimize the prediction…

As the application area of convolutional neural networks (CNN) is growing in embedded devices, it becomes popular to use a hardware CNN accelerator, called neural processing unit (NPU), to achieve higher performance per watt than CPUs or…

Machine Learning · Computer Science 2020-09-07 Jaeseong Lee , Duseok Kang , Soonhoi Ha

Capsule Networks (CapsNets) are able to hierarchically preserve the pose relationships between multiple objects for image classification tasks. Other than achieving high accuracy, another relevant factor in deploying CapsNets in…

Machine Learning · Computer Science 2023-04-26 Alberto Marchisio , Antonio De Marco , Alessio Colucci , Maurizio Martina , Muhammad Shafique