English
Related papers

Related papers: Multi-Objective Hardware Aware Neural Architecture…

200 papers

High-resolution representations (HR) are essential for dense prediction tasks such as segmentation, detection, and pose estimation. Learning HR representations is typically ignored in previous Neural Architecture Search (NAS) methods that…

Computer Vision and Pattern Recognition · Computer Science 2021-06-15 Mingyu Ding , Xiaochen Lian , Linjie Yang , Peng Wang , Xiaojie Jin , Zhiwu Lu , Ping Luo

Multiple object tracking is a critical task in autonomous driving. Existing works primarily focus on the heuristic design of neural networks to obtain high accuracy. As tracking accuracy improves, however, neural networks become…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Chensheng Peng , Zhaoyu Zeng , Jinling Gao , Jundong Zhou , Masayoshi Tomizuka , Xinbing Wang , Chenghu Zhou , Nanyang Ye

Graph neural networks (GNNs) have emerged as a popular strategy for handling non-Euclidean data due to their state-of-the-art performance. However, most of the current GNN model designs mainly focus on task accuracy, lacking in considering…

Machine Learning · Computer Science 2023-04-14 Ao Zhou , Jianlei Yang , Yingjie Qi , Yumeng Shi , Tong Qiao , Weisheng Zhao , Chunming Hu

Neural Architecture Search (NAS) has emerged as a powerful framework for automatically discovering neural architectures that balance accuracy and efficiency. However, as AI transitions from static benchmarks to real-world deployment, the…

Machine Learning · Computer Science 2026-05-07 Matteo Gambella , Fabrizio Pittorino , Manuel Roveri

Neural Architecture Search (NAS) effectively discovers new Convolutional Neural Network (CNN) architectures, particularly for accuracy optimization. However, prior approaches often require resource-intensive training on super networks or…

Machine Learning · Computer Science 2024-01-18 Ye Qiao , Haocheng Xu , Yifan Zhang , Sitao Huang

A fundamental question lies in almost every application of deep neural networks: what is the optimal neural architecture given a specific dataset? Recently, several Neural Architecture Search (NAS) frameworks have been developed that use…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-02-04 Weiwen Jiang , Xinyi Zhang , Edwin H. -M. Sha , Lei Yang , Qingfeng Zhuge , Yiyu Shi , Jingtong Hu

Deep neural networks have been found vulnerable to adversarial attacks, thus raising potentially concerns in security-sensitive contexts. To address this problem, recent research has investigated the adversarial robustness of deep neural…

Machine Learning · Computer Science 2022-07-13 Jia Liu , Ran Cheng , Yaochu Jin

Deep learning applications are being transferred from the cloud to edge with the rapid development of embedded computing systems. In order to achieve higher energy efficiency with the limited resource budget, neural networks(NNs) must be…

Machine Learning · Computer Science 2022-10-18 Hongjiang Chen , Yang Wang , Leibo Liu , Shaojun Wei , Shouyi Yin

Neural architecture search (NAS) is an attractive approach to automate the design of optimized architectures but is constrained by high computational budget, especially when optimizing for multiple, important conflicting objectives. To…

Machine Learning · Computer Science 2025-09-03 Zhao Wei , Chin Chun Ooi , Yew-Soon Ong

Network Architecture Search (NAS) methods have recently gathered much attention. They design networks with better performance and use a much shorter search time compared to traditional manual tuning. Despite their efficiency in model…

Machine Learning · Computer Science 2021-09-13 Yiren Zhao , Xitong Gao , Ilia Shumailov , Nicolo Fusi , Robert Mullins

A key problem in deep multi-attribute learning is to effectively discover the inter-attribute correlation structures. Typically, the conventional deep multi-attribute learning approaches follow the pipeline of manually designing the network…

Neural and Evolutionary Computing · Computer Science 2018-08-03 Siyu Huang , Xi Li , Zhi-Qi Cheng , Zhongfei Zhang , Alexander Hauptmann

Neural Architecture Search (NAS) is a popular tool for automatically generating Neural Network (NN) architectures. In early NAS works, these tools typically optimized NN architectures for a single metric, such as accuracy. However, in the…

Neural and Evolutionary Computing · Computer Science 2023-04-05 Emil Njor , Jan Madsen , Xenofon Fafoutis

Deploying models across diverse devices demands tradeoffs among multiple objectives due to different resource constraints. Arguably, due to the small model trap problem in multi-objective neural architecture search (MO-NAS) based on a…

Machine Learning · Computer Science 2024-07-19 Peng Liao , XiLu Wang , Yaochu Jin , WenLi Du

Recent advances in adversarial attacks show the vulnerability of deep neural networks searched by Neural Architecture Search (NAS). Although NAS methods can find network architectures with the state-of-the-art performance, the adversarial…

Machine Learning · Computer Science 2020-11-20 Zhixiong Yue , Baijiong Lin , Xiaonan Huang , Yu Zhang

In hardware-aware Differentiable Neural Architecture Search (DNAS), it is challenging to compute gradients of hardware metrics to perform architecture search. Existing works rely on linear approximations with limited support to customized…

Machine Learning · Computer Science 2021-11-25 Qian Jiang , Xiaofan Zhang , Deming Chen , Minh N. Do , Raymond A. Yeh

Differentiable architecture search is prevalent in the field of NAS because of its simplicity and efficiency, where two paradigms, multi-path algorithms and single-path methods, are dominated. Multi-path framework (e.g. DARTS) is intuitive…

Computer Vision and Pattern Recognition · Computer Science 2021-11-09 Haoxian Tan , Sheng Guo , Yujie Zhong , Matthew R. Scott , Weilin Huang

Differentiable architecture search has gradually become the mainstream research topic in the field of Neural Architecture Search (NAS) for its high efficiency compared with the early NAS methods. Recent differentiable NAS also aims at…

Machine Learning · Computer Science 2023-07-04 Bo Lyu , Shiping Wen

Neural Architecture Search (NAS) algorithms aim at finding efficient Deep Neural Network (DNN) architectures for a given application under given system constraints. DNNs are computationally-complex as well as vulnerable to adversarial…

Machine Learning · Computer Science 2025-10-23 Alberto Marchisio , Vojtech Mrazek , Andrea Massa , Beatrice Bussolino , Maurizio Martina , Muhammad Shafique

Neural architecture search (NAS) can have a significant impact in computer vision by automatically designing optimal neural network architectures for various tasks. A variant, binarized neural architecture search (BNAS), with a search space…

Computer Vision and Pattern Recognition · Computer Science 2020-02-12 Hanlin Chen , Li'an Zhuo , Baochang Zhang , Xiawu Zheng , Jianzhuang Liu , David Doermann , Rongrong Ji

Semantic segmentation of 3D medical images is a challenging task due to the high variability of the shape and pattern of objects (such as organs or tumors). Given the recent success of deep learning in medical image segmentation, Neural…

Image and Video Processing · Electrical Eng. & Systems 2022-03-25 Cheng Peng , Andriy Myronenko , Ali Hatamizadeh , Vish Nath , Md Mahfuzur Rahman Siddiquee , Yufan He , Daguang Xu , Rama Chellappa , Dong Yang