English
Related papers

Related papers: Revisiting Long-Tailed Learning: Insights from an …

200 papers

Despite its high search efficiency, differential architecture search (DARTS) often selects network architectures with dominated skip connections which lead to performance degradation. However, theoretical understandings on this issue remain…

Machine Learning · Computer Science 2020-10-13 Pan Zhou , Caiming Xiong , Richard Socher , Steven C. H. Hoi

Networks found with Neural Architecture Search (NAS) achieve state-of-the-art performance in a variety of tasks, out-performing human-designed networks. However, most NAS methods heavily rely on human-defined assumptions that constrain the…

Computer Vision and Pattern Recognition · Computer Science 2023-01-10 Vasco Lopes , Luís A. Alexandre

Differentiable Architecture Search (DARTS) has attracted a lot of attention due to its simplicity and small search costs achieved by a continuous relaxation and an approximation of the resulting bi-level optimization problem. However, DARTS…

Machine Learning · Computer Science 2020-01-29 Arber Zela , Thomas Elsken , Tonmoy Saikia , Yassine Marrakchi , Thomas Brox , Frank Hutter

In the past decade, advances in deep learning have resulted in breakthroughs in a variety of areas, including computer vision, natural language understanding, speech recognition, and reinforcement learning. Specialized, high-performing…

Machine Learning · Computer Science 2023-01-26 Colin White , Mahmoud Safari , Rhea Sukthanker , Binxin Ru , Thomas Elsken , Arber Zela , Debadeepta Dey , Frank Hutter

Recently, Neural Architecture Search has achieved great success in large-scale image classification. In contrast, there have been limited works focusing on architecture search for object detection, mainly because the costly ImageNet…

Computer Vision and Pattern Recognition · Computer Science 2019-09-06 Junran Peng , Ming Sun , Zhaoxiang Zhang , Tieniu Tan , Junjie Yan

Differentiable Neural Architecture Search (NAS) provides efficient, gradient-based methods for automatically designing neural networks, yet its adoption remains limited in practice. We present MIDAS, a novel approach that modernizes DARTS…

Machine Learning · Computer Science 2026-02-23 Konstanty Subbotko

Differentiable Neural Architecture Search (DARTS) is becoming more and more popular among Neural Architecture Search (NAS) methods because of its high search efficiency and low compute cost. However, the stability of DARTS is very inferior,…

Computer Vision and Pattern Recognition · Computer Science 2023-02-14 Xunyu Zhu , Jian Li , Yong Liu , Weiping Wang

This paper proposes Binary ArchitecTure Search (BATS), a framework that drastically reduces the accuracy gap between binary neural networks and their real-valued counterparts by means of Neural Architecture Search (NAS). We show that…

Computer Vision and Pattern Recognition · Computer Science 2020-07-27 Adrian Bulat , Brais Martinez , Georgios Tzimiropoulos

Recent research works establish deep neural networks as high performing tools for radar target detection, especially on challenging environments (presence of clutter or interferences, multi-target scenarii...). However, the usually large…

Signal Processing · Electrical Eng. & Systems 2025-06-30 Noé Lallouet , Tristan Cazenave , Cyrille Enderli , Stéphanie Gourdin

Neural Architecture Search (NAS) has become the de fecto tools in the industry in automating the design of deep neural networks for various applications, especially those driven by mobile and edge devices with limited computing resources.…

Machine Learning · Computer Science 2024-02-13 Ruiyang Qin , Yuting Hu , Zheyu Yan , Jinjun Xiong , Ahmed Abbasi , Yiyu Shi

Various hand-designed CNN architectures have been developed, such as VGG, ResNet, DenseNet, etc., and achieve State-of-the-Art (SoTA) levels on different tasks. Neural Architecture Search (NAS) now focuses on automatically finding the best…

Computer Vision and Pattern Recognition · Computer Science 2023-05-10 Yu-Ming Zhang , Jun-Wei Hsieh , Chun-Chieh Lee , Kuo-Chin Fan

Evolutionary computation (EC)-based neural architecture search (NAS) has achieved remarkable performance in the automatic design of neural architectures. However, the high computational cost associated with evaluating searched architectures…

Neural and Evolutionary Computing · Computer Science 2025-05-01 Yangyang Li , Guanlong Liu , Ronghua Shang , Licheng Jiao

Neural architecture search (NAS) typically consists of three main steps: training a super-network, training and evaluating sampled deep neural networks (DNNs), and training the discovered DNN. Most of the existing efforts speed up some…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Tien-Ju Yang , Yi-Lun Liao , Vivienne Sze

Differentiable Architecture Search (DARTS) is an efficient Neural Architecture Search (NAS) method but suffers from robustness, generalization, and discrepancy issues. Many efforts have been made towards the performance collapse issue…

Neural and Evolutionary Computing · Computer Science 2025-04-24 Yanlin Zhou , Mostafa El-Khamy , Kee-Bong Song

Neural Architecture Search (NAS) is increasingly popular to automatically explore the accuracy versus computational complexity trade-off of Deep Learning (DL) architectures. When targeting tiny edge devices, the main challenge for DL…

Machine Learning · Computer Science 2023-01-26 Matteo Risso , Alessio Burrello , Luca Benini , Enrico Macii , Massimo Poncino , Daniele Jahier Pagliari

Recently proposed neural architecture search (NAS) methods co-train billions of architectures in a supernet and estimate their potential accuracy using the network weights detached from the supernet. However, the ranking correlation between…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Jiefeng Peng , Jiqi Zhang , Changlin Li , Guangrun Wang , Xiaodan Liang , Liang Lin

Despite the significant advances achieved in Artificial Neural Networks (ANNs), their design process remains notoriously tedious, depending primarily on intuition, experience and trial-and-error. This human-dependent process is often…

Artificial Intelligence · Computer Science 2025-02-20 Mohamed Shahawy , Elhadj Benkhelifa , David White

The Neural Architecture Search (NAS) problem is typically formulated as a graph search problem where the goal is to learn the optimal operations over edges in order to maximise a graph-level global objective. Due to the large architecture…

Computer Vision and Pattern Recognition · Computer Science 2023-01-13 Vasco Lopes , Fabio Maria Carlucci , Pedro M Esperança , Marco Singh , Victor Gabillon , Antoine Yang , Hang Xu , Zewei Chen , Jun Wang

The ability to rank candidate architectures is the key to the performance of neural architecture search~(NAS). One-shot NAS is proposed to reduce the expense but shows inferior performance against conventional NAS and is not adequately…

Machine Learning · Computer Science 2020-04-01 Renqian Luo , Tao Qin , Enhong Chen

Deep neural networks have recently drawn considerable attention to build and evaluate artificial learning models for perceptual tasks. Here, we present a study on the performance of the deep learning models to deal with global optimization…

Neural and Evolutionary Computing · Computer Science 2020-12-18 Hojjat Rakhshani , Lhassane Idoumghar , Soheila Ghambari , Julien Lepagnot , Mathieu Brévilliers