English
Related papers

Related papers: UNAS: Differentiable Architecture Search Meets Rei…

200 papers

We propose Efficient Neural Architecture Search (ENAS), a fast and inexpensive approach for automatic model design. In ENAS, a controller learns to discover neural network architectures by searching for an optimal subgraph within a large…

Machine Learning · Computer Science 2018-02-13 Hieu Pham , Melody Y. Guan , Barret Zoph , Quoc V. Le , Jeff Dean

Automated neural network design has received ever-increasing attention with the evolution of deep convolutional neural networks (CNNs), especially involving their deployment on embedded and mobile platforms. One of the biggest problems that…

Machine Learning · Computer Science 2021-03-04 Qingbei Guo , Xiao-Jun Wu , Josef Kittler , Zhiquan Feng

Deep Neural Networks (DNNs) have the potential for making various clinical procedures more time-efficient by automating medical image segmentation. Due to their strong, in some cases human-level, performance, they have become the standard…

Image and Video Processing · Electrical Eng. & Systems 2022-02-24 Martijn M. A. Bosma , Arkadiy Dushatskiy , Monika Grewal , Tanja Alderliesten , Peter A. N. Bosman

Designing domain specific neural networks is a time-consuming, error-prone, and expensive task. Neural Architecture Search (NAS) exists to simplify domain-specific model development but there is a gap in the literature for time series…

Machine Learning · Computer Science 2024-02-06 Tobias King , Yexu Zhou , Tobias Röddiger , Michael Beigl

Differentiable Neural Architecture Search (DNAS) has demonstrated great success in designing state-of-the-art, efficient neural networks. However, DARTS-based DNAS's search space is small when compared to other search methods', since all…

Computer Vision and Pattern Recognition · Computer Science 2020-04-14 Alvin Wan , Xiaoliang Dai , Peizhao Zhang , Zijian He , Yuandong Tian , Saining Xie , Bichen Wu , Matthew Yu , Tao Xu , Kan Chen , Peter Vajda , Joseph E. Gonzalez

Neural Architecture Search (NAS) paves the way for the automatic definition of Neural Network (NN) architectures, attracting increasing research attention and offering solutions in various scenarios. This study introduces a novel NAS…

Machine Learning · Computer Science 2025-01-29 Matteo Gambella , Fabrizio Pittorino , Manuel Roveri

Neural architecture search (NAS) has a great impact by automatically designing effective neural network architectures. However, the prohibitive computational demand of conventional NAS algorithms (e.g. $10^4$ GPU hours) makes it difficult…

Machine Learning · Computer Science 2019-02-26 Han Cai , Ligeng Zhu , Song Han

Edge computing aims to enable edge devices, such as IoT devices, to process data locally instead of relying on the cloud. However, deep learning techniques like computer vision and natural language processing can be computationally…

Computer Vision and Pattern Recognition · Computer Science 2023-07-11 Oshin Dutta , Tanu Kanvar , Sumeet Agarwal

Recent advancements in artificial intelligence (AI) have positioned deep learning (DL) as a pivotal technology in fields like computer vision, data mining, and natural language processing. A critical factor in DL performance is the…

Machine Learning · Computer Science 2024-06-26 Jiaming Yan

As progress is made on training machine learning models on incrementally expanding classification tasks (i.e., incremental learning), a next step is to translate this progress to industry expectations. One technique missing from incremental…

Machine Learning · Computer Science 2022-05-23 James Seale Smith , Zachary Seymour , Han-Pang Chiu

Neural architecture search (NAS) recently attracts much research attention because of its ability to identify better architectures than handcrafted ones. However, many NAS methods, which optimize the search process in a discrete search…

Machine Learning · Computer Science 2019-11-22 Quanming Yao , Ju Xu , Wei-Wei Tu , Zhanxing Zhu

Neural architecture search (NAS) has gained immense popularity owing to its ability to automate neural architecture design. A number of training-free metrics are recently proposed to realize NAS without training, hence making NAS more…

Machine Learning · Computer Science 2022-10-13 Yao Shu , Zhongxiang Dai , Zhaoxuan Wu , Bryan Kian Hsiang Low

The significant computational cost of multiplications hinders the deployment of deep neural networks (DNNs) on edge devices. While multiplication-free models offer enhanced hardware efficiency, they typically sacrifice accuracy. As a…

Machine Learning · Computer Science 2024-09-10 Yang Xu , Huihong Shi , Zhongfeng Wang

The rapidly evolving field of Artificial Intelligence necessitates automated approaches to co-design neural network architecture and neural accelerators to maximize system efficiency and address productivity challenges. To enable joint…

Deep learning has revolutionized computer vision, but it achieved its tremendous success using deep network architectures which are mostly hand-crafted and therefore likely suboptimal. Neural Architecture Search (NAS) aims to bridge this…

Computer Vision and Pattern Recognition · Computer Science 2025-02-10 Ondřej Týbl , Lukáš Neumann

Differentiable Neural Architecture Search (NAS) provides efficient, gradient-based methods for automatically designing neural networks, yet its adoption remains limited in practice. We present MIDAS, a novel approach that modernizes DARTS…

Machine Learning · Computer Science 2026-02-23 Konstanty Subbotko

Neural architecture search (NAS) is a promising research direction that has the potential to replace expert-designed networks with learned, task-specific architectures. In this work, in order to help ground the empirical results in this…

Machine Learning · Computer Science 2019-08-01 Liam Li , Ameet Talwalkar

Typically, deep learning architectures are handcrafted for their respective learning problem. As an alternative, neural architecture search (NAS) has been proposed where the architecture's structure is learned in an additional optimization…

Image and Video Processing · Electrical Eng. & Systems 2019-07-29 Nils Gessert , Alexander Schlaefer

The success of deep learning in recent years has lead to a rising demand for neural network architecture engineering. As a consequence, neural architecture search (NAS), which aims at automatically designing neural network architectures in…

Computer Vision and Pattern Recognition · Computer Science 2022-02-16 Thomas Elsken , Arber Zela , Jan Hendrik Metzen , Benedikt Staffler , Thomas Brox , Abhinav Valada , Frank Hutter

Neural Architecture Search (NAS), i.e., the automation of neural network design, has gained much popularity in recent years with increasingly complex search algorithms being proposed. Yet, solid comparisons with simple baselines are often…

Neural and Evolutionary Computing · Computer Science 2020-07-28 T. Den Ottelander , A. Dushatskiy , M. Virgolin , P. A. N. Bosman
‹ Prev 1 3 4 5 6 7 10 Next ›