English
Related papers

Related papers: Efficient Architecture Search via Bi-level Data Pr…

200 papers

In this paper, we propose a Shapley value based method to evaluate operation contribution (Shapley-NAS) for neural architecture search. Differentiable architecture search (DARTS) acquires the optimal architectures by optimizing the…

Machine Learning · Computer Science 2022-06-22 Han Xiao , Ziwei Wang , Zheng Zhu , Jie Zhou , Jiwen Lu

Neural Architecture Search (NAS) has gained attraction due to superior classification performance. Differential Architecture Search (DARTS) is a computationally light method. To limit computational resources DARTS makes numerous…

Computer Vision and Pattern Recognition · Computer Science 2020-11-17 Muhammad Suhaib Tanveer , Muhammad Umar Karim Khan , Chong-Min Kyung

In recent years, neural architecture search (NAS) methods have been proposed for the automatic generation of task-oriented network architecture in image classification. However, the architectures obtained by existing NAS approaches are…

Computer Vision and Pattern Recognition · Computer Science 2021-03-24 Haichao Zhang , Kuangrong Hao , Lei Gao , Xuesong Tang , Bing Wei

Neural Architecture Search has attracted increasing attention in recent years. Among them, differential NAS approaches such as DARTS, have gained popularity for the search efficiency. However, they still suffer from three main issues, that…

Machine Learning · Computer Science 2023-01-18 Peng Ye , Tong He , Baopu Li , Tao Chen , Lei Bai , Wanli Ouyang

Neural Architecture Search (NAS) has attracted growing interest. To reduce the search cost, recent work has explored weight sharing across models and made major progress in One-Shot NAS. However, it has been observed that a model with…

Computer Vision and Pattern Recognition · Computer Science 2021-12-17 Xin Xia , Xuefeng Xiao , Xing Wang , Min Zheng

AI technology has made remarkable achievements in computational pathology (CPath), especially with the help of deep neural networks. However, the network performance is highly related to architecture design, which commonly requires human…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Sheyang Tang , Mahdi S. Hosseini , Lina Chen , Sonal Varma , Corwyn Rowsell , Savvas Damaskinos , Konstantinos N. Plataniotis , Zhou Wang

Neural Architecture Search (NAS) aims to automatically find effective architectures within a predefined search space. However, the search space is often extremely large. As a result, directly searching in such a large search space is…

Computer Vision and Pattern Recognition · Computer Science 2024-06-07 Yaofo Chen , Yong Guo , Daihai Liao , Fanbing Lv , Hengjie Song , James Tin-Yau Kwok , Mingkui Tan

Differentiable architecture search (DARTS) yields highly efficient gradient-based neural architecture search (NAS) by relaxing the discrete operation selection to optimize continuous architecture parameters that maps NAS from the discrete…

Machine Learning · Computer Science 2023-06-13 Jiuling Zhang , Zhiming Ding

The recurrent mechanism has recently been introduced into U-Net in various medical image segmentation tasks. Existing studies have focused on promoting network recursion via reusing building blocks. Although network parameters could be…

Image and Video Processing · Electrical Eng. & Systems 2021-07-02 Xinyi Wang , Tiange Xiang , Chaoyi Zhang , Yang Song , Dongnan Liu , Heng Huang , Weidong Cai

Improving search efficiency serves as one of the crucial objectives of Neural Architecture Search (NAS). However, many current approaches ignore the universality of the search strategy and fail to reduce the computational redundancy during…

Computer Vision and Pattern Recognition · Computer Science 2024-08-05 Danpei Zhao , Zhuoran Liu , Bo Yuan

Neural Architecture Search (NAS) has emerged as one of the effective methods to design the optimal neural network architecture automatically. Although neural architectures have achieved human-level performances in several tasks, few of them…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Caiyang Yu , Xianggen Liu , Yifan Wang , Yun Liu , Wentao Feng , Deng Xiong , Chenwei Tang , Jiancheng Lv

Differentiable ARchiTecture Search, i.e., DARTS, has drawn great attention in neural architecture search. It tries to find the optimal architecture in a shallow search network and then measures its performance in a deep evaluation network.…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Hongyuan Yu , Houwen Peng , Yan Huang , Jianlong Fu , Hao Du , Liang Wang , Haibin Ling

We present the first differentiable Network Architecture Search (NAS) for Graph Neural Networks (GNNs). GNNs show promising performance on a wide range of tasks, but require a large amount of architecture engineering. First, graphs are…

Machine Learning · Computer Science 2020-03-24 Yiren Zhao , Duo Wang , Xitong Gao , Robert Mullins , Pietro Lio , Mateja Jamnik

Data-driven, automatic design space exploration of neural accelerator architecture is desirable for specialization and productivity. Previous frameworks focus on sizing the numerical architectural hyper-parameters while neglect searching…

Machine Learning · Computer Science 2021-05-28 Yujun Lin , Mengtian Yang , Song Han

We present LDP, a lightweight dense prediction neural architecture search (NAS) framework. Starting from a pre-defined generic backbone, LDP applies the novel Assisted Tabu Search for efficient architecture exploration. LDP is fast and…

Computer Vision and Pattern Recognition · Computer Science 2022-03-10 Lam Huynh , Esa Rahtu , Jiri Matas , Janne Heikkila

In the past few years, neural architecture search (NAS) has become an increasingly important tool within the deep learning community. Despite the many recent successes of NAS, however, most existing approaches operate within highly…

Machine Learning · Computer Science 2022-11-14 Charles Jin , Phitchaya Mangpo Phothilimthana , Sudip Roy

Simplicity is the ultimate sophistication. Differentiable Architecture Search (DARTS) has now become one of the mainstream paradigms of neural architecture search. However, it largely suffers from the well-known performance collapse issue…

Machine Learning · Computer Science 2021-10-19 Xiangxiang Chu , Bo Zhang

This paper addresses the scalability challenge of architecture search by formulating the task in a differentiable manner. Unlike conventional approaches of applying evolution or reinforcement learning over a discrete and non-differentiable…

Machine Learning · Computer Science 2019-04-24 Hanxiao Liu , Karen Simonyan , Yiming Yang

Deep neural networks (DNNs) have shown superior performances on various multimodal learning problems. However, it often requires huge efforts to adapt DNNs to individual multimodal tasks by manually engineering unimodal features and…

Computer Vision and Pattern Recognition · Computer Science 2022-01-04 Yihang Yin , Siyu Huang , Xiang Zhang

Neural Architecture Search~(NAS) has attracted increasingly more attention in recent years because of its capability to design deep neural networks automatically. Among them, differential NAS approaches such as DARTS, have gained popularity…

Machine Learning · Computer Science 2022-03-07 Peng Ye , Baopu Li , Yikang Li , Tao Chen , Jiayuan Fan , Wanli Ouyang