English
Related papers

Related papers: RC-DARTS: Resource Constrained Differentiable Arch…

200 papers

Network architecture search (NAS), in particular the differentiable architecture search (DARTS) method, has shown a great power to learn excellent model architectures on the specific dataset of interest. In contrast to using a fixed…

Computer Vision and Pattern Recognition · Computer Science 2022-09-22 Xuhong Ren , Jianlang Chen , Felix Juefei-Xu , Wanli Xue , Qing Guo , Lei Ma , Jianjun Zhao , Shengyong Chen

State-of-the-art automatic speech recognition (ASR) system development is data and computation intensive. The optimal design of deep neural networks (DNNs) for these systems often require expert knowledge and empirical evaluation. In this…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-30 Shoukang Hu , Xurong Xie , Mingyu Cui , Jiajun Deng , Shansong Liu , Jianwei Yu , Mengzhe Geng , Xunying Liu , Helen Meng

Recently, there has been a growing interest in automating the process of neural architecture design, and the Differentiable Architecture Search (DARTS) method makes the process available within a few GPU days. However, the performance of…

Computer Vision and Pattern Recognition · Computer Science 2020-10-21 Hanwen Liang , Shifeng Zhang , Jiacheng Sun , Xingqiu He , Weiran Huang , Kechen Zhuang , Zhenguo Li

The rapidly evolving field of Artificial Intelligence necessitates automated approaches to co-design neural network architecture and neural accelerators to maximize system efficiency and address productivity challenges. To enable joint…

In the era of data proliferation, efficiently sifting through vast information to extract meaningful insights has become increasingly crucial. This paper addresses the computational overhead and resource inefficiency prevalent in existing…

Information Retrieval · Computer Science 2024-12-20 Sheng Zhang , Maolin Wang , Yao Zhao , Chenyi Zhuang , Jinjie Gu , Ruocheng Guo , Xiangyu Zhao , Zijian Zhang , Hongzhi Yin

AI technology has made remarkable achievements in computational pathology (CPath), especially with the help of deep neural networks. However, the network performance is highly related to architecture design, which commonly requires human…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Sheyang Tang , Mahdi S. Hosseini , Lina Chen , Sonal Varma , Corwyn Rowsell , Savvas Damaskinos , Konstantinos N. Plataniotis , Zhou Wang

Neural architecture search (NAS) approaches aim at automatically finding novel CNN architectures that fit computational constraints while maintaining a good performance on the target platform. We introduce a novel efficient one-shot NAS…

Computer Vision and Pattern Recognition · Computer Science 2020-05-22 Maxim Berman , Leonid Pishchulin , Ning Xu , Matthew B. Blaschko , Gerard Medioni

This work introduces improvements to the stability and generalizability of Cyclic DARTS (CDARTS). CDARTS is a Differentiable Architecture Search (DARTS)-based approach to neural architecture search (NAS) that uses a cyclic feedback…

Machine Learning · Computer Science 2023-09-06 Emily Herron , Derek Rose , Steven Young

Existing Neural Architecture Search (NAS) methods either encode neural architectures using discrete encodings that do not scale well, or adopt supervised learning-based methods to jointly learn architecture representations and optimize…

Computer Vision and Pattern Recognition · Computer Science 2020-10-27 Shen Yan , Yu Zheng , Wei Ao , Xiao Zeng , Mi Zhang

In one-shot NAS, sub-networks need to be searched from the supernet to meet different hardware constraints. However, the search cost is high and $N$ times of searches are needed for $N$ different constraints. In this work, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2021-03-15 Sian-Yao Huang , Wei-Ta Chu

The deployment of Deep Neural Networks (DNNs) on edge devices is hindered by the substantial gap between performance requirements and available processing power. While recent research has made significant strides in developing pruning…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Hamid Mousavi , Mohammad Loni , Mina Alibeigi , Masoud Daneshtalab

The algorithms of one-shot neural architecture search(NAS) have been widely used to reduce computation consumption. However, because of the interference among the subnets in which weights are shared, the subnets inherited from these…

Computer Vision and Pattern Recognition · Computer Science 2022-06-15 Jiawei Liu , Kaiyu Zhang , Weitai Hu , Qing Yang

Neural architecture search (NAS) proves to be among the best approaches for many tasks by generating an application-adaptive neural architecture, which is still challenged by high computational cost and memory consumption. At the same time,…

Computer Vision and Pattern Recognition · Computer Science 2020-05-19 Li'an Zhuo , Baochang Zhang , Hanlin Chen , Linlin Yang , Chen Chen , Yanjun Zhu , David Doermann

Neural architecture search (NAS) has become increasingly popular in the deep learning community recently, mainly because it can provide an opportunity to allow interested users without rich expertise to benefit from the success of deep…

Machine Learning · Computer Science 2022-10-25 Shiqing Liu , Haoyu Zhang , Yaochu Jin

Recent state-of-the-art methods for neural architecture search (NAS) exploit gradient-based optimization by relaxing the problem into continuous optimization over architectures and shared-weights, a noisy process that remains poorly…

Machine Learning · Computer Science 2021-03-19 Liam Li , Mikhail Khodak , Maria-Florina Balcan , Ameet Talwalkar

Deep neural networks (DNNs) based automatic speech recognition (ASR) systems are often designed using expert knowledge and empirical evaluation. In this paper, a range of neural architecture search (NAS) techniques are used to automatically…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-09 Shoukang Hu , Xurong Xie , Shansong Liu , Mingyu Cui , Mengzhe Geng , Xunying Liu , Helen Meng

Neural architecture search (NAS), an important branch of automatic machine learning, has become an effective approach to automate the design of deep learning models. However, the major issue in NAS is how to reduce the large search time…

Machine Learning · Computer Science 2021-07-15 Jae-hun Shim , Kyeongbo Kong , Suk-Ju Kang

Neural architecture search has shown its great potential in various areas recently. However, existing methods rely heavily on a black-box controller to search architectures, which suffers from the serious problem of lacking…

Machine Learning · Computer Science 2020-09-29 Xinyue Zheng , Peng Wang , Qigang Wang , Zhongchao Shi

Neural Architecture Search (NAS) for automatically finding the optimal network architecture has shown some success with competitive performances in various computer vision tasks. However, NAS in general requires a tremendous amount of…

Computer Vision and Pattern Recognition · Computer Science 2022-12-14 Bokyeung Lee , Kyungdeuk Ko , Jonghwan Hong , Hanseok Ko

This paper proposes Binary ArchitecTure Search (BATS), a framework that drastically reduces the accuracy gap between binary neural networks and their real-valued counterparts by means of Neural Architecture Search (NAS). We show that…

Computer Vision and Pattern Recognition · Computer Science 2020-07-27 Adrian Bulat , Brais Martinez , Georgios Tzimiropoulos
‹ Prev 1 8 9 10 Next ›