English
Related papers

Related papers: DARTS-PRIME: Regularization and Scheduling Improve…

200 papers

Accurately segmenting temporal frames of cine magnetic resonance imaging (MRI) is a crucial step in various real-time MRI guided cardiac interventions. To achieve fast and accurate visual assistance, there are strict requirements on the…

Image and Video Processing · Electrical Eng. & Systems 2022-06-14 Qing Lu , Xiaowei Xu , Shunjie Dong , Cong Hao , Lei Yang , Cheng Zhuo , Yiyu Shi

The rapid proliferation of computing domains relying on Internet of Things (IoT) devices has created a pressing need for efficient and accurate deep-learning (DL) models that can run on low-power devices. However, traditional DL models tend…

Neural Architecture Search (NAS) has garnered significant research interest due to its capability to discover architectures superior to manually designed ones. Learning text representation is crucial for text classification and other…

Neural Architecture Search (NAS) has attracted growing interest. To reduce the search cost, recent work has explored weight sharing across models and made major progress in One-Shot NAS. However, it has been observed that a model with…

Computer Vision and Pattern Recognition · Computer Science 2021-12-17 Xin Xia , Xuefeng Xiao , Xing Wang , Min Zheng

Differentiable ARchiTecture Search (DARTS) has attracted much attention due to its simplicity and significant improvement in efficiency. However, the excessive accumulation of the skip connection, when training epochs become large, makes it…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Chao Li , Jia Ning , Han Hu , Kun He

Neural Architecture Search (NAS) algorithms automate the task of finding optimal deep learning architectures given an initial search space of possible operations. Developing these search spaces is usually a manual affair with pre-optimized…

Machine Learning · Computer Science 2021-11-08 Robert Wu , Nayan Saxena , Rohan Jain

Realistic use of neural networks often requires adhering to multiple constraints on latency, energy and memory among others. A popular approach to find fitting networks is through constrained Neural Architecture Search (NAS), however,…

Machine Learning · Computer Science 2021-02-24 Niv Nayman , Yonathan Aflalo , Asaf Noy , Lihi Zelnik-Manor

Neural architecture search (NAS) has been successfully applied to tasks like image classification and language modeling for finding efficient high-performance network architectures. In ASR field especially end-to-end ASR, the related…

Sound · Computer Science 2021-08-11 Xian Shi , Pan Zhou , Wei Chen , Lei Xie

Single Image Super-Resolution (SISR) tasks have achieved significant performance with deep neural networks. However, the large number of parameters in CNN-based met-hods for SISR tasks require heavy computations. Although several efficient…

Image and Video Processing · Electrical Eng. & Systems 2022-12-20 Han Huang , Li Shen , Chaoyang He , Weisheng Dong , Wei Liu

Differentiable Architecture Search (DARTS) provides a baseline for searching effective network architectures based gradient, but it is accompanied by huge computational overhead in searching and training network architecture. Recently, many…

Machine Learning · Computer Science 2020-10-19 Zhaowen Wang , Wei Zhang , Zhiming Wang

Neural Architecture Search (NAS) has emerged as one of the effective methods to design the optimal neural network architecture automatically. Although neural architectures have achieved human-level performances in several tasks, few of them…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Caiyang Yu , Xianggen Liu , Yifan Wang , Yun Liu , Wentao Feng , Deng Xiong , Chenwei Tang , Jiancheng Lv

Neural Architecture Search (NAS) has emerged as a powerful approach for automating neural network design. However, existing NAS methods face critical limitations in real-world deployments: architectures lack adaptability across scenarios,…

Machine Learning · Computer Science 2025-08-29 Maolin Wang , Tianshuo Wei , Sheng Zhang , Ruocheng Guo , Wanyu Wang , Shanshan Ye , Lixin Zou , Xuetao Wei , Xiangyu Zhao

Morphologically complex languages, particularly multiscript Indian languages, present significant challenges for Natural Language Processing (NLP). This work introduces MorphNAS, a novel differentiable neural architecture search framework…

Computation and Language · Computer Science 2025-08-25 Prathamesh Devadiga , Omkaar Jayadev Shetty , Hiya Nachnani , Prema R

Convolutional neural networks (CNNs) have shown good performance in polarimetric synthetic aperture radar (PolSAR) image classification due to the automation of feature engineering. Excellent hand-crafted architectures of CNNs incorporated…

Computer Vision and Pattern Recognition · Computer Science 2020-12-16 Hongwei Dong , Siyu Zhang , Bin Zou , Lamei Zhang

Differentiable neural architecture search (DNAS) is known for its capacity in the automatic generation of superior neural networks. However, DNAS based methods suffer from memory usage explosion when the search space expands, which may…

Machine Learning · Computer Science 2021-09-14 Zheyu Yan , Weiwen Jiang , Xiaobo Sharon Hu , Yiyu Shi

How to benefit from plenty of existing denoising designs? Few methods via Neural Architecture Search (NAS) intend to answer this question. However, these NAS-based denoising methods explore limited search space and are hard to extend in…

Image and Video Processing · Electrical Eng. & Systems 2025-02-20 Zheyu Zhang , Yueyi Zhang , Xiaoyan sun

With the flourish of differentiable neural architecture search (NAS), automatically searching latency-constrained architectures gives a new perspective to reduce human labor and expertise. However, the searched architectures are usually…

Computer Vision and Pattern Recognition · Computer Science 2020-08-13 Yibo Hu , Xiang Wu , Ran He

This paper proposes Binary ArchitecTure Search (BATS), a framework that drastically reduces the accuracy gap between binary neural networks and their real-valued counterparts by means of Neural Architecture Search (NAS). We show that…

Computer Vision and Pattern Recognition · Computer Science 2020-07-27 Adrian Bulat , Brais Martinez , Georgios Tzimiropoulos

Gradient-based one-shot neural architecture search (NAS) has significantly reduced the cost of exploring architectural spaces with discrete design choices, such as selecting operations within a model. However, the field faces two major…

Machine Learning · Computer Science 2025-07-23 Abhash Kumar Jha , Shakiba Moradian , Arjun Krishnakumar , Martin Rapp , Frank Hutter

Neural Architecture Search (NAS) algorithms are intended to remove the burden of manual neural network design, and have shown to be capable of designing excellent models for a variety of well-known problems. However, these algorithms…

Machine Learning · Computer Science 2022-04-21 Rob Geada , Andrew Stephen McGough