中文
相关论文

相关论文: MTL-NAS: Task-Agnostic Neural Architecture Search …

200 篇论文

Neural Architecture Search (NAS) aims to automatically find effective architectures within a predefined search space. However, the search space is often extremely large. As a result, directly searching in such a large search space is…

计算机视觉与模式识别 · 计算机科学 2024-06-07 Yaofo Chen , Yong Guo , Daihai Liao , Fanbing Lv , Hengjie Song , James Tin-Yau Kwok , Mingkui Tan

Neural Architecture Search (NAS) methods, which automatically learn entire neural model or individual neural cell architectures, have recently achieved competitive or state-of-the-art (SOTA) performance on variety of natural language…

计算与语言 · 计算机科学 2020-10-12 Ansel MacLaughlin , Jwala Dhamala , Anoop Kumar , Sriram Venkatapathy , Ragav Venkatesan , Rahul Gupta

Neural architecture search (NAS) searches architectures automatically for given tasks, e.g., image classification and language modeling. Improving the search efficiency and effectiveness have attracted increasing attention in recent years.…

机器学习 · 计算机科学 2020-01-03 Yao Shu , Wei Wang , Shaofeng Cai

Neural Architecture Search (NAS), i.e., the automation of neural network design, has gained much popularity in recent years with increasingly complex search algorithms being proposed. Yet, solid comparisons with simple baselines are often…

神经与进化计算 · 计算机科学 2020-07-28 T. Den Ottelander , A. Dushatskiy , M. Virgolin , P. A. N. Bosman

Prior neural architecture search (NAS) for adversarial robustness works have discovered that a lightweight and adversarially robust neural network architecture could exist in a non-robust large teacher network, generally disclosed by…

机器学习 · 计算机科学 2024-06-17 Dingrong Wang , Hitesh Sapkota , Zhiqiang Tao , Qi Yu

As we advance in the fast-growing era of Machine Learning, various new and more complex neural architectures are arising to tackle problem more efficiently. On the one hand their efficient usage requires advanced knowledge and expertise,…

机器学习 · 计算机科学 2023-10-30 Léo Pouy , Fouad Khenfri , Patrick Leserf , Chokri Mraidha , Cherif Larouci

Neural architecture search (NAS) has shown great promise in automatically designing lightweight models. However, conventional approaches are insufficient in training the supernet and pay little attention to actual robot hardware resources.…

机器人学 · 计算机科学 2025-09-26 Shouren Mao , Minghao Qin , Wei Dong , Huajian Liu , Yongzhuo Gao

Most of the previous approaches to Time Series Classification (TSC) highlight the significance of receptive fields and frequencies while overlooking the time resolution. Hence, unavoidably suffered from scalability issues as they integrated…

计算机视觉与模式识别 · 计算机科学 2024-02-22 Tue M. Cao , Nhat H. Tran , Hieu H. Pham , Hung T. Nguyen , Le P. Nguyen

Neural architecture search (NAS) methods aim to automatically find the optimal deep neural network (DNN) architecture as measured by a given objective function, typically some combination of task accuracy and inference efficiency. For many…

In this paper, we propose Efficient Progressive Neural Architecture Search (EPNAS), a neural architecture search (NAS) that efficiently handles large search space through a novel progressive search policy with performance prediction based…

机器学习 · 计算机科学 2019-07-11 Yanqi Zhou , Peng Wang , Sercan Arik , Haonan Yu , Syed Zawad , Feng Yan , Greg Diamos

Typically, deep learning architectures are handcrafted for their respective learning problem. As an alternative, neural architecture search (NAS) has been proposed where the architecture's structure is learned in an additional optimization…

图像与视频处理 · 电气工程与系统科学 2019-07-29 Nils Gessert , Alexander Schlaefer

Neural architecture search has shown its great potential in various areas recently. However, existing methods rely heavily on a black-box controller to search architectures, which suffers from the serious problem of lacking…

机器学习 · 计算机科学 2020-09-29 Xinyue Zheng , Peng Wang , Qigang Wang , Zhongchao Shi

One-Shot Neural Architecture Search (NAS) is a promising method to significantly reduce search time without any separate training. It can be treated as a Network Compression problem on the architecture parameters from an over-parameterized…

机器学习 · 计算机科学 2019-06-11 Hongpeng Zhou , Minghao Yang , Jun Wang , Wei Pan

To search an optimal sub-network within a general deep neural network (DNN), existing neural architecture search (NAS) methods typically rely on handcrafting a search space beforehand. Such requirements make it challenging to extend them…

机器学习 · 计算机科学 2023-10-09 Tianyi Chen , Luming Liang , Tianyu Ding , Ilya Zharkov

Recently, neural architecture search (NAS) has been applied to automatically search high-performance networks for medical image segmentation. The NAS search space usually contains a network topology level (controlling connections among…

计算机视觉与模式识别 · 计算机科学 2021-03-31 Yufan He , Dong Yang , Holger Roth , Can Zhao , Daguang Xu

With the fast evolvement of embedded deep-learning computing systems, applications powered by deep learning are moving from the cloud to the edge. When deploying neural networks (NNs) onto the devices under complex environments, there are…

信号处理 · 电气工程与系统科学 2021-04-13 Xuefei Ning , Guangjun Ge , Wenshuo Li , Zhenhua Zhu , Yin Zheng , Xiaoming Chen , Zhen Gao , Yu Wang , Huazhong Yang

This paper proposes a novel medical image segmentation framework, MNAS-Unet, which combines Monte Carlo Tree Search (MCTS) and Neural Architecture Search (NAS). MNAS-Unet dynamically explores promising network architectures through MCTS,…

计算机视觉与模式识别 · 计算机科学 2026-02-27 Liping Meng , Fan Nie , Yunyun Zhang , Chao Han

In recent years, neural architecture search (NAS) has received intensive scientific and industrial interest due to its capability of finding a neural architecture with high accuracy for various artificial intelligence tasks such as image…

机器学习 · 计算机科学 2021-01-18 Martin Ferianc , Hongxiang Fan , Miguel Rodrigues

We introduce the first Neural Architecture Search (NAS) method to find a better transformer architecture for image recognition. Recently, transformers without CNN-based backbones are found to achieve impressive performance for image…

计算机视觉与模式识别 · 计算机科学 2021-08-18 Boyu Chen , Peixia Li , Chuming Li , Baopu Li , Lei Bai , Chen Lin , Ming Sun , Junjie yan , Wanli Ouyang

Tree-structured multi-task architectures have been employed to jointly tackle multiple vision tasks in the context of multi-task learning (MTL). The major challenge is to determine where to branch out for each task given a backbone model to…

机器学习 · 计算机科学 2022-05-26 Lijun Zhang , Xiao Liu , Hui Guan