中文
相关论文

相关论文: RBFleX-NAS: Training-Free Neural Architecture Sear…

200 篇论文

The term Neural Architecture Search (NAS) refers to the automatic optimization of network architectures for a new, previously unknown task. Since testing an architecture is computationally very expensive, many optimizers need days or even…

机器学习 · 计算机科学 2019-07-22 Martin Wistuba

The key challenge in neural architecture search (NAS) is designing how to explore wisely in the huge search space. We propose a new NAS method called TNAS (NAS with trees), which improves search efficiency by exploring only a small number…

人工智能 · 计算机科学 2022-04-12 Guocheng Qian , Xuanyang Zhang , Guohao Li , Chen Zhao , Yukang Chen , Xiangyu Zhang , Bernard Ghanem , Jian Sun

Neural Architecture Search (NAS) has emerged as a key tool in identifying optimal configurations of deep neural networks tailored to specific tasks. However, training and assessing numerous architectures introduces considerable…

机器学习 · 计算机科学 2024-04-25 Haoming Zhang , Ran Cheng

Neural Architectures Search (NAS) becomes more and more popular over these years. However, NAS-generated models tends to suffer greater vulnerability to various malicious attacks. Lots of robust NAS methods leverage adversarial training to…

机器学习 · 计算机科学 2023-04-11 Xunyu Zhu , Jian Li , Yong Liu , Weiping Wang

Neural Architecture Search (NAS) algorithms aim at finding efficient Deep Neural Network (DNN) architectures for a given application under given system constraints. DNNs are computationally-complex as well as vulnerable to adversarial…

Neural Architecture Search (NAS) for automatically finding the optimal network architecture has shown some success with competitive performances in various computer vision tasks. However, NAS in general requires a tremendous amount of…

计算机视觉与模式识别 · 计算机科学 2022-12-14 Bokyeung Lee , Kyungdeuk Ko , Jonghwan Hong , Hanseok Ko

Differentiable neural architecture search (DNAS) is known for its capacity in the automatic generation of superior neural networks. However, DNAS based methods suffer from memory usage explosion when the search space expands, which may…

机器学习 · 计算机科学 2021-09-14 Zheyu Yan , Weiwen Jiang , Xiaobo Sharon Hu , Yiyu Shi

Neural Architecture Search (NAS) aims to automate the discovery of high-performing deep neural network architectures. Traditional objective-based NAS approaches typically optimize a certain performance metric (e.g., prediction accuracy),…

神经与进化计算 · 计算机科学 2024-08-01 An Vo , Ngoc Hoang Luong

Deep Neural Networks (DNNs) have the potential for making various clinical procedures more time-efficient by automating medical image segmentation. Due to their strong, in some cases human-level, performance, they have become the standard…

图像与视频处理 · 电气工程与系统科学 2022-02-24 Martijn M. A. Bosma , Arkadiy Dushatskiy , Monika Grewal , Tanja Alderliesten , Peter A. N. Bosman

The success of deep neural networks relies on significant architecture engineering. Recently neural architecture search (NAS) has emerged as a promise to greatly reduce manual effort in network design by automatically searching for optimal…

计算机视觉与模式识别 · 计算机科学 2020-02-26 Ning Wang , Yang Gao , Hao Chen , Peng Wang , Zhi Tian , Chunhua Shen , Yanning Zhang

Neural Architecture Search (NAS) has been quite successful in constructing state-of-the-art models on a variety of tasks. Unfortunately, the computational cost can make it difficult to scale. In this paper, we make the first attempt to…

机器学习 · 计算机科学 2019-11-18 Albert Shaw , Wei Wei , Weiyang Liu , Le Song , Bo Dai

Neural Architecture Search (NAS) has proven effective in discovering new Convolutional Neural Network (CNN) architectures, particularly for scenarios with well-defined accuracy optimization goals. However, previous approaches often involve…

机器学习 · 计算机科学 2024-08-28 Ye Qiao , Haocheng Xu , Yifan Zhang , Sitao Huang

Current neural architecture search (NAS) strategies focus only on finding a single, good, architecture. They offer little insight into why a specific network is performing well, or how we should modify the architecture if we want further…

机器学习 · 计算机科学 2021-02-22 Binxin Ru , Xingchen Wan , Xiaowen Dong , Michael Osborne

Recently, Neural Architecture Search has achieved great success in large-scale image classification. In contrast, there have been limited works focusing on architecture search for object detection, mainly because the costly ImageNet…

计算机视觉与模式识别 · 计算机科学 2019-09-06 Junran Peng , Ming Sun , Zhaoxiang Zhang , Tieniu Tan , Junjie Yan

We propose Efficient Neural Architecture Search (ENAS), a fast and inexpensive approach for automatic model design. In ENAS, a controller learns to discover neural network architectures by searching for an optimal subgraph within a large…

机器学习 · 计算机科学 2018-02-13 Hieu Pham , Melody Y. Guan , Barret Zoph , Quoc V. Le , Jeff Dean

As the saying goes, "seeing is believing". However, with the development of digital face editing tools, we can no longer trust what we can see. Although face forgery detection has made promising progress, most current methods are designed…

计算机视觉与模式识别 · 计算机科学 2023-06-19 Xiao Jin , Xin-Yue Mu , Jing Xu

Multiplication is arguably the most cost-dominant operation in modern deep neural networks (DNNs), limiting their achievable efficiency and thus more extensive deployment in resource-constrained applications. To tackle this limitation,…

硬件体系结构 · 计算机科学 2022-12-20 Huihong Shi , Haoran You , Yang Zhao , Zhongfeng Wang , Yingyan Lin

We propose a novel hardware and software co-exploration framework for efficient neural architecture search (NAS). Different from existing hardware-aware NAS which assumes a fixed hardware design and explores the neural architecture search…

机器学习 · 计算机科学 2020-01-14 Weiwen Jiang , Lei Yang , Edwin Sha , Qingfeng Zhuge , Shouzhen Gu , Sakyasingha Dasgupta , Yiyu Shi , Jingtong Hu

Neural architecture search (NAS) is a promising technique to design efficient and high-performance deep neural networks (DNNs). As the performance requirements of ML applications grow continuously, the hardware accelerators start playing a…

计算机视觉与模式识别 · 计算机科学 2021-08-03 Guihong Li , Sumit K. Mandal , Umit Y. Ogras , Radu Marculescu

The choice of neural network features can have a large impact on both the accuracy and speed of the network. Despite the current industry shift towards large transformer models, specialized binary classifiers remain critical for numerous…

神经与进化计算 · 计算机科学 2025-03-17 Benjamin David Winter , William John Teahan