中文
相关论文

相关论文: HMCNAS: Neural Architecture Search using Hidden Ma…

200 篇论文

Realistic use of neural networks often requires adhering to multiple constraints on latency, energy and memory among others. A popular approach to find fitting networks is through constrained Neural Architecture Search (NAS), however,…

机器学习 · 计算机科学 2021-02-24 Niv Nayman , Yonathan Aflalo , Asaf Noy , Lihi Zelnik-Manor

Current Neural Architecture Search techniques can suffer from a few shortcomings, including high computational cost, excessive bias from the search space, conceptual complexity or uncertain empirical benefits over random search. In this…

神经与进化计算 · 计算机科学 2020-10-26 Luc Frachon , Wei Pang , George M. Coghill

The discovery of neural architectures from simple building blocks is a long-standing goal of Neural Architecture Search (NAS). Hierarchical search spaces are a promising step towards this goal but lack a unifying search space design…

机器学习 · 计算机科学 2023-12-11 Simon Schrodi , Danny Stoll , Binxin Ru , Rhea Sukthanker , Thomas Brox , Frank Hutter

In neural architecture search (NAS), the space of neural network architectures is automatically explored to maximize predictive accuracy for a given task. Despite the success of recent approaches, most existing methods cannot be directly…

机器学习 · 统计学 2019-02-15 Francesco Paolo Casale , Jonathan Gordon , Nicolo Fusi

Deep Neural networks are efficient and flexible models that perform well for a variety of tasks such as image, speech recognition and natural language understanding. In particular, convolutional neural networks (CNN) generate a keen…

机器学习 · 计算机科学 2018-12-20 Yesmina Jaafra , Jean Luc Laurent , Aline Deruyver , Mohamed Saber Naceur

Graph neural networks (GNNs) have been successfully applied to learning representation on graphs in many relational tasks. Recently, researchers study neural architecture search (NAS) to reduce the dependence of human expertise and explore…

机器学习 · 计算机科学 2021-09-06 Shaofei Cai , Liang Li , Xinzhe Han , Zheng-jun Zha , Qingming Huang

Neural Architecture Search (NAS) has been quite successful in constructing state-of-the-art models on a variety of tasks. Unfortunately, the computational cost can make it difficult to scale. In this paper, we make the first attempt to…

机器学习 · 计算机科学 2019-11-18 Albert Shaw , Wei Wei , Weiyang Liu , Le Song , Bo Dai

One-Shot Neural Architecture Search (NAS) is a promising method to significantly reduce search time without any separate training. It can be treated as a Network Compression problem on the architecture parameters from an over-parameterized…

机器学习 · 计算机科学 2019-06-11 Hongpeng Zhou , Minghao Yang , Jun Wang , Wei Pan

The automated machine learning (AutoML) field has become increasingly relevant in recent years. These algorithms can develop models without the need for expert knowledge, facilitating the application of machine learning techniques in the…

机器学习 · 计算机科学 2022-12-14 Andrea Falanti , Eugenio Lomurno , Danilo Ardagna , Matteo Matteucci

In this paper, we propose Efficient Progressive Neural Architecture Search (EPNAS), a neural architecture search (NAS) that efficiently handles large search space through a novel progressive search policy with performance prediction based…

机器学习 · 计算机科学 2019-07-11 Yanqi Zhou , Peng Wang , Sercan Arik , Haonan Yu , Syed Zawad , Feng Yan , Greg Diamos

The automation of neural architecture design has been a coveted alternative to human experts. Recent works have small search space, which is easier to optimize but has a limited upper bound of the optimal solution. Extra human design is…

计算机视觉与模式识别 · 计算机科学 2021-08-19 Yuanzheng Ci , Chen Lin , Ming Sun , Boyu Chen , Hongwen Zhang , Wanli Ouyang

Neural Architecture Search (NAS) is quickly becoming the go-to approach to optimize the structure of Deep Learning (DL) models for complex tasks such as Image Classification or Object Detection. However, many other relevant applications of…

Neural Architecture Search aims at automatically finding neural architectures that are competitive with architectures designed by human experts. While recent approaches have achieved state-of-the-art predictive performance for image…

机器学习 · 统计学 2019-02-27 Thomas Elsken , Jan Hendrik Metzen , Frank Hutter

While evolutionary computation is well suited for automatic discovery in engineering, it can also be used to gain insight into how humans and organizations could perform more effectively. Using a real-world problem of innovation search in…

神经与进化计算 · 计算机科学 2023-07-04 Erkin Bahceci , Riitta Katila , Risto Miikkulainen

In this paper, we present a general and effective framework for Neural Architecture Search (NAS), named PredNAS. The motivation is that given a differentiable performance estimation function, we can directly optimize the architecture…

计算机视觉与模式识别 · 计算机科学 2022-10-27 Liuchun Yuan , Zehao Huang , Naiyan Wang

Graph Neural Networks (GNNs) have been popularly used for analyzing non-Euclidean data such as social network data and biological data. Despite their success, the design of graph neural networks requires a lot of manual work and domain…

机器学习 · 计算机科学 2020-11-03 Yang Gao , Hong Yang , Peng Zhang , Chuan Zhou , Yue Hu

Neural Architecture Search (NAS) has demonstrated state-of-the-art performance on various computer vision tasks. Despite the superior performance achieved, the efficiency and generality of existing methods are highly valued due to their…

计算机视觉与模式识别 · 计算机科学 2023-03-13 Xiawu Zheng , Chenyi Yang , Shaokun Zhang , Yan Wang , Baochang Zhang , Yongjian Wu , Yunsheng Wu , Ling Shao , Rongrong Ji

Designing convolutional neural networks (CNN) for mobile devices is challenging because mobile models need to be small and fast, yet still accurate. Although significant efforts have been dedicated to design and improve mobile CNNs on all…

计算机视觉与模式识别 · 计算机科学 2019-05-30 Mingxing Tan , Bo Chen , Ruoming Pang , Vijay Vasudevan , Mark Sandler , Andrew Howard , Quoc V. Le

Convolutional Neural Networks (CNNs) continue to achieve great success in classification tasks as innovative techniques and complex multi-path architecture topologies are introduced. Neural Architecture Search (NAS) aims to automate the…

神经与进化计算 · 计算机科学 2023-12-14 Trevor Londt , Xiaoying Gao , Peter Andreae , Yi Mei

Binary Convolutional Neural Networks (CNNs) have significantly reduced the number of arithmetic operations and the size of memory storage needed for CNNs, which makes their deployment on mobile and embedded systems more feasible. However,…

计算机视觉与模式识别 · 计算机科学 2020-08-11 Baozhou Zhu , Zaid Al-Ars , Peter Hofstee