中文
相关论文

相关论文: Efficient Decoupled Neural Architecture Search by …

200 篇论文

The ability to rank candidate architectures is the key to the performance of neural architecture search~(NAS). One-shot NAS is proposed to reduce the expense but shows inferior performance against conventional NAS and is not adequately…

机器学习 · 计算机科学 2020-04-01 Renqian Luo , Tao Qin , Enhong Chen

Neural network (NN) models are increasingly used in scientific simulations, AI, and other high performance computing (HPC) fields to extract knowledge from datasets. Each dataset requires tailored NN model architecture, but designing…

Differentiable ARchiTecture Search (DARTS) is one of the most trending Neural Architecture Search (NAS) methods. It drastically reduces search cost by resorting to weight-sharing. However, it also dramatically reduces the search space, thus…

机器学习 · 计算机科学 2022-11-02 Alexandre Heuillet , Hedi Tabia , Hichem Arioui , Kamal Youcef-Toumi

In recent years, Deep Reinforcement Learning has made impressive advances in solving several important benchmark problems for sequential decision making. Many control applications use a generic multilayer perceptron (MLP) for non-vision…

机器学习 · 计算机科学 2020-03-13 Mario Srouji , Jian Zhang , Ruslan Salakhutdinov

Deep Neural Networks (DNNs) are intensively used to solve a wide variety of complex problems. Although powerful, such systems require manual configuration and tuning. To this end, we view DNNs as configurable systems and propose an…

机器学习 · 计算机科学 2019-04-10 Salah Ghamizi , Maxime Cordy , Mike Papadakis , Yves Le Traon

The time and effort involved in hand-designing deep neural networks is immense. This has prompted the development of Neural Architecture Search (NAS) techniques to automate this design. However, NAS algorithms tend to be slow and expensive;…

机器学习 · 计算机科学 2021-06-14 Joseph Mellor , Jack Turner , Amos Storkey , Elliot J. Crowley

Recent neural architecture search (NAS) based approaches have made great progress in hyperspectral image (HSI) classification tasks. However, the architectures are usually optimized independently of the network weights, increasing searching…

计算机视觉与模式识别 · 计算机科学 2023-04-25 Di Wang , Bo Du , Liangpei Zhang , Dacheng Tao

Recently, Neural Architecture Search has achieved great success in large-scale image classification. In contrast, there have been limited works focusing on architecture search for object detection, mainly because the costly ImageNet…

计算机视觉与模式识别 · 计算机科学 2019-09-06 Junran Peng , Ming Sun , Zhaoxiang Zhang , Tieniu Tan , Junjie Yan

Automatic neural architecture search techniques are becoming increasingly important in machine learning area. Especially, weight sharing methods have shown remarkable potentials on searching good network architectures with few computational…

计算机视觉与模式识别 · 计算机科学 2019-12-25 Muyuan Fang , Qiang Wang , Zhao Zhong

This paper reviews, analyzes, and proposes a new perspective on the bi-encoder architecture for neural search. While the bi-encoder architecture is widely used due to its simplicity and scalability at test time, it has some notable issues…

机器学习 · 计算机科学 2025-12-29 Hung-Nghiep Tran , Akiko Aizawa , Atsuhiro Takasu

Architecture search optimizes the structure of a neural network for some task instead of relying on manual authoring. However, it is slow, as each potential architecture is typically trained from scratch. In this paper we present an…

机器学习 · 计算机科学 2021-10-08 Mohan Singamsetti , Anmol Mahajan , Matthew Guzdial

Neural architecture search (NAS) aims to automatically design deep neural networks of satisfactory performance. Wherein, architecture performance predictor is critical to efficiently value an intermediate neural architecture. But for the…

计算机视觉与模式识别 · 计算机科学 2020-10-16 Yehui Tang , Yunhe Wang , Yixing Xu , Hanting Chen , Chunjing Xu , Boxin Shi , Chao Xu , Qi Tian , Chang Xu

Efficient spatial exploration is a key aspect of search and rescue. In this paper, we present a search algorithm that generates efficient trajectories that optimize the rate at which probability mass is covered by a searcher. This should…

机器人学 · 计算机科学 2019-06-18 Sandeep Manjanna , Herke van Hoof , Gregory Dudek

Graph neural architecture search has received a lot of attention as Graph Neural Networks (GNNs) has been successfully applied on the non-Euclidean data recently. However, exploring all possible GNNs architectures in the huge search space…

机器学习 · 计算机科学 2021-12-08 Jiamin Chen , Jianliang Gao , Yibo Chen , Oloulade Babatounde Moctard , Tengfei Lyu , Zhao Li

In this work, we propose a novel evolutionary algorithm for neural architecture search, applicable to global search spaces. The algorithm's architectural representation organizes the topology in multiple hierarchical modules, while the…

神经与进化计算 · 计算机科学 2023-05-05 Aristeidis Christoforidis , George Kyriakides , Konstantinos Margaritis

Neural Architecture Search (NAS) is a popular tool for automatically generating Neural Network (NN) architectures. In early NAS works, these tools typically optimized NN architectures for a single metric, such as accuracy. However, in the…

神经与进化计算 · 计算机科学 2023-04-05 Emil Njor , Jan Madsen , Xenofon Fafoutis

The automation of neural architecture design has been a coveted alternative to human experts. Recent works have small search space, which is easier to optimize but has a limited upper bound of the optimal solution. Extra human design is…

计算机视觉与模式识别 · 计算机科学 2021-08-19 Yuanzheng Ci , Chen Lin , Ming Sun , Boyu Chen , Hongwen Zhang , Wanli Ouyang

Early advancements in convolutional neural networks (CNNs) architectures are primarily driven by human expertise and by elaborate design processes. Recently, neural architecture search was proposed with the aim of automating the network…

计算机视觉与模式识别 · 计算机科学 2020-09-16 Zhichao Lu , Ian Whalen , Yashesh Dhebar , Kalyanmoy Deb , Erik Goodman , Wolfgang Banzhaf , Vishnu Naresh Boddeti

The multi-modal nature of many vision problems calls for neural network architectures that can perform multiple tasks concurrently. Typically, such architectures have been handcrafted in the literature. However, given the size and…

计算机视觉与模式识别 · 计算机科学 2021-05-12 David Bruggemann , Menelaos Kanakis , Stamatios Georgoulis , Luc Van Gool

In a recurrent setting, conventional approaches to neural architecture search find and fix a general model for all data samples and time steps. We propose a novel algorithm that can dynamically search for the structure of cells in a…

机器学习 · 计算机科学 2019-05-28 Xin Qian , Matthew Kennedy , Diego Klabjan