English
Related papers

Related papers: Building Optimal Neural Architectures using Interp…

200 papers

Recently, Neural Architecture Search (NAS) has successfully identified neural network architectures that exceed human designed ones on large-scale image classification. In this paper, we study NAS for semantic image segmentation. Existing…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Chenxi Liu , Liang-Chieh Chen , Florian Schroff , Hartwig Adam , Wei Hua , Alan Yuille , Li Fei-Fei

In this work we have extended AutoML inspired approaches to the exploration and optimization of neuromorphic architectures. Through the integration of a parallel asynchronous model-based search approach with a simulation framework to…

Neural and Evolutionary Computing · Computer Science 2023-02-28 Angel Yanguas-Gil , Sandeep Madireddy

Automatic search of neural architectures for various vision and natural language tasks is becoming a prominent tool as it allows to discover high-performing structures on any dataset of interest. Nevertheless, on more difficult domains,…

Computer Vision and Pattern Recognition · Computer Science 2020-05-25 Vladimir Nekrasov , Chunhua Shen , Ian Reid

In this work, we develop a neural architecture search algorithm, termed Resbuilder, that develops ResNet architectures from scratch that achieve high accuracy at moderate computational cost. It can also be used to modify existing…

Machine Learning · Computer Science 2023-08-17 Julian Burghoff , Matthias Rottmann , Jill von Conta , Sebastian Schoenen , Andreas Witte , Hanno Gottschalk

Efficient video architecture is the key to deploying video recognition systems on devices with limited computing resources. Unfortunately, existing video architectures are often computationally intensive and not suitable for such…

Computer Vision and Pattern Recognition · Computer Science 2021-12-10 Yifan Jiang , Xinyu Gong , Junru Wu , Humphrey Shi , Zhicheng Yan , Zhangyang Wang

In 3D shape recognition, multi-view based methods leverage human's perspective to analyze 3D shapes and have achieved significant outcomes. Most existing research works in deep learning adopt handcrafted networks as backbones due to their…

Computer Vision and Pattern Recognition · Computer Science 2020-12-11 Zhaoqun Li , Hongren Wang , Jinxing Li

Neural network-based semantic segmentation has achieved remarkable results when large amounts of annotated data are available, that is, in the supervised case. However, such data is expensive to collect and so methods have been developed to…

Computer Vision and Pattern Recognition · Computer Science 2021-06-25 Xueqing Deng , Yi Zhu , Yuxin Tian , Shawn Newsam

Design space exploration is an important but costly step involved in the design/deployment of custom architectures to squeeze out maximum possible performance and energy efficiency. Conventionally, optimizations require iterative sampling…

Machine Learning · Computer Science 2021-08-20 Ananda Samajdar , Jan Moritz Joseph , Matthew Denton , Tushar Krishna

Neural architecture search (NAS) aims to automatically design deep neural networks of satisfactory performance. Wherein, architecture performance predictor is critical to efficiently value an intermediate neural architecture. But for the…

Computer Vision and Pattern Recognition · Computer Science 2020-10-16 Yehui Tang , Yunhe Wang , Yixing Xu , Hanting Chen , Chunjing Xu , Boxin Shi , Chao Xu , Qi Tian , Chang Xu

Mappings to structured output spaces (strings, trees, partitions, etc.) are typically learned using extensions of classification algorithms to simple graphical structures (eg., linear chains) in which search and parameter estimation can be…

Machine Learning · Computer Science 2009-07-07 Hal Daumé , Daniel Marcu

The automation of neural architecture design has been a coveted alternative to human experts. Recent works have small search space, which is easier to optimize but has a limited upper bound of the optimal solution. Extra human design is…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Yuanzheng Ci , Chen Lin , Ming Sun , Boyu Chen , Hongwen Zhang , Wanli Ouyang

Neural architecture search has recently attracted lots of research efforts as it promises to automate the manual design of neural networks. However, it requires a large amount of computing resources and in order to alleviate this, a…

Machine Learning · Computer Science 2019-11-27 Alina Dubatovka , Efi Kokiopoulou , Luciano Sbaiz , Andrea Gesmundo , Gabor Bartok , Jesse Berent

We propose a vision-based architecture search algorithm for robot manipulation learning, which discovers interactions between low dimension action inputs and high dimensional visual inputs. Our approach automatically designs architectures…

Recently, Graph Neural Networks (GNNs) have gained popularity in a variety of real-world scenarios. Despite the great success, the architecture design of GNNs heavily relies on manual labor. Thus, automated graph neural network (AutoGNN)…

Machine Learning · Computer Science 2021-12-03 Zhili Wang , Shimin Di , Lei Chen

In recent years, deep neural networks have had great success in machine learning and pattern recognition. Architecture size for a neural network contributes significantly to the success of any neural network. In this study, we optimize the…

Machine Learning · Computer Science 2021-01-19 Yigit Alparslan , Ethan Jacob Moyer , Isamu Mclean Isozaki , Daniel Schwartz , Adam Dunlop , Shesh Dave , Edward Kim

The history of deep learning has shown that human-designed problem-specific networks can greatly improve the classification performance of general neural models. In most practical cases, however, choosing the optimal architecture for a…

Machine Learning · Computer Science 2020-09-14 Nicolo Colombo , Yang Gao

Existing neural network architectures in computer vision -- whether designed by humans or by machines -- were typically found using both images and their associated labels. In this paper, we ask the question: can we find high-quality neural…

Computer Vision and Pattern Recognition · Computer Science 2020-08-04 Chenxi Liu , Piotr Dollár , Kaiming He , Ross Girshick , Alan Yuille , Saining Xie

The standard paradigm in Neural Architecture Search (NAS) is to search for a fully deterministic architecture with specific operations and connections. In this work, we instead propose to search for the optimal operation distribution, thus…

Machine Learning · Computer Science 2021-11-09 Xingchen Wan , Binxin Ru , Pedro M. Esperança , Fabio M. Carlucci

Recent studies on automatic neural architectures search have demonstrated significant performance, competitive to or even better than hand-crafted neural architectures. However, most of the existing network architecture tend to use…

Machine Learning · Computer Science 2020-06-12 Peiye Liu , Bo Wu , Huadong Ma , Mingoo Seok

Neural architecture search (NAS) searches architectures automatically for given tasks, e.g., image classification and language modeling. Improving the search efficiency and effectiveness have attracted increasing attention in recent years.…

Machine Learning · Computer Science 2020-01-03 Yao Shu , Wei Wang , Shaofeng Cai