English
Related papers

Related papers: Hierarchical Representations for Efficient Archite…

200 papers

It has been widely recognized that the performance of a multi-agent system is highly affected by its organization. A large scale system may have billions of possible ways of organization, which makes it impractical to find an optimal choice…

Multiagent Systems · Computer Science 2014-11-25 Zhiqi Shen , Ling Yu , Han Yu

The automation of feature extraction of machine learning has been successfully realized by the explosive development of deep learning. However, the structures and hyperparameters of deep neural network architectures also make huge…

Machine Learning · Computer Science 2024-10-01 Wenzhu Shao

Neural structure search (NAS), as the mainstream approach to automate deep neural architecture design, has achieved much success in recent years. However, the performance estimation component adhering to NAS is often prohibitively costly,…

Machine Learning · Computer Science 2022-04-27 Zixuan Liang , Yanan Sun

Deep learning has made breakthroughs and substantial in many fields due to its powerful automatic representation capabilities. It has been proven that neural architecture design is crucial to the feature representation of data and the final…

Machine Learning · Computer Science 2021-03-03 Pengzhen Ren , Yun Xiao , Xiaojun Chang , Po-Yao Huang , Zhihui Li , Xiaojiang Chen , Xin Wang

To achieve excellent performance with modern neural networks, having the right network architecture is important. Neural Architecture Search (NAS) concerns the automatic discovery of task-specific network architectures. Modern NAS…

Computer Vision and Pattern Recognition · Computer Science 2022-04-29 Alexander Chebykin , Tanja Alderliesten , Peter A. N. Bosman

There is a growing interest in automated neural architecture search (NAS) methods. They are employed to routinely deliver high-quality neural network architectures for various challenging data sets and reduce the designer's effort. The NAS…

Neural and Evolutionary Computing · Computer Science 2022-06-28 Michal Pinos , Vojtech Mrazek , Lukas Sekanina

Neural architecture search (NAS) aims to automatically design deep neural networks of satisfactory performance. Wherein, architecture performance predictor is critical to efficiently value an intermediate neural architecture. But for the…

Computer Vision and Pattern Recognition · Computer Science 2020-10-16 Yehui Tang , Yunhe Wang , Yixing Xu , Hanting Chen , Chunjing Xu , Boxin Shi , Chao Xu , Qi Tian , Chang Xu

Convolutional neural networks belong to the most successul image classifiers, but the adaptation of their network architecture to a particular problem is computationally expensive. We show that an evolutionary algorithm saves training time…

Neural and Evolutionary Computing · Computer Science 2018-12-20 Jonas Prellberg , Oliver Kramer

As we advance in the fast-growing era of Machine Learning, various new and more complex neural architectures are arising to tackle problem more efficiently. On the one hand their efficient usage requires advanced knowledge and expertise,…

Machine Learning · Computer Science 2023-10-30 Léo Pouy , Fouad Khenfri , Patrick Leserf , Chokri Mraidha , Cherif Larouci

Single Image Super-Resolution (SISR) tasks have achieved significant performance with deep neural networks. However, the large number of parameters in CNN-based met-hods for SISR tasks require heavy computations. Although several efficient…

Image and Video Processing · Electrical Eng. & Systems 2022-12-20 Han Huang , Li Shen , Chaoyang He , Weisheng Dong , Wei Liu

Designing architectures for deep neural networks requires expert knowledge and substantial computation time. We propose a technique to accelerate architecture selection by learning an auxiliary HyperNet that generates the weights of a main…

Machine Learning · Computer Science 2017-08-18 Andrew Brock , Theodore Lim , J. M. Ritchie , Nick Weston

In comparison to classical shallow representation learning techniques, deep neural networks have achieved superior performance in nearly every application benchmark. But despite their clear empirical advantages, it is still not well…

Machine Learning · Computer Science 2022-01-11 Calvin Murdock , George Cazenavette , Simon Lucey

We propose a method for learning the neural network architecture that based on Genetic Algorithm (GA). Our approach uses a genetic algorithm integrated with standard Stochastic Gradient Descent(SGD) which allows the sharing of weights…

Neural and Evolutionary Computing · Computer Science 2019-07-08 Hai Victor Habi , Gil Rafalovich

Machine learning models work better when curated features are provided to them. Feature engineering methods have been usually used as a preprocessing step to obtain or build a proper feature set. In late years, autoencoders (a specific type…

Neural and Evolutionary Computing · Computer Science 2023-01-18 Francisco Charte , Antonio J. Rivera , Francisco Martínez , María J. del Jesus

Artificial neural network (NN) architecture design is a nontrivial and time-consuming task that often requires a high level of human expertise. Neural architecture search (NAS) serves to automate the design of NN architectures and has…

Neural and Evolutionary Computing · Computer Science 2024-09-10 Reinhard Booysen , Anna Sergeevna Bosman

Neural Architecture Search (NAS) is a powerful tool for automating effective image processing DNN designing. The ranking has been advocated to design an efficient performance predictor for NAS. The previous contrastive method solves the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Bicheng Guo , Tao Chen , Shibo He , Haoyu Liu , Lilin Xu , Peng Ye , Jiming Chen

Neural Architecture Search (NAS) refers to automatically design the architecture. We propose an hourglass-inspired approach (HourNAS) for this problem that is motivated by the fact that the effects of the architecture often proceed from the…

Computer Vision and Pattern Recognition · Computer Science 2020-12-09 Zhaohui Yang , Yunhe Wang , Xinghao Chen , Jianyuan Guo , Wei Zhang , Chao Xu , Chunjing Xu , Dacheng Tao , Chang Xu

With the increasing number of new neural architecture designs and substantial existing neural architectures, it becomes difficult for the researchers to situate their contributions compared with existing neural architectures or establish…

Artificial Intelligence · Computer Science 2024-03-19 Xiaohuan Pei , Yanxi Li , Minjing Dong , Chang Xu

Binary Neural Networks (BNNs) have gained extensive attention for their superior inferencing efficiency and compression ratio compared to traditional full-precision networks. However, due to the unique characteristics of BNNs, designing a…

Computer Vision and Pattern Recognition · Computer Science 2024-08-29 Zhihao Lin , Yongtao Wang , Jinhe Zhang , Xiaojie Chu , Haibin Ling

Deep convolutional neural networks demonstrate impressive results in the super-resolution domain. A series of studies concentrate on improving peak signal noise ratio (PSNR) by using much deeper layers, which are not friendly to constrained…

Computer Vision and Pattern Recognition · Computer Science 2020-07-22 Xiangxiang Chu , Bo Zhang , Hailong Ma , Ruijun Xu , Qingyuan Li