English
Related papers

Related papers: Denoising Designs-inherited Search Framework for I…

200 papers

Recent advances in Neural Architecture Search (NAS) such as one-shot NAS offer the ability to extract specialized hardware-aware sub-network configurations from a task-specific super-network. While considerable effort has been employed…

Machine Learning · Computer Science 2022-05-24 Daniel Cummings , Anthony Sarah , Sharath Nittur Sridhar , Maciej Szankin , Juan Pablo Munoz , Sairam Sundaresan

As deep neural networks achieve unprecedented performance in various tasks, neural architecture search (NAS), a research field for designing neural network architectures with automated processes, is actively underway. More recently,…

Machine Learning · Computer Science 2022-06-07 Youngkee Kim , Soyi Jung , Minseok Choi , Joongheon Kim

Recent advancements in Neural Architecture Search(NAS) resulted in finding new state-of-the-art Artificial Neural Network (ANN) solutions for tasks like image classification, object detection, or semantic segmentation without substantial…

Image and Video Processing · Electrical Eng. & Systems 2020-04-21 Marcin Możejko , Tomasz Latkowski , Łukasz Treszczotko , Michał Szafraniuk , Krzysztof Trojanowski

In this paper, we jointly combine image classification and image denoising, aiming to enhance human perception of noisy images captured by edge devices, like low-light security cameras. In such settings, it is important to retain the…

Computer Vision and Pattern Recognition · Computer Science 2024-09-16 Thomas C Markhorst , Jan C van Gemert , Osman S Kayhan

There is a constant need for high-performing and computationally efficient neural network models for image super-resolution: computationally efficient models can be used via low-capacity devices and reduce carbon footprints. One way to…

Computer Vision and Pattern Recognition · Computer Science 2024-01-11 Egor Shvetsov , Dmitry Osin , Alexey Zaytsev , Ivan Koryakovskiy , Valentin Buchnev , Ilya Trofimov , Evgeny Burnaev

Neural Architecture Search (NAS) has shown great potentials in automatically designing scalable network architectures for dense image predictions. However, existing NAS algorithms usually compromise on restricted search space and search on…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Xiong Zhang , Hongmin Xu , Hong Mo , Jianchao Tan , Cheng Yang , Lei Wang , Wenqi Ren

Deep learning has made breakthroughs and substantial in many fields due to its powerful automatic representation capabilities. It has been proven that neural architecture design is crucial to the feature representation of data and the final…

Machine Learning · Computer Science 2021-03-03 Pengzhen Ren , Yun Xiao , Xiaojun Chang , Po-Yao Huang , Zhihui Li , Xiaojiang Chen , Xin Wang

An effective and efficient architecture performance evaluation scheme is essential for the success of Neural Architecture Search (NAS). To save computational cost, most of existing NAS algorithms often train and evaluate intermediate neural…

Machine Learning · Computer Science 2021-09-27 Yixing Xu , Yunhe Wang , Kai Han , Yehui Tang , Shangling Jui , Chunjing Xu , Chang Xu

Neural Architecture Search (NAS) aims to automatically find effective architectures within a predefined search space. However, the search space is often extremely large. As a result, directly searching in such a large search space is…

Computer Vision and Pattern Recognition · Computer Science 2024-06-07 Yaofo Chen , Yong Guo , Daihai Liao , Fanbing Lv , Hengjie Song , James Tin-Yau Kwok , Mingkui Tan

Current neural architecture search (NAS) algorithms still require expert knowledge and effort to design a search space for network construction. In this paper, we consider automating the search space design to minimize human interference,…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Daquan Zhou , Xiaojie Jin , Xiaochen Lian , Linjie Yang , Yujing Xue , Qibin Hou , Jiashi Feng

Neural Architecture Search (NAS) is an emerging topic in machine learning and computer vision. The fundamental ideology of NAS is using an automatic mechanism to replace manual designs for exploring powerful network architectures. One of…

Machine Learning · Computer Science 2020-09-24 Lanfei Wang , Lingxi Xie , Tianyi Zhang , Jun Guo , Qi Tian

The term Neural Architecture Search (NAS) refers to the automatic optimization of network architectures for a new, previously unknown task. Since testing an architecture is computationally very expensive, many optimizers need days or even…

Machine Learning · Computer Science 2019-07-22 Martin Wistuba

Deep neural networks (DNNs) have shown very promising results for various image restoration (IR) tasks. However, the design of network architectures remains a major challenging for achieving further improvements. While most existing…

Computer Vision and Pattern Recognition · Computer Science 2020-10-28 Weisheng Dong , Peiyao Wang , Wotao Yin , Guangming Shi , Fangfang Wu , Xiaotong Lu

Neural Architecture Search (NAS) has shown promising capability in learning text representation. However, existing text-based NAS neither performs a learnable fusion of neural operations to optimize the architecture, nor encodes the latent…

Computation and Language · Computer Science 2023-07-13 Kuan-Chun Chen , Cheng-Te Li , Kuo-Jung Lee

Neural Architecture Search~(NAS) has attracted increasingly more attention in recent years because of its capability to design deep neural networks automatically. Among them, differential NAS approaches such as DARTS, have gained popularity…

Machine Learning · Computer Science 2022-03-07 Peng Ye , Baopu Li , Yikang Li , Tao Chen , Jiayuan Fan , Wanli Ouyang

Weight sharing has become a de facto standard in neural architecture search because it enables the search to be done on commodity hardware. However, recent works have empirically shown a ranking disorder between the performance of…

Machine Learning · Computer Science 2021-04-13 Kaicheng Yu , Rene Ranftl , Mathieu Salzmann

In this paper, we investigate a new variant of neural architecture search (NAS) paradigm -- searching with random labels (RLNAS). The task sounds counter-intuitive for most existing NAS algorithms since random label provides few information…

Computer Vision and Pattern Recognition · Computer Science 2021-05-26 Xuanyang Zhang , Pengfei Hou , Xiangyu Zhang , Jian Sun

Semantic segmentation is a popular research topic in computer vision, and many efforts have been made on it with impressive results. In this paper, we intend to search an optimal network structure that can run in real-time for this problem.…

Computer Vision and Pattern Recognition · Computer Science 2022-08-11 Peng Ye , Baopu Li , Tao Chen , Jiayuan Fan , Zhen Mei , Chen Lin , Chongyan Zuo , Qinghua Chi , Wanli Ouyan

Traditional neural architecture search (NAS) has a significant impact in computer vision by automatically designing network architectures for various tasks. In this paper, binarized neural architecture search (BNAS), with a search space of…

Computer Vision and Pattern Recognition · Computer Science 2020-09-10 Hanlin Chen , Li'an Zhuo , Baochang Zhang , Xiawu Zheng , Jianzhuang Liu , Rongrong Ji , David Doermann , Guodong Guo

Neural Architecture Search (NAS) aims to facilitate the design of deep networks for new tasks. Existing techniques rely on two stages: searching over the architecture space and validating the best architecture. NAS algorithms are currently…

Machine Learning · Computer Science 2019-11-25 Kaicheng Yu , Christian Sciuto , Martin Jaggi , Claudiu Musat , Mathieu Salzmann