English
Related papers

Related papers: HR-NAS: Searching Efficient High-Resolution Neural…

200 papers

Benefiting from the search efficiency, differentiable neural architecture search (NAS) has evolved as the most dominant alternative to automatically design competitive deep neural networks (DNNs). We note that DNNs must be executed under…

Machine Learning · Computer Science 2022-09-01 Xiangzhong Luo , Di Liu , Hao Kong , Shuo Huai , Hui Chen , Weichen Liu

Recently, Neural Architecture Search (NAS) has successfully identified neural network architectures that exceed human designed ones on large-scale image classification. In this paper, we study NAS for semantic image segmentation. Existing…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Chenxi Liu , Liang-Chieh Chen , Florian Schroff , Hartwig Adam , Wei Hua , Alan Yuille , Li Fei-Fei

Hyperspectral image (HSI) classification has been a hot topic for decides, as hyperspectral images have rich spatial and spectral information and provide strong basis for distinguishing different land-cover objects. Benefiting from the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-07 Xizhe Xue , Haokui Zhang , Bei Fang , Zongwen Bai , Ying Li

Accurate medical image segmentation especially for echocardiographic images with unmissable noise requires elaborate network design. Compared with manual design, Neural Architecture Search (NAS) realizes better segmentation results due to…

Image and Video Processing · Electrical Eng. & Systems 2023-12-29 Renqi Chen , Jingjing Luo , Fan Nian , Yuhui Cen , Yiheng Peng , Zekuan Yu

Feature extractor plays a critical role in text recognition (TR), but customizing its architecture is relatively less explored due to expensive manual tweaking. In this work, inspired by the success of neural architecture search (NAS), we…

Computer Vision and Pattern Recognition · Computer Science 2022-09-28 Hui Zhang , Quanming Yao , James T. Kwok , Xiang Bai

Neural architecture search (NAS) is a promising technique to design efficient and high-performance deep neural networks (DNNs). As the performance requirements of ML applications grow continuously, the hardware accelerators start playing a…

Computer Vision and Pattern Recognition · Computer Science 2021-08-03 Guihong Li , Sumit K. Mandal , Umit Y. Ogras , Radu Marculescu

Recent work showed neural-network-based approaches to reconstructing images from compressively sensed measurements offer significant improvements in accuracy and signal compression. Such methods can dramatically boost the capability of…

Image and Video Processing · Electrical Eng. & Systems 2020-04-29 Fangliang Bai , Jinchao Liu , Xiaojuan Liu , Margarita Osadchy , Chao Wang , Stuart J. Gibson

Neural architecture search has proven to be a powerful approach to designing and refining neural networks, often boosting their performance and efficiency over manually-designed variations, but comes with computational overhead. While there…

Neural Architecture Search (NAS) is increasingly popular to automatically explore the accuracy versus computational complexity trade-off of Deep Learning (DL) architectures. When targeting tiny edge devices, the main challenge for DL…

Machine Learning · Computer Science 2023-01-26 Matteo Risso , Alessio Burrello , Luca Benini , Enrico Macii , Massimo Poncino , Daniele Jahier Pagliari

The key challenge in neural architecture search (NAS) is designing how to explore wisely in the huge search space. We propose a new NAS method called TNAS (NAS with trees), which improves search efficiency by exploring only a small number…

Artificial Intelligence · Computer Science 2022-04-12 Guocheng Qian , Xuanyang Zhang , Guohao Li , Chen Zhao , Yukang Chen , Xiangyu Zhang , Bernard Ghanem , Jian Sun

Neural networks (NNs) with intensive multiplications (e.g., convolutions and transformers) are capable yet power hungry, impeding their more extensive deployment into resource-constrained devices. As such, multiplication-free networks,…

Machine Learning · Computer Science 2025-03-04 Haoran You , Baopu Li , Huihong Shi , Yonggan Fu , Yingyan Celine Lin

We explore efficient neural architecture search methods and show that a simple yet powerful evolutionary algorithm can discover new architectures with excellent performance. Our approach combines a novel hierarchical genetic representation…

Machine Learning · Computer Science 2018-02-26 Hanxiao Liu , Karen Simonyan , Oriol Vinyals , Chrisantha Fernando , Koray Kavukcuoglu

Reinforcement Learning has yielded promising results for Neural Architecture Search (NAS). In this paper, we demonstrate how its performance can be improved by using a simplified Transformer block to model the policy network. The simplified…

Machine Learning · Computer Science 2020-11-06 Chepuri Shri Krishna , Ashish Gupta , Swarnim Narayan , Himanshu Rai , Diksha Manchanda

In recent years, neural architecture search (NAS) has received intensive scientific and industrial interest due to its capability of finding a neural architecture with high accuracy for various artificial intelligence tasks such as image…

Machine Learning · Computer Science 2021-01-18 Martin Ferianc , Hongxiang Fan , Miguel Rodrigues

Transformers exhibit great advantages in handling computer vision tasks. They model image classification tasks by utilizing a multi-head attention mechanism to process a series of patches consisting of split images. However, for complex…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Haichao Zhang , Kuangrong Hao , Witold Pedrycz , Lei Gao , Xuesong Tang , Bing Wei

Recently, deep learning has become a de facto standard in machine learning with convolutional neural networks (CNNs) demonstrating spectacular success on a wide variety of tasks. However, CNNs are typically very demanding computationally at…

Computer Vision and Pattern Recognition · Computer Science 2019-09-27 Yochai Zur , Chaim Baskin , Evgenii Zheltonozhskii , Brian Chmiel , Itay Evron , Alex M. Bronstein , Avi Mendelson

Tensor network methods provide a scalable solution to represent high-dimensional data. However, their efficacy is often limited by static, expert-defined structures that fail to adapt to evolving data correlations. We address this…

Computational Engineering, Finance, and Science · Computer Science 2026-03-31 Zheng Guo , Aditya Deshpande , Xinyu Wang , Brian C. Kiedrowski , Alex A. Gorodetsky

Neural architecture search can discover neural networks with good performance, and One-Shot approaches are prevalent. One-Shot approaches typically require a supernet with weight sharing and predictors that predict the performance of…

Machine Learning · Computer Science 2021-08-19 Chia-Hsiang Liu , Yu-Shin Han , Yuan-Yao Sung , Yi Lee , Hung-Yueh Chiang , Kai-Chiang Wu

Deep Neural Networks (DNNs) excel in learning hierarchical representations from raw data, such as images, audio, and text. To compute these DNN models with high performance and energy efficiency, these models are usually deployed onto…

The reasoning segmentation task involves segmenting objects within an image by interpreting implicit user instructions, which may encompass subtleties such as contextual cues and open-world knowledge. Despite significant advancements made…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Weihuang Lin , Yiwei Ma , Xiaoshuai Sun , Shuting He , Jiayi Ji , Liujuan Cao , Rongrong Ji