English
Related papers

Related papers: FMAS: Fast Multi-Objective SuperNet Architecture S…

200 papers

Federated Learning (FL) often struggles with data heterogeneity due to the naturally uneven distribution of user data across devices. Federated Neural Architecture Search (NAS) enables collaborative search for optimal model architectures…

Machine Learning · Computer Science 2025-04-10 Xinyuan Huang , Jiechao Gao

Neural Architecture Search (NAS) has shown great potentials in automatically designing scalable network architectures for dense image predictions. However, existing NAS algorithms usually compromise on restricted search space and search on…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Xiong Zhang , Hongmin Xu , Hong Mo , Jianchao Tan , Cheng Yang , Lei Wang , Wenqi Ren

Neural architecture search (NAS) enables finding the best-performing architecture from a search space automatically. Most NAS methods exploit an over-parameterized network (i.e., a supernet) containing all possible architectures (i.e.,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Youngmin Oh , Hyunju Lee , Bumsub Ham

We present an elegant framework of fine-grained neural architecture search (FGNAS), which allows to employ multiple heterogeneous operations within a single layer and can even generate compositional feature maps using several different base…

Computer Vision and Pattern Recognition · Computer Science 2019-11-19 Heewon Kim , Seokil Hong , Bohyung Han , Heesoo Myeong , Kyoung Mu Lee

Deep learning has largely reduced the need for manual feature selection in image segmentation. Nevertheless, network architecture optimization and hyperparameter tuning are mostly manual and time consuming. Although there are increasing…

Image and Video Processing · Electrical Eng. & Systems 2019-09-16 Ken C. L. Wong , Mehdi Moradi

In this paper, we focus on exploring effective methods for faster and accurate semantic segmentation. A common practice to improve the performance is to attain high-resolution feature maps with strong semantic representation. Two strategies…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Xiangtai Li , Jiangning Zhang , Yibo Yang , Guangliang Cheng , Kuiyuan Yang , Yunhai Tong , Dacheng Tao

Automated design of neural network architectures tailored for a specific task is an extremely promising, albeit inherently difficult, avenue to explore. While most results in this domain have been achieved on image classification and…

Computer Vision and Pattern Recognition · Computer Science 2019-05-20 Vladimir Nekrasov , Hao Chen , Chunhua Shen , Ian Reid

The recent breakthroughs of Neural Architecture Search (NAS) have motivated various applications in medical image segmentation. However, most existing work either simply rely on hyper-parameter tuning or stick to a fixed network backbone,…

Image and Video Processing · Electrical Eng. & Systems 2020-07-14 Xingang Yan , Weiwen Jiang , Yiyu Shi , Cheng Zhuo

Search space design is very critical to neural architecture search (NAS) algorithms. We propose a fine-grained search space comprised of atomic blocks, a minimal search unit that is much smaller than the ones used in recent NAS algorithms.…

Computer Vision and Pattern Recognition · Computer Science 2020-02-25 Jieru Mei , Yingwei Li , Xiaochen Lian , Xiaojie Jin , Linjie Yang , Alan Yuille , Jianchao Yang

Hardware-aware Neural Architecture Search (NAS) technologies have been proposed to automate and speed up model design to meet both quality and inference efficiency requirements on a given hardware. Prior arts have shown the capability of…

Neural and Evolutionary Computing · Computer Science 2023-05-09 Qian Xu , Victor Li , Crews Darren S

As the application area of convolutional neural networks (CNN) is growing in embedded devices, it becomes popular to use a hardware CNN accelerator, called neural processing unit (NPU), to achieve higher performance per watt than CPUs or…

Machine Learning · Computer Science 2020-09-07 Jaeseong Lee , Duseok Kang , Soonhoi Ha

Neural Architecture Search (NAS) has proved effective in offering outperforming alternatives to handcrafted neural networks. In this paper we analyse the benefits of NAS for image classification tasks under strict computational constraints.…

Computer Vision and Pattern Recognition · Computer Science 2020-09-30 Cristian Cioflan , Radu Timofte

Neural architecture search (NAS) relies on a good controller to generate better architectures or predict the accuracy of given architectures. However, training the controller requires both abundant and high-quality pairs of architectures…

Machine Learning · Computer Science 2020-11-04 Renqian Luo , Xu Tan , Rui Wang , Tao Qin , Enhong Chen , Tie-Yan Liu

Neural architecture search (NAS) and network pruning are widely studied efficient AI techniques, but not yet perfect. NAS performs exhaustive candidate architecture search, incurring tremendous search cost. Though (structured) pruning can…

Computer Vision and Pattern Recognition · Computer Science 2022-06-03 Yanyu Li , Pu Zhao , Geng Yuan , Xue Lin , Yanzhi Wang , Xin Chen

Image semantic segmentation technology is one of the key technologies for intelligent systems to understand natural scenes. As one of the important research directions in the field of visual intelligence, this technology has broad…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Junjun Wu , Huiyu Kuang , Qinghua Lu , Zeqin Lin , Qingwu Shi , Xilin Liu , Xiaoman Zhu

Neural architecture search can discover neural networks with good performance, and One-Shot approaches are prevalent. One-Shot approaches typically require a supernet with weight sharing and predictors that predict the performance of…

Machine Learning · Computer Science 2021-08-19 Chia-Hsiang Liu , Yu-Shin Han , Yuan-Yao Sung , Yi Lee , Hung-Yueh Chiang , Kai-Chiang Wu

Scale-permuted networks have shown promising results on object bounding box detection and instance segmentation. Scale permutation and cross-scale fusion of features enable the network to capture multi-scale semantics while preserving…

Computer Vision and Pattern Recognition · Computer Science 2021-03-24 Abdullah Rashwan , Xianzhi Du , Xiaoqi Yin , Jing Li

It has been shown that deep neural networks are prone to overfitting on biased training data. Towards addressing this issue, meta-learning employs a meta model for correcting the training bias. Despite the promising performances, super slow…

Machine Learning · Computer Science 2021-05-03 Youjiang Xu , Linchao Zhu , Lu Jiang , Yi Yang

In this paper, we propose Efficient Progressive Neural Architecture Search (EPNAS), a neural architecture search (NAS) that efficiently handles large search space through a novel progressive search policy with performance prediction based…

Machine Learning · Computer Science 2019-07-11 Yanqi Zhou , Peng Wang , Sercan Arik , Haonan Yu , Syed Zawad , Feng Yan , Greg Diamos

We present FasterSeg, an automatically designed semantic segmentation network with not only state-of-the-art performance but also faster speed than current methods. Utilizing neural architecture search (NAS), FasterSeg is discovered from a…

Computer Vision and Pattern Recognition · Computer Science 2020-01-20 Wuyang Chen , Xinyu Gong , Xianming Liu , Qian Zhang , Yuan Li , Zhangyang Wang