English
Related papers

Related papers: Hit-Detector: Hierarchical Trinity Architecture Se…

200 papers

Recently, self-attention operators have shown superior performance as a stand-alone building block for vision models. However, existing self-attention models are often hand-designed, modified from CNNs, and obtained by stacking one operator…

Computer Vision and Pattern Recognition · Computer Science 2021-11-16 Huaijin Pi , Huiyu Wang , Yingwei Li , Zizhang Li , Alan Yuille

The recent progress of deep convolutional neural networks has enabled great success in single image super-resolution (SISR) and many other vision tasks. Their performances are also being increased by deepening the networks and developing…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Joon Young Ahn , Nam Ik Cho

Neural architecture search (NAS) recently attracts much research attention because of its ability to identify better architectures than handcrafted ones. However, many NAS methods, which optimize the search process in a discrete search…

Machine Learning · Computer Science 2019-11-22 Quanming Yao , Ju Xu , Wei-Wei Tu , Zhanxing Zhu

Adequate labeled data and expensive compute resources are the prerequisites for the success of neural architecture search(NAS). It is challenging to apply NAS in meta-learning scenarios with limited compute resources and data. In this…

Machine Learning · Computer Science 2021-10-13 Jingtao Rong , Xinyi Yu , Mingyang Zhang , Linlin Ou

The neural architecture search (NAS) algorithm with reinforcement learning can be a powerful and novel framework for the automatic discovering process of neural architectures. However, its application is restricted by noncontinuous and…

Machine Learning · Computer Science 2020-03-27 Chun-Ting Liu

Neural architecture search (NAS) has shown promise towards automating neural network design for a given task, but it is computationally demanding due to training costs associated with evaluating a large number of architectures to find the…

Computer Vision and Pattern Recognition · Computer Science 2025-02-07 Shahid Siddiqui , Christos Kyrkou , Theocharis Theocharides

Recently, much attention has been spent on neural architecture search (NAS), aiming to outperform those manually-designed neural architectures on high-level vision recognition tasks. Inspired by the success, here we attempt to leverage NAS…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Haokui Zhang , Ying Li , Hao Chen , Chengrong Gong , Zongwen Bai , Chunhua Shen

The allocation of computation resources in the backbone is a crucial issue in object detection. However, classification allocation pattern is usually adopted directly to object detector, which is proved to be sub-optimal. In order to…

Computer Vision and Pattern Recognition · Computer Science 2019-12-25 Feng Liang , Chen Lin , Ronghao Guo , Ming Sun , Wei Wu , Junjie Yan , Wanli Ouyang

Model efficiency has become increasingly important in computer vision. In this paper, we systematically study neural network architecture design choices for object detection and propose several key optimizations to improve efficiency.…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Mingxing Tan , Ruoming Pang , Quoc V. Le

Neural Architecture Search (NAS) was first proposed to achieve state-of-the-art performance through the discovery of new architecture patterns, without human intervention. An over-reliance on expert knowledge in the search space design has…

Machine Learning · Computer Science 2021-01-05 Binxin Ru , Pedro Esperanca , Fabio Carlucci

In this paper, we aim to design an efficient real-time object detector that exceeds the YOLO series and is easily extensible for many object recognition tasks such as instance segmentation and rotated object detection. To obtain a more…

Computer Vision and Pattern Recognition · Computer Science 2022-12-20 Chengqi Lyu , Wenwei Zhang , Haian Huang , Yue Zhou , Yudong Wang , Yanyi Liu , Shilong Zhang , Kai Chen

The key challenge in neural architecture search (NAS) is designing how to explore wisely in the huge search space. We propose a new NAS method called TNAS (NAS with trees), which improves search efficiency by exploring only a small number…

Artificial Intelligence · Computer Science 2022-04-12 Guocheng Qian , Xuanyang Zhang , Guohao Li , Chen Zhao , Yukang Chen , Xiangyu Zhang , Bernard Ghanem , Jian Sun

We present LDP, a lightweight dense prediction neural architecture search (NAS) framework. Starting from a pre-defined generic backbone, LDP applies the novel Assisted Tabu Search for efficient architecture exploration. LDP is fast and…

Computer Vision and Pattern Recognition · Computer Science 2022-03-10 Lam Huynh , Esa Rahtu , Jiri Matas , Janne Heikkila

Deep learning-based fault detection methods have achieved significant success. In visual fault detection of freight trains, there exists a large characteristic difference between inter-class components (scale variance) but intra-class on…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Yang Zhang , Mingying Li , Huilin Pan , Moyun Liu , Yang Zhou

Neural Architecture Search (NAS) has garnered significant research interest due to its capability to discover architectures superior to manually designed ones. Learning text representation is crucial for text classification and other…

In this work, we propose a novel evolutionary algorithm for neural architecture search, applicable to global search spaces. The algorithm's architectural representation organizes the topology in multiple hierarchical modules, while the…

Neural and Evolutionary Computing · Computer Science 2023-05-05 Aristeidis Christoforidis , George Kyriakides , Konstantinos Margaritis

Despite the blooming success of architecture search for vision tasks in resource-constrained environments, the design of on-device object detection architectures have mostly been manual. The few automated search efforts are either centered…

Computer Vision and Pattern Recognition · Computer Science 2020-08-03 Bo Chen , Golnaz Ghiasi , Hanxiao Liu , Tsung-Yi Lin , Dmitry Kalenichenko , Hartwig Adams , Quoc V. Le

Automatic search of neural architectures for various vision and natural language tasks is becoming a prominent tool as it allows to discover high-performing structures on any dataset of interest. Nevertheless, on more difficult domains,…

Computer Vision and Pattern Recognition · Computer Science 2020-05-25 Vladimir Nekrasov , Chunhua Shen , Ian Reid

Recently, the efficiency of automatic neural architecture design has been significantly improved by gradient-based search methods such as DARTS. However, recent literature has brought doubt to the generalization ability of DARTS, arguing…

Machine Learning · Computer Science 2021-01-26 Guilin Li , Xing Zhang , Zitong Wang , Matthias Tan , Jiashi Feng , Zhenguo Li , Tong Zhang

In the recent past, the success of Neural Architecture Search (NAS) has enabled researchers to broadly explore the design space using learning-based methods. Apart from finding better neural network architectures, the idea of automation has…

Machine Learning · Computer Science 2019-11-04 Qing Lu , Weiwen Jiang , Xiaowei Xu , Yiyu Shi , Jingtong Hu