English
Related papers

Related papers: MO-EMT-NAS: Multi-Objective Continuous Transfer of…

200 papers

This paper proposes a neural architecture search (NAS) method for split computing. Split computing is an emerging machine-learning inference technique that addresses the privacy and latency challenges of deploying deep learning in IoT…

Machine Learning · Computer Science 2022-08-31 Shoma Shimizu , Takayuki Nishio , Shota Saito , Yoichi Hirose , Chen Yen-Hsiu , Shinichi Shirakawa

Most existing neural architecture search (NAS) algorithms are dedicated to and evaluated by the downstream tasks, e.g., image classification in computer vision. However, extensive experiments have shown that, prominent neural architectures,…

Machine Learning · Computer Science 2021-11-18 Yuhong Li , Cong Hao , Pan Li , Jinjun Xiong , Deming Chen

Most existing neural architecture search (NAS) benchmarks and algorithms prioritize well-studied tasks, e.g. image classification on CIFAR or ImageNet. This makes the performance of NAS approaches in more diverse areas poorly understood. In…

Computer Vision and Pattern Recognition · Computer Science 2023-01-23 Renbo Tu , Nicholas Roberts , Mikhail Khodak , Junhong Shen , Frederic Sala , Ameet Talwalkar

Vision Transformers have enabled recent attention-based Deep Learning (DL) architectures to achieve remarkable results in Computer Vision (CV) tasks. However, due to the extensive computational resources required, these architectures are…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Lotfi Abdelkrim Mecharbat , Hadjer Benmeziane , Hamza Ouarnoughi , Smail Niar

Deep neural networks (DNNs) have shown superior performances on various multimodal learning problems. However, it often requires huge efforts to adapt DNNs to individual multimodal tasks by manually engineering unimodal features and…

Computer Vision and Pattern Recognition · Computer Science 2022-01-04 Yihang Yin , Siyu Huang , Xiang Zhang

Modern computer vision requires balancing predictive accuracy with real-time efficiency, yet the high inference cost of large vision models (LVMs) limits deployment on resource-constrained edge devices. Although Evolutionary Neural…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Haoyu Zhang , Zhihao Yu , Rui Wang , Yaochu Jin , Qiqi Liu , Ran Cheng

Most differentiable neural architecture search methods construct a super-net for search and derive a target-net as its sub-graph for evaluation. There exists a significant gap between the architectures in search and evaluation. As a result,…

Computer Vision and Pattern Recognition · Computer Science 2021-01-28 Yibo Yang , Shan You , Hongyang Li , Fei Wang , Chen Qian , Zhouchen Lin

Multi-Object Tracking (MOT) is a critical problem in computer vision, essential for understanding how objects move and interact in videos. This field faces significant challenges such as occlusions and complex environmental dynamics,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-10 Luiz C. S. de Araujo , Carlos M. S. Figueiredo

Neural architecture search (NAS) aims to discover network architectures with desired properties such as high accuracy or low latency. Recently, differentiable NAS (DNAS) has demonstrated promising results while maintaining a search cost…

Machine Learning · Computer Science 2020-08-31 Arash Vahdat , Arun Mallya , Ming-Yu Liu , Jan Kautz

The key challenge in neural architecture search (NAS) is designing how to explore wisely in the huge search space. We propose a new NAS method called TNAS (NAS with trees), which improves search efficiency by exploring only a small number…

Artificial Intelligence · Computer Science 2022-04-12 Guocheng Qian , Xuanyang Zhang , Guohao Li , Chen Zhao , Yukang Chen , Xiangyu Zhang , Bernard Ghanem , Jian Sun

With the shift towards on-device deep learning, ensuring a consistent behavior of an AI service across diverse compute platforms becomes tremendously important. Our work tackles the emergent problem of reducing predictive inconsistencies…

Computer Vision and Pattern Recognition · Computer Science 2022-09-29 Rahul Duggal , Hao Zhou , Shuo Yang , Jun Fang , Yuanjun Xiong , Wei Xia

We propose a new architecture called Memory-Augmented Encoder-Solver (MAES) that enables transfer learning to solve complex working memory tasks adapted from cognitive psychology. It uses dual recurrent neural network controllers, inside…

Machine Learning · Computer Science 2018-10-01 T. S. Jayram , Tomasz Kornuta , Ryan L. McAvoy , Ahmet S. Ozcan

Neural Architecture Search (NAS) has gained significant popularity as an effective tool for designing high performance deep neural networks (DNNs). NAS can be performed via policy gradient, evolutionary algorithms, differentiable…

Machine Learning · Computer Science 2021-04-27 Hanxun Huang , Xingjun Ma , Sarah M. Erfani , James Bailey

This paper investigates an under-explored but important problem: given a collection of pre-trained neural networks, predicting their performance on each multi-modal task without fine-tuning them, such as image recognition, referring,…

Machine Learning · Computer Science 2023-08-14 Fanqing Meng , Wenqi Shao , Zhanglin Peng , Chonghe Jiang , Kaipeng Zhang , Yu Qiao , Ping Luo

With the success of deep neural networks, Neural Architecture Search (NAS) as a way of automatic model design has attracted wide attention. As training every child model from scratch is very time-consuming, recent works leverage…

Machine Learning · Computer Science 2020-01-07 Yuge Zhang , Zejun Lin , Junyang Jiang , Quanlu Zhang , Yujing Wang , Hui Xue , Chen Zhang , Yaming Yang

Deep learning has become in recent years a cornerstone tool fueling key innovations in the industry, such as autonomous driving. To attain good performances, the neural network architecture used for a given application must be chosen with…

Computer Vision and Pattern Recognition · Computer Science 2021-09-17 Anthony Cazasnoves , Pierre-Antoine Ganaye , Kévin Sanchis , Tugdual Ceillier

The perception system for autonomous driving generally requires to handle multiple diverse sub-tasks. However, current algorithms typically tackle individual sub-tasks separately, which leads to low efficiency when aiming at obtaining…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Xuesong Chen , Shaoshuai Shi , Tao Ma , Jingqiu Zhou , Simon See , Ka Chun Cheung , Hongsheng Li

One-Shot methods have evolved into one of the most popular methods in Neural Architecture Search (NAS) due to weight sharing and single training of a supernet. However, existing methods generally suffer from two issues: predetermined number…

Machine Learning · Computer Science 2020-03-24 Zan Shen , Jiang Qian , Bojin Zhuang , Shaojun Wang , Jing Xiao

Monumental advances in deep learning have led to unprecedented achievements across various domains. While the performance of deep neural networks is indubitable, the architectural design and interpretability of such models are nontrivial.…

Machine Learning · Computer Science 2023-07-06 Zachariah Carmichael , Tim Moon , Sam Ade Jacobs

As the volume of image data grows, data-oriented cloud computing in Internet of Video Things (IoVT) systems encounters latency issues. Task-oriented edge computing addresses this by shifting data analysis to the edge. However, limited…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Jiaqi Wu , Simin Chen , Zehua Wang , Wei Chen , Zijian Tian , F. Richard Yu , Victor C. M. Leung