English
Related papers

Related papers: Toward Edge-Efficient Dense Predictions with Syner…

200 papers

Neural architecture search (NAS) has become increasingly popular in the deep learning community recently, mainly because it can provide an opportunity to allow interested users without rich expertise to benefit from the success of deep…

Machine Learning · Computer Science 2022-10-25 Shiqing Liu , Haoyu Zhang , Yaochu Jin

We present a novel deep learning (DL) approach to produce highly accurate predictions of macroscopic physical properties of solid solution binary alloys and magnetic systems. The major idea is to make use of the correlations between…

Computational Physics · Physics 2021-01-29 Massimiliano Lupo Pasini , Ying Wai Li , Junqi Yin , Jiaxin Zhang , Kipton Barros , Markus Eisenbach

The success of deep neural networks (DNNs) is heavily dependent on computational resources. While DNNs are often employed on cloud servers, there is a growing need to operate DNNs on edge devices. Edge devices are typically limited in their…

Machine Learning · Computer Science 2022-06-08 May Malka , Erez Farhan , Hai Morgenstern , Nir Shlezinger

Joint channel estimation and signal detection (JCESD) is crucial in orthogonal frequency division multiplexing (OFDM) systems, but traditional algorithms perform poorly in low signal-to-noise ratio (SNR) scenarios. Deep learning (DL)…

Signal Processing · Electrical Eng. & Systems 2024-06-24 Haocheng Ju , Haimiao Zhang , Lin Li , Xiao Li , Bin Dong

Neural architecture search (NAS) has dramatically advanced the development of neural network design. We revisit the search space design in most previous NAS methods and find the number and widths of blocks are set manually. However, block…

Computer Vision and Pattern Recognition · Computer Science 2020-04-10 Jiemin Fang , Yuzhu Sun , Qian Zhang , Yuan Li , Wenyu Liu , Xinggang Wang

Deep Neural Networks are vulnerable to adversarial attacks. Neural Architecture Search (NAS), one of the driving tools of deep neural networks, demonstrates superior performance in prediction accuracy in various machine learning…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Utkarsh Nath , Yancheng Wang , Yingzhen Yang

3D face alignment is a very challenging and fundamental problem in computer vision. Existing deep learning-based methods manually design different networks to regress either parameters of a 3D face model or 3D positions of face vertices.…

Computer Vision and Pattern Recognition · Computer Science 2024-06-13 Zhichao Jiang , Hongsong Wang , Xi Teng , Baopu Li

Accurate surface roughness prediction is critical for ensuring high product quality, especially in areas like manufacturing and aerospace, where the smallest imperfections can compromise performance or safety. However, this is challenging…

Computational Engineering, Finance, and Science · Computer Science 2024-05-29 Penghui Ruan , Divya Saxena , Jiannong Cao , Xiaoyun Liu , Ruoxin Wang , Chi Fai Cheung

Differentiable Architecture Search (DARTS) is an effective continuous relaxation-based network architecture search (NAS) method with low search cost. It has attracted significant attentions in Auto-ML research and becomes one of the most…

Artificial Intelligence · Computer Science 2022-03-10 Jun-Wei Hsieh , Ming-Ching Chang , Ping-Yang Chen , Santanu Santra , Cheng-Han Chou , Chih-Sheng Huang

Despite the success of recent Neural Architecture Search (NAS) methods on various tasks which have shown to output networks that largely outperform human-designed networks, conventional NAS methods have mostly tackled the optimization of…

Machine Learning · Computer Science 2021-07-05 Hayeon Lee , Eunyoung Hyung , Sung Ju Hwang

Multi-task learning (MTL) for dense prediction has shown promising results but still faces challenges in balancing shared representations with task-specific specialization. In this paper, we introduce a novel Fine-Grained Mixture of Experts…

Computer Vision and Pattern Recognition · Computer Science 2025-07-28 Yangyang Xu , Xi Ye , Duo Su

Many real-world applications are widely adopting the edge computing paradigm due to its low latency and better privacy protection. With notable success in AI and deep learning (DL), edge devices and AI accelerators play a crucial role in…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-07-28 Piyush Subedi , Jianwei Hao , In Kee Kim , Lakshmish Ramaswamy

Designing low-latency and high-efficiency hybrid networks for a variety of low-cost commodity edge devices is both costly and tedious, leading to the adoption of hardware-aware neural architecture search (NAS) for finding optimal…

Machine Learning · Computer Science 2024-08-29 Hung-Yueh Chiang , Diana Marculescu

Continual learning with neural networks is an important learning framework in AI that aims to learn a sequence of tasks well. However, it is often confronted with three challenges: (1) overcome the catastrophic forgetting problem, (2) adapt…

Machine Learning · Computer Science 2020-06-11 Qiang Gao , Zhipeng Luo , Diego Klabjan

Deep neural networks (DNNs) based automatic speech recognition (ASR) systems are often designed using expert knowledge and empirical evaluation. In this paper, a range of neural architecture search (NAS) techniques are used to automatically…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-09 Shoukang Hu , Xurong Xie , Shansong Liu , Mingyu Cui , Mengzhe Geng , Xunying Liu , Helen Meng

Embedded deep learning platforms have witnessed two simultaneous improvements. First, the accuracy of convolutional neural networks (CNNs) has been significantly improved through the use of automated neural-architecture search (NAS)…

Neural and Evolutionary Computing · Computer Science 2019-10-22 Lile Cai , Anne-Maelle Barneche , Arthur Herbout , Chuan Sheng Foo , Jie Lin , Vijay Ramaseshan Chandrasekhar , Mohamed M. Sabry

Neural Architecture Search (NAS) algorithms aim at finding efficient Deep Neural Network (DNN) architectures for a given application under given system constraints. DNNs are computationally-complex as well as vulnerable to adversarial…

Machine Learning · Computer Science 2025-10-23 Alberto Marchisio , Vojtech Mrazek , Andrea Massa , Beatrice Bussolino , Maurizio Martina , Muhammad Shafique

Neural Architecture Search (NAS) has gained widespread attention for its transformative potential in deep learning model design. However, the vast and complex search space of NAS leads to significant computational and time costs. Neural…

Neural and Evolutionary Computing · Computer Science 2025-09-30 Bingye Zhou , Caiyang Yu , Chenwei Tang

Neural architecture search (NAS) automates neural network design by using optimization algorithms to navigate architecture spaces, reducing the burden of manual architecture design. While NAS has achieved success, applying it to emerging…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Yisheng Yang , Guodong Du , Chean Khim Toa , Ho-Kin Tang , Sim Kuan Goh

Future communication networks must address the scarce spectrum to accommodate extensive growth of heterogeneous wireless devices. Wireless signal recognition is becoming increasingly more significant for spectrum monitoring, spectrum…

Signal Processing · Electrical Eng. & Systems 2022-06-22 Anu Jagannath , Jithin Jagannath