English
Related papers

Related papers: Device-Conditioned Neural Architecture Search for …

200 papers

Designing resource-efficient Deep Neural Networks (DNNs) is critical to deploy deep learning solutions over edge platforms due to diverse performance, power, and memory budgets. Unfortunately, it is often the case a well-trained ML model…

Machine Learning · Computer Science 2020-06-09 Sheng-Chun Kao , Arun Ramamurthy , Reed Williams , Tushar Krishna

We present MorphNet, an approach to automate the design of neural network structures. MorphNet iteratively shrinks and expands a network, shrinking via a resource-weighted sparsifying regularizer on activations and expanding via a uniform…

Machine Learning · Computer Science 2018-04-19 Ariel Gordon , Elad Eban , Ofir Nachum , Bo Chen , Hao Wu , Tien-Ju Yang , Edward Choi

Deep convolutional neural networks, assisted by architectural design strategies, make extensive use of data augmentation techniques and layers with a high number of feature maps to embed object transformations. That is highly inefficient…

Computer Vision and Pattern Recognition · Computer Science 2021-12-21 Vittorio Mazzia , Francesco Salvetti , Marcello Chiaberge

Model quantization is challenging due to many tedious hyper-parameters such as precision (bitwidth), dynamic range (minimum and maximum discrete values) and stepsize (interval between discrete values). Unlike prior arts that carefully tune…

Machine Learning · Computer Science 2021-07-08 Zhang Zhaoyang , Shao Wenqi , Gu Jinwei , Wang Xiaogang , Luo Ping

The design of neural network architectures is frequently either based on human expertise using trial/error and empirical feedback or tackled via large scale reinforcement learning strategies performed over distinct discrete architecture…

Computer Vision and Pattern Recognition · Computer Science 2019-09-06 Yunyang Xiong , Ronak Mehta , Vikas Singh

The severe on-chip memory limitations are currently preventing the deployment of the most accurate Deep Neural Network (DNN) models on tiny MicroController Units (MCUs), even if leveraging an effective 8-bit quantization scheme. To tackle…

Machine Learning · Computer Science 2020-08-13 Manuele Rusci , Marco Fariselli , Alessandro Capotondi , Luca Benini

Deep learning-based models are at the forefront of most driver observation benchmarks due to their remarkable accuracies but are also associated with high computational costs. This is challenging, as resources are often limited in…

Computer Vision and Pattern Recognition · Computer Science 2023-11-13 Calvin Tanama , Kunyu Peng , Zdravko Marinov , Rainer Stiefelhagen , Alina Roitberg

Multiple mobile manipulators show superiority in the tasks requiring mobility and dexterity compared with a single robot, especially when manipulating/transporting bulky objects. However, closed-chain of the system, redundancy of each…

Robotics · Computer Science 2026-02-25 Heng Zhang , Haoyi Song , Wenhang Liu , Xinjun Sheng , Zhenhua Xiong , Xiangyang Zhu

All-in-one image restoration aims to handle diverse degradations within a single model. However, existing methods often suffer from three key limitations: 1) per-input computational overhead from dynamic degradation estimation; 2)…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Ao Li , Xiaoning Liu , Sheng Li , Yapeng Du , Zhen Long , Lei Luo , Le Zhang , Ce Zhu

Resource allocation and transceivers in wireless networks are usually designed by solving optimization problems subject to specific constraints, which can be formulated as variable or functional optimization. If the objective and constraint…

Machine Learning · Computer Science 2020-01-06 Dong Liu , Chengjian Sun , Chenyang Yang , Lajos Hanzo

In this study, energy-efficient deterministic adaptive beamforming algorithms are proposed for distributed sensor/relay networks. Specifically, DBSA, D-QESA, D-QESA-E, and a hybrid algorithm, hybrid-QESA, that combines the benefits of both…

Information Theory · Computer Science 2015-09-10 Chun-Wei Li , Kuo-Ming Chen , Po-Chun Fu , Wei-Ning Chen , Che Lin

Deep neural networks have recently achieved state of the art performance thanks to new training algorithms for rapid parameter estimation and new regularization methods to reduce overfitting. However, in practice the network architecture…

Machine Learning · Computer Science 2016-03-04 Minyoung Kim , Luca Rigazio

Learning visuomotor policy for multi-task robotic manipulation has been a long-standing challenge for the robotics community. The difficulty lies in the diversity of action space: typically, a goal can be accomplished in multiple ways,…

Robotics · Computer Science 2025-03-24 Kun Wu , Yichen Zhu , Jinming Li , Junjie Wen , Ning Liu , Zhiyuan Xu , Jian Tang

Object transportation could be a challenging problem for a single robot due to the oversize and/or overweight issues. A multi-robot system can take the advantage of increased driving power and more flexible configuration to solve such a…

Robotics · Computer Science 2020-07-21 Lin Zhang , Hao Xiong , Ou Ma , Zhaokui Wang

Very large-scale Deep Neural Networks (DNNs) have achieved remarkable successes in a large variety of computer vision tasks. However, the high computation intensity of DNNs makes it challenging to deploy these models on resource-limited…

Computer Vision and Pattern Recognition · Computer Science 2017-07-26 Wei Wen , Cong Xu , Chunpeng Wu , Yandan Wang , Yiran Chen , Hai Li

Conventional multiply-accumulate (MAC) operations have long dominated computation time for deep neural networks (DNNs), espcially convolutional neural networks (CNNs). Recently, product quantization (PQ) has been applied to these workloads,…

Hardware Architecture · Computer Science 2024-04-01 Ahmed F. AbouElhamayed , Angela Cui , Javier Fernandez-Marques , Nicholas D. Lane , Mohamed S. Abdelfattah

Decentralized federated learning (DFL) enables edge devices to collaboratively train models through local training and fully decentralized device-to-device (D2D) model exchanges. However, these energy-intensive operations often rapidly…

Machine Learning · Computer Science 2026-02-17 Kai Zhang , Xuanyu Cao , Khaled B. Letaief

The emergence of CNNs in mainstream deployment has necessitated methods to design and train efficient architectures tailored to maximize the accuracy under diverse hardware & latency constraints. To scale these resource-intensive tasks with…

Computer Vision and Pattern Recognition · Computer Science 2021-04-27 Manas Sahni , Shreya Varshini , Alind Khare , Alexey Tumanov

The prediction accuracy of the deep neural networks (DNNs) after deployment at the edge can suffer with time due to shifts in the distribution of the new data. To improve robustness of DNNs, they must be able to update themselves to enhance…

Machine Learning · Computer Science 2022-03-23 Kshitij Bhardwaj , James Diffenderfer , Bhavya Kailkhura , Maya Gokhale

FPGAs have been shown to be a promising platform for deploying Quantised Neural Networks (QNNs) with high-speed, low-latency, and energy-efficient inference. However, the complexity of modern deep-learning models limits the performance on…

Hardware Architecture · Computer Science 2025-11-06 Changhong Li , Biswajit Basu , Shreejith Shanker