English
Related papers

Related papers: SplitNets: Designing Neural Architectures for Effi…

200 papers

Edge-cloud co-inference enables efficient deep neural network (DNN) deployment by splitting the architecture between an edge device and cloud server, crucial for resource-constraint edge devices. This approach requires balancing on-device…

Computer Vision and Pattern Recognition · Computer Science 2024-11-08 Maruf Hassan , Steven Davy

Lightweight autonomous unmanned aerial vehicles (UAV) are emerging as a central component of a broad range of applications. However, autonomous navigation necessitates the implementation of perception algorithms, often deep neural networks…

Robotics · Computer Science 2026-04-10 Timothy K Johnsen , Ian Harshbarger , Zixia Xia , Marco Levorato

This paper presents a hardware-efficient deep neural network (DNN), optimized through hardware-aware neural architecture search (HW-NAS); the DNN supports the classification of session-level encrypted traffic on resource-constrained…

Networking and Internet Architecture · Computer Science 2026-03-20 Adel Chehade , Edoardo Ragusa , Paolo Gastaldo , Rodolfo Zunino

In this work, we address the NER problem by splitting it into two logical sub-tasks: (1) Span Detection which simply extracts entity mention spans irrespective of entity type; (2) Span Classification which classifies the spans into their…

Computation and Language · Computer Science 2023-11-01 Jatin Arora , Youngja Park

Deep neural networks (DNN) have shown superior performance in a variety of tasks. As they rapidly evolve, their escalating computation and memory demands make it challenging to deploy them on resource-constrained edge devices. Though…

Machine Learning · Computer Science 2021-09-07 Jiaqi Gu , Hanqing Zhu , Chenghao Feng , Mingjie Liu , Zixuan Jiang , Ray T. Chen , David Z. Pan

Deep neural network (DNN) inference is increasingly being executed on mobile and embedded platforms due to several key advantages in latency, privacy and always-on availability. However, due to limited computing resources, efficient DNN…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Lei Xun , Jonathon Hare , Geoff V. Merrett

Deep Neural Networks (DNNs) have made significant improvements to reach the desired accuracy to be employed in a wide variety of Machine Learning (ML) applications. Recently the Google Brain's team demonstrated the ability of Capsule…

Machine Learning · Computer Science 2021-01-26 Alberto Marchisio , Andrea Massa , Vojtech Mrazek , Beatrice Bussolino , Maurizio Martina , Muhammad Shafique

A split-transform-merge strategy has been broadly used as an architectural constraint in convolutional neural networks for visual recognition tasks. It approximates sparsely connected networks by explicitly defining multiple branches to…

Computer Vision and Pattern Recognition · Computer Science 2020-08-28 Taesup Kim , Sungwoong Kim , Yoshua Bengio

This paper presents a unified framework for codifying and automating optimization strategies to efficiently deploy deep neural networks (DNNs) on resource-constrained hardware, such as FPGAs, while maintaining high performance, accuracy,…

Hardware Architecture · Computer Science 2026-02-11 Zhiqiang Que , Jose G. F. Coutinho , Ce Guo , Hongxiang Fan , Wayne Luk

We present TDNet, a temporally distributed network designed for fast and accurate video semantic segmentation. We observe that features extracted from a certain high-level layer of a deep CNN can be approximated by composing features…

Computer Vision and Pattern Recognition · Computer Science 2020-04-08 Ping Hu , Fabian Caba Heilbron , Oliver Wang , Zhe Lin , Stan Sclaroff , Federico Perazzi

The success rate of catheterization procedures is closely linked to the sensory data provided to the surgeon. Vision-based deep learning models can deliver both tactile and visual information in a sensor-free manner, while also being…

Image and Video Processing · Electrical Eng. & Systems 2025-01-03 Pedram Fekri , Mehrdad Zadeh , Javad Dargahi

With the ever-increasing computational demand of DNN training workloads, distributed training has been widely adopted. A combination of data, model and pipeline parallelism strategy, called hybrid parallelism distributed training, is…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-06-16 Guandong Lu , Runzhe Chen , Yakai Wang , Yangjie Zhou , Rui Zhang , Zheng Hu , Yanming Miao , Zhifang Cai , Li Li , Jingwen Leng , Minyi Guo

We propose three novel pruning techniques to improve the cost and results of inference-aware Differentiable Neural Architecture Search (DNAS). First, we introduce Prunode, a stochastic bi-path building block for DNAS, which can search over…

Machine Learning · Computer Science 2023-01-06 Sławomir Kierat , Mateusz Sieniawski , Denys Fridman , Chen-Han Yu , Szymon Migacz , Paweł Morkisz , Alex-Fit Florea

End-to-end performance estimation and measurement of deep neural network (DNN) systems become more important with increasing complexity of DNN systems consisting of hardware and software components. The methodology proposed in this paper…

Machine Learning · Computer Science 2019-11-19 Michael J. Klaiber , Sebastian Vogel , Axel Acosta , Robert Korn , Leonardo Ecco , Kristine Back , Andre Guntoro , Ingo Feldner

To preserve user privacy while enabling mobile intelligence, techniques have been proposed to train deep neural networks on decentralized data. However, training over decentralized data makes the design of neural architecture quite…

Machine Learning · Computer Science 2022-07-07 Jinliang Yuan , Mengwei Xu , Yuxin Zhao , Kaigui Bian , Gang Huang , Xuanzhe Liu , Shangguang Wang

We propose SplitNet, a method for decoupling visual perception and policy learning. By incorporating auxiliary tasks and selective learning of portions of the model, we explicitly decompose the learning objectives for visual navigation into…

Computer Vision and Pattern Recognition · Computer Science 2019-10-25 Daniel Gordon , Abhishek Kadian , Devi Parikh , Judy Hoffman , Dhruv Batra

Biomedical imaging is a driver of scientific discovery and core component of medical care, currently stimulated by the field of deep learning. While semantic segmentation algorithms enable 3D image analysis and quantification in many…

Computer Vision and Pattern Recognition · Computer Science 2020-12-09 Fabian Isensee , Paul F. Jäger , Simon A. A. Kohl , Jens Petersen , Klaus H. Maier-Hein

Neural Architecture Search (NAS) has been widely adopted to design accurate and efficient image classification models. However, applying NAS to a new computer vision task still requires a huge amount of effort. This is because 1) previous…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Bichen Wu , Chaojian Li , Hang Zhang , Xiaoliang Dai , Peizhao Zhang , Matthew Yu , Jialiang Wang , Yingyan Celine Lin , Peter Vajda

This work presents an in-depth analysis of the majority of the deep neural networks (DNNs) proposed in the state of the art for image recognition. For each DNN multiple performance indices are observed, such as recognition accuracy, model…

Computer Vision and Pattern Recognition · Computer Science 2023-09-15 Simone Bianco , Remi Cadene , Luigi Celona , Paolo Napoletano

Video and image streaming on edge devices requires low latency. To address this, Neural Networks (NNs) are widely used, and prior work mainly focuses on accelerating them with single hardware units such as Graphics Processing Units (GPUs),…

Hardware Architecture · Computer Science 2026-05-04 Ali Emre Oztas , Mahir Demir , James Garside , Mikel Luj'an