English
Related papers

Related papers: BottleNet: A Deep Learning Architecture for Intell…

200 papers

Deluge Networks (DelugeNets) are deep neural networks which efficiently facilitate massive cross-layer information inflows from preceding layers to succeeding layers. The connections between layers in DelugeNets are established through…

Computer Vision and Pattern Recognition · Computer Science 2017-08-24 Jason Kuen , Xiangfei Kong , Gang Wang , Yap-Peng Tan

An important task in the Internet of Things (IoT) is field monitoring, where multiple IoT nodes take measurements and communicate them to the base station or the cloud for processing, inference, and analysis. This communication becomes…

Machine Learning · Computer Science 2020-03-25 Rong Du , Sindri Magnússon , Carlo Fischione

Deep learning is increasingly being used to perform machine vision tasks such as classification, object detection, and segmentation on 3D point cloud data. However, deep learning inference is computationally expensive. The limited…

Image and Video Processing · Electrical Eng. & Systems 2023-08-14 Mateen Ulhaq , Ivan V. Bajić

Deploying deep neural networks (DNNs) on resource-constrained edge devices such as FPGAs requires a careful balance among latency, power, and hardware resource usage, while maintaining high accuracy. Existing Lookup Table (LUT)-based DNNs…

Hardware Architecture · Computer Science 2026-01-16 Binglei Lou , Ruilin Wu , Philip Leong

In this paper, we are interested in building a domain knowledge based deep learning framework to solve the chiller plants energy optimization problems. Compared to the hotspot applications of deep learning (e.g. image classification and…

Signal Processing · Electrical Eng. & Systems 2021-06-14 Fanhe Ma , Faen Zhang , Shenglan Ben , Shuxin Qin , Pengcheng Zhou , Changsheng Zhou , Fengyi Xu

Recent advances in geometric deep-learning introduce complex computational challenges for evaluating the distance between meshes. From a mesh model, point clouds are necessary along with a robust distance metric to assess surface quality or…

Computer Vision and Pattern Recognition · Computer Science 2021-04-30 Léo Lebrat , Rodrigo Santa Cruz , Clinton Fookes , Olivier Salvado

Modern deep learning architectures produce highly accurate results on many challenging semantic segmentation datasets. State-of-the-art methods are, however, not directly transferable to real-time applications or embedded devices, since…

Computer Vision and Pattern Recognition · Computer Science 2018-11-06 Rudra P K Poudel , Ujwal Bonde , Stephan Liwicki , Christopher Zach

Transformer-based models excel in speech recognition. Existing efforts to optimize Transformer inference, typically for long-context applications, center on simplifying attention score calculations. However, streaming speech recognition…

Machine Learning · Computer Science 2024-01-22 Yang Li , Liangzhen Lai , Yuan Shangguan , Forrest N. Iandola , Zhaoheng Ni , Ernie Chang , Yangyang Shi , Vikas Chandra

Dataset distillation aims to distill the knowledge of a large-scale real dataset into small yet informative synthetic data such that a model trained on it performs as well as a model trained on the full dataset. Despite recent progress,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Ahmad Sajedi , Samir Khaki , Lucy Z. Liu , Ehsan Amjadian , Yuri A. Lawryshyn , Konstantinos N. Plataniotis

Past few years have witnessed exponential growth of interest in deep learning methodologies with rapidly improving accuracies and reduced computational complexity. In particular, architectures using Convolutional Neural Networks (CNNs) have…

Computer Vision and Pattern Recognition · Computer Science 2018-05-11 Sai Samarth R Phaye , Apoorva Sikka , Abhinav Dhall , Deepti Bathula

The pervasiveness of "Internet-of-Things" in our daily life has led to a recent surge in fog computing, encompassing a collaboration of cloud computing and edge intelligence. To that effect, deep learning has been a major driving force…

Machine Learning · Computer Science 2020-05-25 Yinghan Long , Indranil Chakraborty , Kaushik Roy

Transfer learning with models pretrained on ImageNet has become a standard practice in computer vision. Transfer learning refers to fine-tuning pretrained weights of a neural network on a downstream task, typically unrelated to ImageNet.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Xander Coetzer , Arné Schreuder , Anna Sergeevna Bosman

Almost in every heavily computation-dependent application, from 6G communication systems to autonomous driving platforms, a large portion of computing should be near to the client side. Edge computing (AI at Edge) in mobile devices is one…

Hardware Architecture · Computer Science 2024-07-29 Seyed Nima Omidsajedi , Rekha Reddy , Jianming Yi , Jan Herbst , Christoph Lipps , Hans Dieter Schotten

This paper proposes an efficient neural network (NN) architecture design methodology called Chameleon that honors given resource constraints. Instead of developing new building blocks or using computationally-intensive reinforcement…

Computer Vision and Pattern Recognition · Computer Science 2018-12-24 Xiaoliang Dai , Peizhao Zhang , Bichen Wu , Hongxu Yin , Fei Sun , Yanghan Wang , Marat Dukhan , Yunqing Hu , Yiming Wu , Yangqing Jia , Peter Vajda , Matt Uyttendaele , Niraj K. Jha

In existing mobile network systems, the data plane (DP) is mainly considered a pipeline consisting of network elements end-to-end forwarding user data traffics. With the rapid maturity of programmable network devices, however, mobile…

Networking and Internet Architecture · Computer Science 2022-11-15 Jia He , Huanzhuo Wu , Xun Xiao , Riccardo Bassoli , Frank H. P. Fitzek

Reducing inference time and energy usage while maintaining prediction accuracy has become a significant concern for deep neural networks (DNN) inference on resource-constrained edge devices. To address this problem, we propose a novel…

Machine Learning · Computer Science 2024-03-13 Hasanul Mahmud , Peng Kang , Kevin Desai , Palden Lama , Sushil Prasad

The rapid proliferation of computing domains relying on Internet of Things (IoT) devices has created a pressing need for efficient and accurate deep-learning (DL) models that can run on low-power devices. However, traditional DL models tend…

The imperative to deploy Deep Neural Network (DNN) models on resource-constrained edge devices, spurred by privacy concerns, has become increasingly apparent. To facilitate the transition from cloud to edge computing, this paper introduces…

Machine Learning · Computer Science 2024-04-05 Behnam Ghavami , Amin Kamjoo , Lesley Shannon , Steve Wilton

Multi-task learning (MTL) allows deep neural networks to learn from related tasks by sharing parameters with other networks. In practice, however, MTL involves searching an enormous space of possible parameter sharing architectures to find…

Machine Learning · Statistics 2018-11-20 Sebastian Ruder , Joachim Bingel , Isabelle Augenstein , Anders Søgaard

Originated from distributed learning, federated learning enables privacy-preserved collaboration on a new abstracted level by sharing the model parameters only. While the current research mainly focuses on optimizing learning algorithms and…

Machine Learning · Computer Science 2020-09-17 Cong Wang , Yuanyuan Yang , Pengzhan Zhou