English
Related papers

Related papers: Error Resilient Collaborative Intelligence via Low…

200 papers

There has been much interest in deploying deep learning algorithms on low-powered devices, including smartphones, drones, and medical sensors. However, full-scale deep neural networks are often too resource-intensive in terms of energy and…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 Yoshitomo Matsubara , Ruihan Yang , Marco Levorato , Stephan Mandt

Low rank tensor representation underpins much of recent progress in tensor completion. In real applications, however, this approach is confronted with two challenging problems, namely (1) tensor rank determination; (2) handling real tensor…

Computer Vision and Pattern Recognition · Computer Science 2017-08-04 Lei Zhang , Wei Wei , Qinfeng Shi , Chunhua Shen , Anton van den Hengel , Yanning Zhang

Collaborative intelligence is a new paradigm for efficient deployment of deep neural networks across the mobile-cloud infrastructure. By dividing the network between the mobile and the cloud, it is possible to distribute the computational…

Image and Video Processing · Electrical Eng. & Systems 2018-06-19 Hyomin Choi , Ivan V. Bajic

The collaboration of large artificial intelligence (AI) models in mobile edge networks has emerged as a promising paradigm to meet the growing demand for intelligent services at the network edge. By enabling multiple devices to…

Networking and Internet Architecture · Computer Science 2026-02-17 Peichun Li , Liping Qian , Dusit Niyato , Shiwen Mao , Yuan Wu

A promising way to deploy Artificial Intelligence (AI)-based services on mobile devices is to run a part of the AI model (a deep neural network) on the mobile itself, and the rest in the cloud. This is sometimes referred to as collaborative…

Multimedia · Computer Science 2019-05-17 Saeed Ranjbar Alvar , Ivan V. Bajić

Collaborative inference has received significant research interest in machine learning as a vehicle for distributing computation load, reducing latency, as well as addressing privacy preservation in communications. Recent collaborative…

Machine Learning · Computer Science 2022-06-17 Jani Boutellier , Bo Tan , Jari Nurmi

AI inference at the edge is becoming increasingly common for low-latency services. However, edge environments are power- and resource-constrained, and susceptible to failures. Conventional failure resilience approaches, such as cloud…

Collaborative inference systems are one of the emerging solutions for deploying deep neural networks (DNNs) at the wireless network edge. Their main idea is to divide a DNN into two parts, where the first is shallow enough to be reliably…

Machine Learning · Computer Science 2023-12-01 Mikolaj Jankowski , Deniz Gunduz , Krystian Mikolajczyk

Due to limited resources on edge and different characteristics of deep neural network (DNN) models, it is a big challenge to optimize DNN inference performance in terms of energy consumption and end-to-end latency on edge devices. In…

Machine Learning · Computer Science 2023-06-26 Ziyang Zhang , Yang Zhao , Huan Li , Changyao Lin , Jie Liu

Deep neural networks (DNN) have shown superior performance in a variety of tasks. As they rapidly evolve, their escalating computation and memory demands make it challenging to deploy them on resource-constrained edge devices. Though…

Machine Learning · Computer Science 2021-09-07 Jiaqi Gu , Hanqing Zhu , Chenghao Feng , Mingjie Liu , Zixuan Jiang , Ray T. Chen , David Z. Pan

As artificial intelligence (AI) applications continue to expand in next-generation networks, there is a growing need for deep neural network (DNN) models. Although DNN models deployed at the edge are promising for providing AI as a service…

Networking and Internet Architecture · Computer Science 2024-08-22 Alireza Maleki , Hamed Shah-Mansouri , Babak H. Khalaj

As a key technology of enabling Artificial Intelligence (AI) applications in 5G era, Deep Neural Networks (DNNs) have quickly attracted widespread attention. However, it is challenging to run computation-intensive DNN-based tasks on mobile…

Networking and Internet Architecture · Computer Science 2019-10-14 En Li , Liekang Zeng , Zhi Zhou , Xu Chen

In collaborative intelligence applications, part of a deep neural network (DNN) is deployed on a relatively low-complexity device such as a mobile phone or edge device, and the remainder of the DNN is processed where more computing…

Machine Learning · Computer Science 2021-05-14 Robert A. Cohen , Hyomin Choi , Ivan V. Bajić

Modern mobile devices are equipped with high-performance hardware resources such as graphics processing units (GPUs), making the end-side intelligent services more feasible. Even recently, specialized silicons as neural engines are being…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-02-04 Amir Erfan Eshratifar , Amirhossein Esmaili , Massoud Pedram

Edge machine learning can deliver low-latency and private artificial intelligent (AI) services for mobile devices by leveraging computation and storage resources at the network edge. This paper presents an energy-efficient edge processing…

Information Theory · Computer Science 2020-03-03 Kai Yang , Yuanming Shi , Wei Yu , Zhi Ding

This paper investigates task-oriented communication for multi-device cooperative edge inference, where a group of distributed low-end edge devices transmit the extracted features of local samples to a powerful edge server for inference.…

Signal Processing · Electrical Eng. & Systems 2023-09-13 Jiawei Shao , Yuyi Mao , Jun Zhang

Edge computing and artificial intelligence (AI), especially deep learning for nowadays, are gradually intersecting to build a novel system, called edge intelligence. However, the development of edge intelligence systems encounters some…

Machine Learning · Computer Science 2021-12-07 Di Liu , Hao Kong , Xiangzhong Luo , Weichen Liu , Ravi Subramaniam

Today's intelligent applications can achieve high performance accuracy using machine learning (ML) techniques, such as deep neural networks (DNNs). Traditionally, in a remote DNN inference problem, an edge device transmits raw data to a…

Machine Learning · Computer Science 2021-06-03 Mounssif Krouka , Anis Elgabli , Chaouki Ben Issaid , Mehdi Bennis

Machine learning at the edge offers great benefits such as increased privacy and security, low latency, and more autonomy. However, a major challenge is that many devices, in particular edge devices, have very limited memory, weak…

Machine Learning · Computer Science 2019-09-05 Yang Li , Thomas Strohmer

To enhance the quality and speed of data processing and protect the privacy and security of the data, edge computing has been extensively applied to support data-intensive intelligent processing services at edge. Among these data-intensive…

Networking and Internet Architecture · Computer Science 2020-10-30 Yana Qin , Danye Wu , Zhiwei Xu , Jie Tian , Yujun Zhang