English
Related papers

Related papers: Pareto-Optimal Bit Allocation for Collaborative In…

200 papers

Graph Neural Networks (GNNs) are powerful tools for processing graph-structured data, increasingly used for large-scale real-world graphs via sampling-based inference methods. However, inherent characteristics of neighbor sampling lead to…

Hardware Architecture · Computer Science 2025-03-04 Yi Luo , Yaobin Wang , Qi Wang , Yingchen Song , Huan Wu , Qingfeng Wang , Jun Huang

This paper presents an overview of the emerging area of collaborative intelligence (CI). Our goal is to raise awareness in the signal processing community of the challenges and opportunities in this area of growing importance, where key…

Image and Video Processing · Electrical Eng. & Systems 2021-02-16 Ivan V. Bajić , Weisi Lin , Yonghong Tian

The cloud-based solutions are becoming inefficient due to considerably large time delays, high power consumption, security and privacy concerns caused by billions of connected wireless devices and typically zillions bytes of data they…

Systems and Control · Electrical Eng. & Systems 2022-08-02 Xiaolan Liu , Jiadong Yu , Yuanwei Liu , Yue Gao , Toktam Mahmoodi , Sangarapillai Lambotharan , Danny H. K. Tsang

Collaborative intelligence is a new paradigm for efficient deployment of deep neural networks across the mobile-cloud infrastructure. By dividing the network between the mobile and the cloud, it is possible to distribute the computational…

Image and Video Processing · Electrical Eng. & Systems 2018-06-19 Hyomin Choi , Ivan V. Bajic

In recent years, deep learning models have become ubiquitous in industry and academia alike. Deep neural networks can solve some of the most complex pattern-recognition problems today, but come with the price of massive compute and memory…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-05-24 Shreshth Tuli , Giuliano Casale , Nicholas R. Jennings

Distributed learning algorithms aim to leverage distributed and diverse data stored at users' devices to learn a global phenomena by performing training amongst participating devices and periodically aggregating their local models'…

Machine Learning · Computer Science 2021-02-04 Naram Mhaisen , Alaa Awad , Amr Mohamed , Aiman Erbad , Mohsen Guizani

We consider a wireless device-to-device (D2D) cooperative network where memory-endowed nodes store and exchange content. Each node generates random file requests following an unknown and possibly arbitrary spatio-temporal process, and a…

Networking and Internet Architecture · Computer Science 2019-05-07 Georgios S. Paschos , Apostolos Destounis , George Iosifidis

Compound AI applications chain together subcomponents such as generative language models, document retrievers, and embedding models. Applying traditional systems optimizations such as parallelism and pipelining in compound AI systems is…

Distributing the inference of convolutional neural network (CNN) to multiple mobile devices has been studied in recent years to achieve real-time inference without losing accuracy. However, how to map CNN to devices remains a challenge. On…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-03-26 Xiang Yang , Zikang Xu , Qi Qi , Jingyu Wang , Haifeng Sun , Jianxin Liao , Song Guo

We propose a novel decomposition framework for the distributed optimization of Difference Convex (DC)-type nonseparable sum-utility functions subject to coupling convex constraints. A major contribution of the paper is to develop for the…

Information Theory · Computer Science 2013-09-23 Alberth Alvarado , Gesualdo Scutari , Jong-Shi Pang

Multi-task learning, which optimizes performance across multiple tasks, is inherently a multi-objective optimization problem. Various algorithms are developed to provide discrete trade-off solutions on the Pareto front. Recently, continuous…

Machine Learning · Computer Science 2024-07-31 Weiyu Chen , James T. Kwok

As the amount of data collected for crowdsensing applications increases rapidly due to improved sensing capabilities and the increasing number of Internet of Things (IoT) devices, the cloud server is no longer able to handle the large-scale…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-12-10 Jer Shyuan Ng , Wei Yang Bryan Lim , Sahil Garg , Zehui Xiong , Dusit Niyato , Mohsen Guizani , Cyril Leung

Deep Neural Network (DNN) applications with edge computing presents a trade-off between responsiveness and computational resources. On one hand, edge computing can provide high responsiveness deploying computational resources close to end…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-01-29 Roberto G. Pacheco , Rodrigo S. Couto

Adaptive networks are suitable for decentralized inference tasks, e.g., to monitor complex natural phenomena. Recent research works have intensively studied distributed optimization problems in the case where the nodes have to estimate a…

Multiagent Systems · Computer Science 2023-07-19 Jie Chen , Cédric Richard , Ali. H. Sayed

Depth image based rendering techniques for multiview applications have been recently introduced for efficient view generation at arbitrary camera positions. Encoding rate control has thus to consider both texture and depth data. Due to…

Computer Vision and Pattern Recognition · Computer Science 2012-11-20 Boshra Rajaei , Thomas Maugey , Hamid-Reza Pourreza , Pascal Frossard

Deep convolutional neural network (CNN) achieves remarkable performance for medical image analysis. UNet is the primary source in the performance of 3D CNN architectures for medical imaging tasks, including brain tumor segmentation. The…

Image and Video Processing · Electrical Eng. & Systems 2020-11-30 Parvez Ahmad , Saqib Qamar , Linlin Shen , Adnan Saeed

A key feature of neural network architectures is their ability to support the simultaneous interaction among large numbers of units in the learning and processing of representations. However, how the richness of such interactions trades off…

Distributed optimization consists of multiple computation nodes working together to minimize a common objective function through local computation iterations and network-constrained communication steps. In the context of robotics,…

Robotics · Computer Science 2021-03-25 Trevor Halsted , Ola Shorinwa , Javier Yu , Mac Schwager

Edge computing is naturally suited to the applications generated by Internet of Things (IoT) nodes. The IoT applications generally take the form of directed acyclic graphs (DAGs), where vertices represent interdependent functions and edges…

Networking and Internet Architecture · Computer Science 2020-12-09 Hailiang Zhao , Shuiguang Deng , Zijie Liu , Zhengzhe Xiang , Jianwei Yin

Inference over large-scale foundation models within heterogeneous edge environments necessitates a fundamentally reconfigurable orchestration substrate. Static partitioning of model layers presumes temporal stability across compute and…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-02-09 Aladin Djuhera , Fernando Koch , Alecio Binotto