English
Related papers

Related papers: Deep Partial Updating: Towards Communication Effic…

200 papers

Splitting network computations between the edge device and a server enables low edge-compute inference of neural networks but might expose sensitive information about the test query to the server. To address this problem, existing…

Machine Learning · Computer Science 2021-06-24 Mohammad Samragh , Hossein Hosseini , Aleksei Triastcyn , Kambiz Azarian , Joseph Soriaga , Farinaz Koushanfar

We present statistical methods for big data arising from online analytical processing, where large amounts of data arrive in streams and require fast analysis without storage/access to the historical data. In particular, we develop…

Computation · Statistics 2018-06-13 Elizabeth D. Schifano , Jing Wu , Chun Wang , Jun Yan , Ming-Hui Chen

In gradient-based learning, a step size chosen in parameter units does not produce a predictable per-step change in function output. This often leads to instability in the streaming setting (i.e., batch size=1), where stochasticity is not…

Machine Learning · Computer Science 2026-04-22 Arsalan Sharifnassab , Mohamed Elsayed , Kris De Asis , A. Rupam Mahmood , Richard S. Sutton

Modern mobile devices are equipped with high-performance hardware resources such as graphics processing units (GPUs), making the end-side intelligent services more feasible. Even recently, specialized silicons as neural engines are being…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-02-04 Amir Erfan Eshratifar , Amirhossein Esmaili , Massoud Pedram

We consider a network of smart sensors for an edge computing application that sample a time-varying signal and send updates to a base station for remote global monitoring. Sensors are equipped with sensing and compute, and can either send…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-02-11 Luca Ballotta , Giovanni Peserico , Francesco Zanini , Paolo Dini

We show that combining human prior knowledge with end-to-end learning can improve the robustness of deep neural networks by introducing a part-based model for object classification. We believe that the richer form of annotation helps guide…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Chawin Sitawarin , Kornrapat Pongmala , Yizheng Chen , Nicholas Carlini , David Wagner

In the future 6th generation networks, ultra-reliable and low-latency communications (URLLC) will lay the foundation for emerging mission-critical applications that have stringent requirements on end-to-end delay and reliability. Existing…

Signal Processing · Electrical Eng. & Systems 2020-02-26 Changyang She , Rui Dong , Zhouyou Gu , Zhanwei Hou , Yonghui Li , Wibowo Hardjawana , Chenyang Yang , Lingyang Song , Branka Vucetic

In industrial machine learning pipelines, data often arrive in parts. Particularly in the case of deep neural networks, it may be too expensive to train the model from scratch each time, so one would rather use a previously learned model…

Machine Learning · Statistics 2018-03-29 Max Kochurov , Timur Garipov , Dmitry Podoprikhin , Dmitry Molchanov , Arsenii Ashukha , Dmitry Vetrov

This study proposes a method to enhance neural network performance when training data and application data are not very similar, e.g., out of distribution problems, as well as pattern and regime shifts. The method consists of three main…

Machine Learning · Computer Science 2025-12-04 Jan Saynisch-Wagner , Saran Rajendran Sari

Due to its speed and simplicity, subgradient descent is one of the most used optimization algorithms in convex machine learning algorithms. However, tuning its learning rate is probably its most severe bottleneck to achieve consistent good…

Machine Learning · Computer Science 2023-07-25 Keyi Chen , Francesco Orabona

This paper presents an adaptive framework for edge inference based on a dynamically configurable transformer-powered deep joint source channel coding (DJSCC) architecture. Motivated by a practical scenario where a resource constrained edge…

Machine Learning · Computer Science 2025-05-26 Alessio Devoto , Jary Pomponi , Mattia Merluzzi , Paolo Di Lorenzo , Simone Scardapane

This paper investigates task-oriented communication for edge inference, where a low-end edge device transmits the extracted feature vector of a local data sample to a powerful edge server for processing. It is critical to encode the data…

Signal Processing · Electrical Eng. & Systems 2023-01-19 Jiawei Shao , Yuyi Mao , Jun Zhang

Physics-informed neural networks (PINNs) are extensively employed to solve partial differential equations (PDEs) by ensuring that the outputs and gradients of deep learning models adhere to the governing equations. However, constrained by…

Machine Learning · Computer Science 2025-07-21 Chenhao Si , Ming Yan

Deep neural network (DNN) partition is a research problem that involves splitting a DNN into multiple parts and offloading them to specific locations. Because of the recent advancement in multi-access edge computing and edge intelligence,…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-04-21 Di Xu , Xiang He , Tonghua Su , Zhongjie Wang

Deep edge intelligence aims to deploy deep learning models that demand computationally expensive training in the edge network with limited computational power. Moreover, many deep edge intelligence applications require handling distributed…

Machine Learning · Computer Science 2023-07-28 Ilkay Sikdokur , İnci M. Baytaş , Arda Yurdakul

Freshness of data is an important performance metric for real-time applications, which can be measured by age-of-information. For computation-intensive messages, the embedded information is not available until being computed. In this paper,…

Information Theory · Computer Science 2019-01-16 Jie Gong , Qiaobin Kuang , Xiang Chen , Xiao Ma

The neural network-based approach to solving partial differential equations has attracted considerable attention due to its simplicity and flexibility in representing the solution of the partial differential equation. In training a neural…

Machine Learning · Computer Science 2022-01-10 Jihun Han , Yoonsang Lee

Rare events, despite their infrequency, often carry critical information and require immediate attentions in mission-critical applications such as autonomous driving, healthcare, and industrial automation. The data-intensive nature of these…

Machine Learning · Computer Science 2025-01-07 You Zhou , Changsheng You , Kaibin Huang

Frequent parameter exchanges between clients and the edge server incur substantial communication overhead, posing a critical bottleneck in federated learning (FL). By exploiting the superposition property of wireless waveforms, over-the-air…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-18 Ruihao Du , Jiaqi Zhu , Zeshen Li , Howard H. Yang

Existing approaches to improve the performances of convolutional neural networks by optimizing the local architectures or deepening the networks tend to increase the size of models significantly. In order to deploy and apply the neural…

Computer Vision and Pattern Recognition · Computer Science 2020-01-22 Hui Zhu , Zhulin An , Kaiqiang Xu , Xiaolong Hu , Yongjun Xu