English
Related papers

Related papers: Large Language Model-aided Edge Learning in Distri…

200 papers

We consider the problem of distributed mean estimation (DME), in which $n$ machines are each given a local $d$-dimensional vector $x_v \in \mathbb{R}^d$, and must cooperate to estimate the mean of their inputs $\mu = \frac 1n\sum_{v = 1}^n…

Machine Learning · Computer Science 2021-04-08 Peter Davies , Vijaykrishna Gurunathan , Niusha Moshrefi , Saleh Ashkboos , Dan Alistarh

Accurate voltage estimation in distribution networks is critical for real-time monitoring and increasing the reliability of the grid. As DER penetration and distribution level voltage variability increase, robust distribution system state…

Machine Learning · Computer Science 2025-10-21 Muhy Eddin Za'ter , Bri-Mathias Hodge

Autoregressive Large Language Models (AR-LLMs) are widely used in software engineering (SE) but face limitations in processing code structure information and suffer from high inference latency. Diffusion LLMs (DLLMs) offer a promising…

Software Engineering · Computer Science 2025-10-07 Jingyao Zhang , Tianlin Li , Xiaoyu Zhang , Qiang Hu , Bin Shi

Integration of renewable energy sources and emerging loads like electric vehicles to smart grids brings more uncertainty to the distribution system management. Demand Side Management (DSM) is one of the approaches to reduce the uncertainty.…

Machine Learning · Computer Science 2021-09-28 Elahe Khoshbakhti Vaygan , Roozbeh Rajabi , Abouzar Estebsari

Large language models (LLMs) have shown remarkable capabilities in various natural language understanding tasks. With only a few demonstration examples, these LLMs can quickly adapt to target tasks without expensive gradient updates. Common…

Computation and Language · Computer Science 2023-11-14 Yue Yu , Jiaming Shen , Tianqi Liu , Zhen Qin , Jing Nathan Yan , Jialu Liu , Chao Zhang , Michael Bendersky

In official statistics, dual system estimation (DSE) is a well-known tool to estimate the size of a population. Two sources are linked, and the number of units that are missed by both sources is estimated. Often dual system estimation is…

Methodology · Statistics 2025-05-05 Ceejay Hammond , Paul A. Smith , Peter G. M. van der Heijden

Decentralized state estimation in a communication-constrained sensor network is considered. The exchanged estimates are dimension-reduced to reduce the communication load using a linear mapping to a lower-dimensional space. The mean squared…

Systems and Control · Electrical Eng. & Systems 2023-12-13 Robin Forsling , Fredrik Gustafsson , Zoran Sjanic , Gustaf Hendeby

Language models (LMs) are machine learning models designed to predict linguistic patterns by estimating the probability of word sequences based on large-scale datasets, such as text. LMs have a wide range of applications in natural language…

Hybrid AC/DC distribution systems are becoming a popular means to accommodate the increasing penetration of distributed energy resources and flexible loads. This paper proposes a distributed and robust state estimation (DRSE) method for…

Systems and Control · Electrical Eng. & Systems 2020-11-24 Manyun Huang , Junbo Zhao , Zhinong Wei , Marco Pau , Guoqiang Sun

Contemporary power grids are being challenged by rapid voltage fluctuations that are caused by large-scale deployment of renewable generation, electric vehicles, and demand response programs. In this context, monitoring the grid's operating…

Machine Learning · Computer Science 2019-09-04 Liang Zhang , Gang Wang , Georgios B. Giannakis

Large Language Models (LLMs) have achieved significant success in various natural language processing tasks, but the role of wireless networks in supporting LLMs has not been thoroughly explored. In this paper, we propose a wireless…

Machine Learning · Computer Science 2024-11-12 Nan Xue , Yaping Sun , Zhiyong Chen , Meixia Tao , Xiaodong Xu , Liang Qian , Shuguang Cui , Wenjun Zhang , Ping Zhang

Distributed Mean Estimation (DME), in which $n$ clients communicate vectors to a parameter server that estimates their average, is a fundamental building block in communication-efficient federated learning. In this paper, we improve on…

Machine Learning · Computer Science 2023-06-13 Ran Ben Basat , Shay Vargaftik , Amit Portnoy , Gil Einziger , Yaniv Ben-Itzhak , Michael Mitzenmacher

Deep Metric Learning (DML) aims to learn embedding functions that map semantically similar inputs to proximate points in a metric space while separating dissimilar ones. Existing methods, such as pairwise losses, are hindered by complex…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Pedro Silva , Guilherme A. L. Silva , Pablo Coelho , Vander Freitas , Gladston Moreira , David Menotii , Eduardo Luz

We propose a novel deep neural network (DNN) based approximation architecture to learn estimates of measurements. We detail an algorithm that enables training of the DNN. The DNN estimator only uses measurements, if and when they are…

Machine Learning · Computer Science 2022-09-13 Shivangi Agarwal , Sanjit K. Kaul , Saket Anand , P. B. Sujit

Large Language Models (LLMs) have demonstrated impressive performance across various tasks, with different models excelling in distinct domains and specific abilities. Effectively combining the predictions of multiple LLMs is crucial for…

Computation and Language · Computer Science 2025-08-01 Jizhou Guo

We consider the problem of distributed estimation of an unknown deterministic scalar parameter (the target signal) in a wireless sensor network (WSN), where each sensor receives a single snapshot of the field. We assume that the observation…

Information Theory · Computer Science 2015-10-09 Qing Zhou , Di Li , Soummya Kar , Lauren Huie , H. Vincent Poor , Shuguang Cui

Latent neural stochastic differential equations (SDEs) have recently emerged as a promising approach for learning generative models from stochastic time series data. However, they systematically underestimate the noise level inherent in…

Machine Learning · Computer Science 2025-06-11 Linus Heck , Maximilian Gelbrecht , Michael T. Schaub , Niklas Boers

Large Language Models (LLMs) have achieved significant success in various natural language processing tasks, but how wireless communications can support LLMs has not been extensively studied. In this paper, we propose a wireless distributed…

Information Theory · Computer Science 2024-05-07 Nan Xue , Yaping Sun , Zhiyong Chen , Meixia Tao , Xiaodong Xu , Liang Qian , Shuguang Cui , Ping Zhang

Power System State Estimation (PSSE) has been a research area of interest for power engineers for a long period of time. Due to the intermittent nature of renewable energy sources, which are applied in the power network more than before,…

Systems and Control · Electrical Eng. & Systems 2021-01-08 Sajjad Asefi , Sergei Parsegov , Elena Gryazina

In recent years, the use of large language models (LLMs) for text classification has attracted widespread attention. Despite this, the classification accuracy of LLMs has not yet universally surpassed that of smaller models. LLMs can…

Computation and Language · Computer Science 2024-12-11 Min Zeng , Caiquan Liu , Shiqi Zhang , Li Xie , Chen Sang , Xiaoxin Chen