English
Related papers

Related papers: Making Every Bit Count for $A$-Optimal State Estim…

200 papers

Efficient LLM inference research has largely focused on reducing the cost of each decoding step (e.g., using quantization, pruning, or sparse attention), typically applying a uniform computation budget to every generated token. In practice,…

Machine Learning · Computer Science 2026-05-12 Yash Akhauri , Mohamed S. Abdelfattah

Edge intelligence has emerged as a promising strategy to deliver low-latency and ubiquitous services for mobile devices. Recent advances in fine-tuning mechanisms of foundation models have enabled edge intelligence by integrating low-rank…

Signal Processing · Electrical Eng. & Systems 2025-09-25 Jingyi Wang , Zhongyuan Zhao , Qingtian Wang , Zexu Li , Yue Wang , Tony Q. S. Quek

This paper studies the structure of downlink sum-rate maximizing selective decentralized feedback policies for opportunistic beamforming under finite feedback constraints on the average number of mobile users feeding back. Firstly, it is…

Information Theory · Computer Science 2011-07-26 Tharaka Samarasinghe , Hazer Inaltekin , Jamie S. Evans

This paper studies the stability of some reconstruction algorithms for compressed sensing in terms of the bit precision. Considering the fact that practical digital systems deal with discretized signals, we motivate the importance of the…

Information Theory · Computer Science 2009-01-16 Ehsan Ardestanizadeh , Mahdi Cheraghchi , Amin Shokrollahi

Accurately inferring the state of a quantum device from the results of measurements is a crucial task in building quantum information processing hardware. The predominant state estimation procedure, maximum likelihood estimation (MLE),…

Quantum Physics · Physics 2010-05-04 Robin Blume-Kohout

We consider machine learning techniques to develop low-latency approximate solutions to a class of inverse problems. More precisely, we use a probabilistic approach for the problem of recovering sparse stochastic signals that are members of…

Information Theory · Computer Science 2016-09-06 Steffen Limmer , Sławomir Stańczak

In high-dimensional statistics, variable selection recovers the latent sparse patterns from all possible covariate combinations. This paper proposes a novel optimization method to solve the exact L0-regularized regression problem, which is…

Methodology · Statistics 2022-06-02 Mingzhang Yin , Nhat Ho , Bowei Yan , Xiaoning Qian , Mingyuan Zhou

While a practical wireless network has many tiers where end users do not directly communicate with the central server, the users' devices have limited computation and battery powers, and the serving base station (BS) has a fixed bandwidth.…

Systems and Control · Electrical Eng. & Systems 2024-03-26 Md Ferdous Pervej , Richeng Jin , Huaiyu Dai

This paper considers probabilistic estimation of a low-rank matrix from non-linear element-wise measurements of its elements. We derive the corresponding approximate message passing (AMP) algorithm and its state evolution. Relying on…

Information Theory · Computer Science 2016-04-19 Thibault Lesieur , Florent Krzakala , Lenka Zdeborová

A network-based optimization approach, EEE, is proposed for the purpose of providing validation-viable state estimations to remediate the failure of pretrained models. To improve optimization efficiency and convergence, the most important…

Neural and Evolutionary Computing · Computer Science 2023-04-25 Ruiyuan Kang , Dimitrios Kyritsis , Panos Liatsis

Energy saving is becoming an important issue in the design and use of computer networks. In this work we propose a problem that considers the use of rate adaptation as the energy saving strategy in networks. The problem is modeled as an…

Networking and Internet Architecture · Computer Science 2013-02-04 Lin Wang , Antonio Fernández Anta , Fa Zhang , Chenying Hou , Zhiyong Liu

Multichannel frequency estimation with incomplete data and miscellaneous noises arises in array signal processing, modal analysis, wireless communications, and so on. In this paper, we consider maximum-likelihood(-like) optimization methods…

Signal Processing · Electrical Eng. & Systems 2023-07-18 Xunmeng Wu , Zai Yang , Zongben Xu

Edge intelligence enables AI inference at the network edge, co-located with or near the radio access network, rather than in centralized clouds or on mobile devices. It targets low-latency, resource-constrained applications with large data…

Networking and Internet Architecture · Computer Science 2026-01-26 Jaume Anguera Peris , Joakim Jaldén

We apply statistical physics to study the task of resource allocation in random sparse networks with limited bandwidths for the transportation of resources along the links. Useful algorithms are obtained from recursive relations.…

Physics and Society · Physics 2009-11-13 C. H. Yeung , K. Y. Michael Wong

We introduce Bayesian Bits, a practical method for joint mixed precision quantization and pruning through gradient based optimization. Bayesian Bits employs a novel decomposition of the quantization operation, which sequentially considers…

Machine Learning · Computer Science 2020-10-28 Mart van Baalen , Christos Louizos , Markus Nagel , Rana Ali Amjad , Ying Wang , Tijmen Blankevoort , Max Welling

Compressed Sensing suggests that the required number of samples for reconstructing a signal can be greatly reduced if it is sparse in a known discrete basis, yet many real-world signals are sparse in a continuous dictionary. One example is…

Information Theory · Computer Science 2015-07-24 Yuanxin Li , Yuejie Chi

We consider the classical problem of estimating the covariance matrix of a subgaussian distribution from i.i.d. samples in the novel context of coarse quantization, i.e., instead of having full knowledge of the samples, they are quantized…

Information Theory · Computer Science 2022-04-25 Sjoerd Dirksen , Johannes Maly , Holger Rauhut

The objective of the present paper is to introduce the concept of a spatially inhomogeneous linear inverse problem where the degree of ill-posedness of operator $Q$ depends not only on the scale but also on location. In this case, the rates…

Statistics Theory · Mathematics 2013-12-05 Marianna Pensky

State estimation aims at approximately reconstructing the solution $u$ to a parametrized partial differential equation from $m$ linear measurements, when the parameter vector $y$ is unknown. Fast numerical recovery methods have been…

Numerical Analysis · Mathematics 2020-11-25 Albert Cohen , Wolfgang Dahmen , Olga Mula , James Nichols

We consider the parametric data model employed in applications such as line spectral estimation and direction-of-arrival estimation. We focus on the stochastic maximum likelihood estimation (MLE) framework and offer approaches to estimate…

Signal Processing · Electrical Eng. & Systems 2023-04-12 Rohan R. Pote , Bhaskar D. Rao