English
Related papers

Related papers: A Simple Proof for the Optimality of Randomized Po…

200 papers

The traditional information theoretic approach to studying feedback is to consider ideal instantaneous high-rate feedback of the channel outputs to the encoder. This was acceptable in classical work because the results were negative:…

Information Theory · Computer Science 2007-12-07 Anant Sahai

We propose a new theoretical model for passively mobile Wireless Sensor Networks, called PM, standing for Passively mobile Machines. The main modification w.r.t. the Population Protocol model is that agents now, instead of being automata,…

Computational Complexity · Computer Science 2010-12-14 Ioannis Chatzigiannakis , Othon Michail , Stavros Nikolaou , Andreas Pavlogiannis , Paul G. Spirakis

Maximum a posteriori (MAP) inference is a fundamental computational paradigm for statistical inference. In the setting of graphical models, MAP inference entails solving a combinatorial optimization problem to find the most likely…

Machine Learning · Computer Science 2020-03-03 Jonathan N. Lee , Aldo Pacchiano , Michael I. Jordan

This paper considers a sequential sensor scheduling and remote estimation problem with multiple communication channels. Departing from the classical remote estimation paradigm, which involves one communication channel (noiseless or noisy),…

Systems and Control · Computer Science 2018-04-10 Xiaobin Gao , Emrah Akyol , Tamer Basar

We consider the estimation of a signal from the knowledge of its noisy linear random Gaussian projections. A few examples where this problem is relevant are compressed sensing, sparse superposition codes, and code division multiple access.…

Information Theory · Computer Science 2020-08-31 Jean Barbier , Nicolas Macris , Mohamad Dia , Florent Krzakala

This paper formulates and solves a sequential detection problem that involves the mutual information (stochastic observability) of a Gaussian process observed in noise with missing measurements. The main result is that the optimal decision…

Optimization and Control · Mathematics 2015-05-30 Vikram Krishnamurthy , Robert Bitmead , Michel Gevers , Erik Miehling

In this paper, we consider a network of processors aiming at cooperatively solving mixed-integer convex programs subject to uncertainty. Each node only knows a common cost function and its local uncertain constraint set. We propose a…

Optimization and Control · Mathematics 2022-07-19 Mohammadreza Chamanbaz , Giuseppe Notarstefano , Francesco Sasso , Roland Bouffanais

The reliability function of a channel is the maximum achievable exponential rate of decay of the error probability as a function of the transmission rate. In this work, we derive bounds on the reliability function of discrete memoryless…

Information Theory · Computer Science 2023-06-13 Mohsen Heidari , Achilleas Anastasopoulos , S. Sandeep Pradhan

We consider the sequential quantum channel discrimination problem using adaptive and non-adaptive strategies. In this setting the number of uses of the underlying quantum channel is not fixed but a random variable that is either bounded in…

Information Theory · Computer Science 2022-10-21 Yonglong Li , Christoph Hirche , Marco Tomamichel

Sample-efficient exploration is crucial not only for discovering rewarding experiences but also for adapting to environment changes in a task-agnostic fashion. A principled treatment of the problem of optimal input synthesis for system…

Machine Learning · Computer Science 2019-10-10 Matthias Schultheis , Boris Belousov , Hany Abdulsamad , Jan Peters

This study focuses on solving group zero-norm regularized robust loss minimization problems. We propose a proximal Majorization-Minimization (PMM) algorithm to address a class of equivalent Difference-of-Convex (DC) surrogate optimization…

Optimization and Control · Mathematics 2025-05-30 Ling Liang , Shujun Bi

This paper considers the problem of variable-length coding over a discrete memoryless channel (DMC) with noiseless feedback. The paper provides a stochastic control view of the problem whose solution is analyzed via a newly proposed…

Information Theory · Computer Science 2016-11-18 Mohammad Naghshvar , Tara Javidi , Michèle Wigger

We develop a predictive-first optimisation framework for streaming hidden Markov models. Unlike classical approaches that prioritise full posterior recovery under a fully specified generative model, we assume access to regime-specific…

Machine Learning · Statistics 2026-04-13 Gerardo Duran-Martin

Policy Mirror Descent (PMD) is a general family of algorithms that covers a wide range of novel and fundamental methods in reinforcement learning. Motivated by the instability of policy iteration (PI) with inexact policy evaluation, PMD…

Optimization and Control · Mathematics 2023-11-23 Emmeran Johnson , Ciara Pike-Burke , Patrick Rebeschini

This paper studies the structure of downlink sum-rate maximizing selective decentralized feedback policies for opportunistic beamforming under finite feedback constraints on the average number of mobile users feeding back. Firstly, it is…

Information Theory · Computer Science 2011-07-26 Tharaka Samarasinghe , Hazer Inaltekin , Jamie S. Evans

This paper considers a sequential estimation and sensor scheduling problem with one sensor and one estimator. The sensor makes sequential observations about the state of an underlying memoryless stochastic process, and makes a decision as…

Systems and Control · Computer Science 2016-11-17 Xiaobin Gao , Emrah Akyol , Tamer Basar

This work proposes lossless and near-lossless compression algorithms for multi-channel biomedical signals. The algorithms are sequential and efficient, which makes them suitable for low-latency and low-power signal transmission…

Information Theory · Computer Science 2016-05-17 Ignacio Capurro , Federico Lecumberry , Álvaro Martín , Ignacio Ramírez , Eugenio Rovira , Gadiel Seroussi

Phase retrieval (PR) is a popular research topic in signal processing and machine learning. However, its performance degrades significantly when the measurements are corrupted by noise or outliers. To address this limitation, we propose a…

Optimization and Control · Mathematics 2025-05-30 Jun Fan , Ailing Yan , Xianchao Xiu , Wanquan Liu

Policy Mirror Descent (PMD) stands as a versatile algorithmic framework encompassing several seminal policy gradient algorithms such as natural policy gradient, with connections with state-of-the-art reinforcement learning (RL) algorithms…

Machine Learning · Computer Science 2024-11-07 Kimon Protopapas , Anas Barakat

Many speech and music analysis and processing schemes rely on an estimate of the fundamental frequency $f_0$ of periodic signal components. Most established schemes apply rather unspecific signal models such as sinusoidal models to the…

Sound · Computer Science 2021-12-23 Volker Hohmann