English
Related papers

Related papers: Optimal Trade-offs in Multi-Processor Approximate …

200 papers

The generalized approximate message passing (GAMP) algorithm under the Bayesian setting shows advantage in recovering under-sampled sparse signals from corrupted observations. Compared to conventional convex optimization methods, it has a…

Information Theory · Computer Science 2017-01-12 Shuai Huang , Trac D. Tran

Marginal MAP problems are notoriously difficult tasks for graphical models. We derive a general variational framework for solving marginal MAP problems, in which we apply analogues of the Bethe, tree-reweighted, and mean field…

Machine Learning · Computer Science 2013-02-28 Qiang Liu , Alexander T. Ihler

We consider distributed statistical optimization in one-shot setting, where there are $m$ machines each observing $n$ i.i.d. samples. Based on its observed samples, each machine sends a $B$-bit-long message to a server. The server then…

Machine Learning · Computer Science 2020-01-01 Saber Salehkaleybar , Arsalan Sharifnassab , S. Jamaloddin Golestani

We study the problem of estimating a rank-$1$ signal in the presence of rotationally invariant noise-a class of perturbations more general than Gaussian noise. Principal Component Analysis (PCA) provides a natural estimator, and sharp…

Machine Learning · Statistics 2021-10-15 Marco Mondelli , Ramji Venkataramanan

The current evolution towards a massive number of antennas and a large variety of transceiver architectures forces to revisit the conventional techniques used to improve the fundamental power amplifier (PA) linearity-efficiency trade-off.…

Signal Processing · Electrical Eng. & Systems 2024-04-22 François Rottenberg , Thomas Feys , Nuutti Tervo

In integrated sensing and communication (ISAC) networks, multiple base stations (BSs) collaboratively sense a common target, leveraging diversity from multiple observation perspectives and joint signal processing to enhance sensing…

Signal Processing · Electrical Eng. & Systems 2026-02-10 Xiaohan Lv , Rang Liu , Yi Chen , Qian Liu , Ming Li

We study the excess mean square error (EMSE) above the minimum mean square error (MMSE) in large linear systems where the posterior mean estimator (PME) is evaluated with a postulated prior that differs from the true prior of the input…

Information Theory · Computer Science 2015-05-18 Yanting Ma , Dror Baron , Ahmad Beirami

Tasks in multi-task learning often correlate, conflict, or even compete with each other. As a result, a single solution that is optimal for all tasks rarely exists. Recent papers introduced the concept of Pareto optimality to this field and…

Machine Learning · Computer Science 2020-08-28 Pingchuan Ma , Tao Du , Wojciech Matusik

Solving multi-objective optimization problems for large deep neural networks is a challenging task due to the complexity of the loss landscape and the expensive computational cost of training and evaluating models. Efficient Pareto front…

Machine Learning · Computer Science 2024-06-17 Anke Tang , Li Shen , Yong Luo , Shiwei Liu , Han Hu , Bo Du

Pairwise comparison data arise in many domains with subjective assessment experiments, for example in image and video quality assessment. In these experiments observers are asked to express a preference between two conditions. However, many…

Machine Learning · Computer Science 2020-04-14 Aliaksei Mikhailiuk , Clifford Wilmot , Maria Perez-Ortiz , Dingcheng Yue , Rafal Mantiuk

The application of current generation computing machines in safety-centric applications like implantable biomedical chips and automobile safety has immensely increased the need for reviewing the worst-case error behavior of computing…

Information Theory · Computer Science 2021-08-23 Karthikeyan Lingasubramanian , Syed M. Alam , Sanjukta Bhanja

Sparse structure learning in high-dimensional Gaussian graphical models is an important problem in multivariate statistical signal processing; since the sparsity pattern naturally encodes the conditional independence relationship among…

Methodology · Statistics 2023-09-26 Ksheera Sagar , Jyotishka Datta , Sayantan Banerjee , Anindya Bhadra

Meshless methods approximate operators in a specific node as a weighted sum of values in its neighbours. Higher order approximations of derivatives provide more accurate solutions with better convergence characteristics, but they come at…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-12 Jon Vehovar , Miha Rot , Gregor Kosec

While globally optimal solutions to many convex programs can be computed efficiently in polynomial time, this is, in general, not possible for nonconvex optimization problems. Therefore, locally optimal approaches or other efficient…

Information Theory · Computer Science 2020-07-03 Bho Matthiesen , Christoph Hellings , Eduard A. Jorswieck , Wolfgang Utschick

Many problems of interest for cyber-physical network systems can be formulated as Mixed Integer Linear Programs in which the constraints are distributed among the agents. In this paper we propose a distributed algorithm to solve this class…

Optimization and Control · Mathematics 2017-12-06 Andrea Testa , Alessandro Rucco , Giuseppe Notarstefano

We present a message-passing algorithm to solve the edge disjoint path problem (EDP) on graphs incorporating under a unique framework both traffic optimization and path length minimization. The min-sum equations for this problem present an…

Disordered Systems and Neural Networks · Physics 2016-01-21 Fabrizio Altarelli , Alfredo Braunstein , Luca Dall'Asta , Caterina De Bacco , Silvio Franz

Expensive multi-objective optimization problems can be found in many real-world applications, where their objective function evaluations involve expensive computations or physical experiments. It is desirable to obtain an approximate Pareto…

Neural and Evolutionary Computing · Computer Science 2022-10-18 Xi Lin , Zhiyuan Yang , Xiaoyuan Zhang , Qingfu Zhang

In this work, we address the problem of estimating sparse communication channels in OFDM systems in the presence of carrier frequency offset (CFO) and unknown noise variance. To this end, we consider a convex optimization problem, including…

Information Theory · Computer Science 2013-11-15 Rodrigo Carvajal , Boris I. Godoy , Juan C. Agüero

In order to reduce hardware complexity and power consumption, massive multiple-input multiple-output (MIMO) systems employ low-resolution analog-to-digital converters (ADCs) to acquire quantized measurements $\boldsymbol y$. This poses new…

Information Theory · Computer Science 2021-02-12 Shuai Huang , Deqiang Qiu , Trac D. Tran

This paper is devoted to the design of precoders maximizing the ergodic mutual information (EMI) of bi-correlated flat fading MIMO systems equiped with MMSE receivers. The channel state information and the second order statistics of the…

Information Theory · Computer Science 2016-11-17 Cedric Artigue , Philippe Loubaton