English
Related papers

Related papers: Deterministic Annealing Based Optimization for Zer…

200 papers

The problem of characterizing the optimal rate achievable with analog network coding (ANC) for a unicast communication over general wireless relay networks is computationally hard. A relay node performing ANC scales and forwards its input…

Information Theory · Computer Science 2014-11-03 Samar Agnihotri

The rate optimization for wireless networks with low SNR is investigated. While the capacity in the limit of disappearing SNR is known to be linear for fading and non-fading channels, we study the problem of operating in low SNR wireless…

Information Theory · Computer Science 2010-08-03 Mohit Thakur , Muriel Médard

Distributed network optimization has been studied for well over a decade. However, we still do not have a good idea of how to design schemes that can simultaneously provide good performance across the dimensions of utility optimality,…

Networking and Internet Architecture · Computer Science 2017-07-19 Sinong Wang , Ness Shroff

We consider decentralized stochastic convex optimization on connected network, in which gradients of agents are unavailable and each agent can query only noisy function values of its own local objective. The goal is to minimize the average…

Optimization and Control · Mathematics 2026-03-17 Jiawei Chen , Alexander Rogozin

Optimization is finding the best solution, which mathematically amounts to locating the global minimum of some cost function. Optimization is traditionally automated with digital or quantum computers, each having their limitations and none…

Statistical Mechanics · Physics 2021-11-16 Natalia B. Janson , Christopher J. Marsden

We develop a framework to optimize the tradeoff between diversity, multiplexing, and delay in MIMO systems to minimize end-to-end distortion. We first focus on the diversity-multiplexing tradeoff in MIMO systems, and develop analytical…

Information Theory · Computer Science 2008-04-09 Tim Holliday , Andrea J. Goldsmith , H. Vincent Poor

A general method of coding over expansions is proposed, which allows one to reduce the highly non-trivial problem of coding over continuous channels to a much simpler discrete ones. More specifically, the focus is on the additive…

Information Theory · Computer Science 2012-02-09 O. Ozan Koyluoglu , Kumar Appaiah , Hongbo Si , Sriram Vishwanath

This paper considers rateless network error correction codes for reliable multicast in the presence of adversarial errors. Most existing network error correction codes are designed for a given network capacity and maximum number of errors…

Information Theory · Computer Science 2013-01-15 Wentao Huang , Tracey Ho , Hongyi Yao , Sidharth Jaggi

This work proposes a learning-based statistical refinement method for improving the denoising results of a given denoiser without knowing the precise noise distribution or accessing clean images or calibration data. While there are many…

Machine Learning · Computer Science 2026-05-07 Rihuan Ke

We propose a framework for second-order achievability, called type deviation convergence, that is generally applicable to settings in network information theory, and is especially suitable for lossy source coding and channel coding with…

Information Theory · Computer Science 2025-10-24 Xiang Li , Cheuk Ting Li

In this paper, we showcase the interplay between discrete and continuous optimization in network-structured settings. We propose the first fully decentralized optimization method for a wide class of non-convex objective functions that…

Optimization and Control · Mathematics 2018-02-13 Aryan Mokhtari , Hamed Hassani , Amin Karbasi

This paper studies decentralized stochastic nonconvex optimization problem over row-stochastic networks. We consider the heavy-tailed gradient noise which is empirically observed in many popular real-world applications. Specifically, we…

Optimization and Control · Mathematics 2026-01-19 Menglian Wang , Zhuanghua Liu , Luo Luo

We consider a decentralized convex unconstrained optimization problem, where the cost function can be decomposed into a sum of strongly convex and smooth functions, associated with individual agents, interacting over a static or…

Optimization and Control · Mathematics 2023-12-12 Dmitry Metelev , Aleksandr Beznosikov , Alexander Rogozin , Alexander Gasnikov , Anton Proskurnikov

Artificial neural networks (ANNs) are used in various applications for data-driven black-box modeling and subsequent optimization. Herein, we present an efficient method for deterministic global optimization of ANN embedded optimization…

Optimization and Control · Mathematics 2018-10-16 Artur M Schweidtmann , Alexander Mitsos

An analog source is to be transmitted across a Gaussian channel in more than one channel use per source symbol. This paper derives a lower bound on the asymptotic mean squared error for a strategy that consists of repeatedly quantizing the…

Information Theory · Computer Science 2016-11-17 Marius Kleiner , Bixio Rimoldi

We consider a decentralized learning problem, where a set of computing nodes aim at solving a non-convex optimization problem collaboratively. It is well-known that decentralized optimization schemes face two major system bottlenecks:…

Machine Learning · Computer Science 2019-11-04 Amirhossein Reisizadeh , Hossein Taheri , Aryan Mokhtari , Hamed Hassani , Ramtin Pedarsani

Despite the extensive use of a centralized approach to design receivers at the base station for massive multiple-input multiple-output (M-MIMO) systems, their actual implementation is a major challenge due to several bottlenecks imposed by…

Information Theory · Computer Science 2021-07-26 Victor Croisfelt , Taufik Abrão , Abolfazl Amiri , Elisabeth de Carvalho , Petar Popovski

In this paper, we study Two-way relaying networks well-known for its throughput merits. In particular, we study the fundamental throughput delay trade-off in two-way relaying networks using opportunistic network coding. We characterize the…

Information Theory · Computer Science 2015-02-11 Maha Zohdy , Tamer ElBatt , Mohamed Nafie

Motivated by recent increased interest in optimization algorithms for non-convex optimization in application to training deep neural networks and other optimization problems in data analysis, we give an overview of recent theoretical…

We study the problem of deep joint source-channel coding (D-JSCC) for correlated image sources, where each source is transmitted through a noisy independent channel to the common receiver. In particular, we consider a pair of images…

Information Theory · Computer Science 2022-01-26 Sixian Wang , Ke Yang , Jincheng Dai , Kai Niu