English
Related papers

Related papers: Alternating minimization for computing doubly mini…

200 papers

We propose a distributed algorithm based on Alternating Direction Method of Multipliers (ADMM) to minimize the sum of locally known convex functions using communication over a network. This optimization problem emerges in many applications…

Optimization and Control · Mathematics 2016-01-05 Ali Makhdoumi , Asuman Ozdaglar

We analyze the lattice fermion kinetic term using PT symmetry, R-hermiticity, and $\gamma_{5}$-hermiticity. R-hermiticity is a condition for Hermite action and it is related to $\gamma_{5}$-hermiticity and PT symmetry. Assuming that a…

High Energy Physics - Lattice · Physics 2013-11-20 Syo Kamata , Hidekazu Tanaka

We propose an optimization formulation for the simultaneous estimation of a latent variable and the identification of a linear continuous-time dynamic system, given a single input-output pair. We justify this approach based on Bayesian…

Optimization and Control · Mathematics 2023-06-29 Pierre-Cyril Aubin-Frankowski , Alain Bensoussan , S. Joe Qin

The peak-to-mean envelope power ratio (PMEPR) of a code employed in orthogonal frequency-division multiplexing (OFDM) systems can be reduced by permuting its coordinates and by rotating each coordinate by a fixed phase shift. Motivated by…

Information Theory · Computer Science 2016-11-17 Kai-Uwe Schmidt

In this paper, we consider optimizing a smooth, convex, lower semicontinuous function in Riemannian space with constraints. To solve the problem, we first convert it to a dual problem and then propose a general primal-dual algorithm to…

Machine Learning · Computer Science 2020-05-20 Shijun Wang , Baocheng Zhu , Lintao Ma , Yuan Qi

Starting from the exact Projected Central Limit Theorem on hyperspheres, we rederive the Beta distribution for subsystem occupation probabilities and Lubkin's purity formula from elementary hyperspherical moments, quantifying the…

Quantum Physics · Physics 2026-05-29 Zhi-Wei Wang , Pei-Wen Li , Samuel L. Braunstein

The alternating direction method of multipliers (ADMM) is widely used for solving large-scale semidefinite programs (SDPs), yet on instances with multiple primal-dual optimal solution pairs, it often enters prolonged slow-convergence…

Optimization and Control · Mathematics 2026-03-04 Shucheng Kang , Heng Yang

For $\alpha,z>0$ with $\alpha\ne1$, motivated by comparison between different kinds of R\'enyi divergences in quantum information, we consider log-majorization between the matrix functions \begin{align*}…

Functional Analysis · Mathematics 2018-08-14 Fumio Hiai

Given two density matrices $\rho$ and $\sigma$, there are a number of different expressions that reduce to the $\alpha$-R\'enyi relative entropy of $\rho$ with respect to $\sigma$ in the classical case; i.e., when $\rho$ and $\sigma$…

Mathematical Physics · Physics 2018-11-14 Eric A. Carlen , Rupert L. Frank , Elliott H. Lieb

We investigate the universal inequalities relating the alpha-Renyi entropies of the marginals of a multi-partite quantum state. This is in analogy to the same question for the Shannon and von Neumann entropy (alpha=1) which are known to…

Quantum Physics · Physics 2013-12-24 Noah Linden , Milán Mosonyi , Andreas Winter

A few iterations of alternating least squares with a random starting point provably suffice to produce nearly optimal spectral- and Frobenius-norm accuracies of low-rank approximations to a matrix; iterating to convergence is unnecessary.…

Numerical Analysis · Mathematics 2017-06-02 Arthur Szlam , Andrew Tulloch , Mark Tygert

We study the computation of the rate-distortion-perception function (RDPF) for discrete memoryless sources subject to a single-letter average distortion constraint and a perception constraint belonging to the family of $f$-divergences. In…

Information Theory · Computer Science 2025-09-11 Giuseppe Serra , Photios A. Stavrou , Marios Kountouris

In this paper, we study the problem of multiple change-point detection for a univariate sequence under the epidemic setting, where the behavior of the sequence alternates between a common normal state and different epidemic states. This is…

Methodology · Statistics 2021-01-07 Zifeng Zhao , Chun Yip Yau

Mutual Information (MI) is a crucial measure for capturing dependencies between variables, but exact computation is challenging in high dimensions with intractable likelihoods, impacting accuracy and robustness. One idea is to use an…

Machine Learning · Statistics 2025-03-13 Forough Fazeliasl , Michael Minyi Zhang , Bei Jiang , Linglong Kong

A uniform matrix product state defined on a tripartite system of spins, denoted by $ABC,$ is shown to be an approximate quantum Markov chain when the size of subsystem $B,$ denoted $|B|,$ is large enough. The quantum conditional mutual…

Quantum Physics · Physics 2024-03-07 Pavel Svetlichnyy , Shivan Mittal , T. A. B. Kennedy

We present theoretical guarantees for an alternating minimization algorithm for the dictionary learning/sparse coding problem. The dictionary learning problem is to factorize vector samples $y^{1},y^{2},\ldots, y^{n}$ into an appropriate…

Machine Learning · Statistics 2019-08-01 Niladri S. Chatterji , Peter L. Bartlett

In this paper, we consider a class of nonconvex problems with linear constraints appearing frequently in the area of image processing. We solve this problem by the penalty method and propose the iteratively reweighted alternating…

Optimization and Control · Mathematics 2019-02-13 Tao Sun , Dongsheng Li , Hao Jiang , Zhe Quan

Primal-dual algorithms are frequently used for iteratively solving large-scale convex optimization problems. The analysis of such algorithms is usually done on a case-by-case basis, and the resulting guaranteed rates of convergence can be…

Optimization and Control · Mathematics 2023-09-21 Bryan Van Scoy , John W. Simpson-Porco , Laurent Lessard

Alternating Direction Method of Multipliers (ADMM) is a popular algorithm for distributed learning, where a network of nodes collaboratively solve a regularized empirical risk minimization by iterative local computation associated with…

Machine Learning · Computer Science 2020-05-19 Zonghao Huang , Yanmin Gong

We study the convergence rate of the alternating projection method (APM) applied to the intersection of an affine subspace and the second-order cone. We show that when they intersect non-transversally, the convergence rate is $O(k^{-1/2})$,…

Optimization and Control · Mathematics 2024-01-05 Hiroyuki Ochiai , Yoshiyuki Sekiguchi , Hayato Waki