English
Related papers

Related papers: An Efficient Alternating Minimization Algorithm fo…

200 papers

The alternating least squares algorithm for CP and Tucker decomposition is dominated in cost by the tensor contractions necessary to set up the quadratic optimization subproblems. We introduce a novel family of algorithms that uses…

Numerical Analysis · Mathematics 2021-04-15 Linjian Ma , Edgar Solomonik

This paper considers an optimization problem that components of the objective function are available at different nodes of a network and nodes are allowed to only exchange information with their neighbors. The decentralized alternating…

Optimization and Control · Mathematics 2015-11-27 Aryan Mokhtari , Wei Shi , Qing Ling , Alejandro Ribeiro

The Augmented Lagrangian Method (ALM) is an iterative method for the solution of equality-constrained non-linear programming problems. In contrast to the quadratic penalty method, the ALM can satisfy equality constraints in an exact way.…

Numerical Analysis · Mathematics 2018-04-24 Martin Neuenhofen

We propose a modified expectation-maximization algorithm by introducing the concept of quantum annealing, which we call the deterministic quantum annealing expectation-maximization (DQAEM) algorithm. The expectation-maximization (EM)…

Machine Learning · Statistics 2017-01-13 Hideyuki Miyahara , Koji Tsumura , Yuki Sughiyama

Higher-order low-rank tensors naturally arise in many applications including hyperspectral data recovery, video inpainting, seismic data recon- struction, and so on. We propose a new model to recover a low-rank tensor by simultaneously…

Numerical Analysis · Computer Science 2015-07-07 Yangyang Xu , Ruru Hao , Wotao Yin , Zhixun Su

The alternating direction method of multipliers (ADMM) is a popular method for solving convex separable minimization problems with linear equality constraints. The generalization of the two-block ADMM to the three-block ADMM is not trivial…

Optimization and Control · Mathematics 2021-05-10 Yang Yang , Yuchao Tang , Jigen Peng

Quantization of the parameters of machine learning models, such as deep neural networks, requires solving constrained optimization problems, where the constraint set is formed by the Cartesian product of many simple discrete sets. For such…

Optimization and Control · Mathematics 2021-03-02 Tianjian Huang , Prajwal Singhania , Maziar Sanjabi , Pabitra Mitra , Meisam Razaviyayn

We propose a framework to solve non-linear and history-dependent mechanical problems based on a hybrid classical computer -- quantum annealer approach. Quantum Computers are anticipated to solve particular operations exponentially faster.…

Computational Engineering, Finance, and Science · Computer Science 2024-02-20 Van-Dung Nguyen , Ling Wu , Françoise Remacle , Ludovic Noels

We formulate em algorithm in the framework of Bregman divergence, which is a general problem setting of information geometry. That is, we address the minimization problem of the Bregman divergence between an exponential subfamily and a…

Information Theory · Computer Science 2024-09-10 Masahito Hayashi

Quantum annealing has emerged as a powerful tool for solving combinatorial optimization problems efficiently, making use of the principles of quantum mechanics. Companies are increasingly investing in the market of quantum computers,…

Quantum Physics · Physics 2025-09-29 Lorenzo Mazzei , Giada Beccari , Mirko Laruina , Marco Cococcioni

The demand for classical-quantum hybrid algorithms to solve large-scale combinatorial optimization problems using quantum annealing (QA) has increased. One approach involves obtaining an approximate solution using classical algorithms and…

Quantum Physics · Physics 2024-11-12 Taisei Takabayashi , Masayuki Ohzeki

We present a quantum algorithm for finding the minimum of a function based on multistep quantum computation and apply it for optimization problems with continuous variables, in which the variables of the problem are discretized to form the…

Quantum Physics · Physics 2023-07-03 Hefeng Wang , Hua Xiang

This paper introduces an algorithm for the nonnegative matrix factorization-and-completion problem, which aims to find nonnegative low-rank matrices X and Y so that the product XY approximates a nonnegative data matrix M whose elements are…

Information Theory · Computer Science 2015-11-23 Yangyang Xu , Wotao Yin , Zaiwen Wen , Yin Zhang

I introduce rate-distortion theory for quantum coding, and derive a lower bound, involving the coherent information, on the rate at which qubits must be used to encode a quantum source with a given maximum level of distortion per source…

Quantum Physics · Physics 2007-05-23 Howard Barnum

An earlier work [18] proposes a method for solving the Lagrangian dual of a constrained binary quadratic programming problem via quantum adiabatic evolution using an outer approximation method. This should be an efficient prescription for…

Optimization and Control · Mathematics 2019-01-07 Sahar Karimi , Pooya Ronagh

We present theoretical guarantees for an alternating minimization algorithm for the dictionary learning/sparse coding problem. The dictionary learning problem is to factorize vector samples $y^{1},y^{2},\ldots, y^{n}$ into an appropriate…

Machine Learning · Statistics 2019-08-01 Niladri S. Chatterji , Peter L. Bartlett

Rate distortion theory treats the problem of encoding a source with minimum codebook size while at the same time allowing for a certain amount of errors in the reconstruction measured by a fidelity criterion and distortion level. Similar to…

Information Theory · Computer Science 2025-11-13 Jonathan E. W. Huffmann , Holger Boche

In a typical video rate allocation problem, the objective is to optimally distribute a source rate budget among a set of (in)dependently coded data units to minimize the total distortion of all units. Conventional Lagrangian approaches…

Multimedia · Computer Science 2016-03-22 Ana De Abreu , Gene Cheung , Pascal Frossard , Fernando Pereira

We analyze the performance of alternating minimization for loss functions optimized over two variables, where each variable may be restricted to lie in some potentially nonconvex constraint set. This type of setting arises naturally in…

Optimization and Control · Mathematics 2019-02-26 Wooseok Ha , Rina Foygel Barber

Combinatorial optimization is a promising application for near-term quantum computers, however, identifying performant algorithms suited to noisy quantum hardware remains as an important goal to potentially realizing quantum computational…

Quantum Physics · Physics 2025-04-01 Titus D. Morris , Ananth Kaushik , Martin Roetteler , Phillip C. Lotshaw