English
Related papers

Related papers: Accelerated optimization of measured relative entr…

200 papers

The quantum Renyi relative entropies play a prominent role in quantum information theory, finding applications in characterizing error exponents and strong converse exponents for quantum hypothesis testing and quantum communication theory.…

Quantum Physics · Physics 2018-07-26 Kaushik P. Seshadreesan , Ludovico Lami , Mark M. Wilde

In the absence of a reference frame for transformations associated with a group G, any quantum state that is non-invariant under the action of G may serve as a token of the missing reference frame. We here introduce a novel measure of the…

Quantum Physics · Physics 2009-07-14 Gilad Gour , Iman Marvian , Robert W. Spekkens

The aim of the present paper is to give axiomatic characterization of quantum relative entropy utilizing resource conversion scenario. We consider two sets of axioms: non-asymptotic and asymptotic. In the former setting, we prove that the…

Quantum Physics · Physics 2010-10-07 Keiji Matsumoto

We derive efficient algorithms to compute weakly Pareto optimal solutions for smooth, convex and unconstrained multiobjective optimization problems in general Hilbert spaces. To this end, we define a novel inertial gradient-like dynamical…

Optimization and Control · Mathematics 2022-07-27 Konstantin Sonntag , Sebastian Peitz

Composite convex optimization models arise in several applications, and are especially prevalent in inverse problems with a sparsity inducing norm and in general convex optimization with simple constraints. The most widely used algorithms…

Optimization and Control · Mathematics 2016-07-15 Vahan Hovhannisyan , Panos Parpas , Stefanos Zafeiriou

We use the relative modular operator to define a generalized relative entropy for any convex operator function g on the positive real line satisfying g(1) = 0. We show that these convex operator functions can be partitioned into convex…

Mathematical Physics · Physics 2015-06-26 Andrew Lesniewski , Mary Beth Ruskai

We explore a large class of correlation measures called the $\alpha-z$ R\'enyi mutual informations (RMIs). Unlike the commonly used notion of RMI involving linear combinations of R\'enyi entropies, the $\alpha-z$ RMIs are positive…

High Energy Physics - Theory · Physics 2024-08-27 Jonah Kudler-Flam , Laimei Nie , Akash Vijay

In a Hilbert setting, we develop fast methods for convex unconstrained optimization. We rely on the asymptotic behavior of an inertial system combining geometric damping with temporal scaling. The convex function to minimize enters the…

Optimization and Control · Mathematics 2020-09-17 Hedy Attouch , Aicha Balhag , Zaki Chbani , Hassan Riahi

The R{\'e}nyi entropy is one of the important information measures that generalizes Shannon's entropy. The quantum R{\'e}nyi entropy has a fundamental role in quantum information theory, therefore, bounding this quantity is of vital…

Mathematical Physics · Physics 2016-09-26 Hadi Reisizadeh , S. Mahmoud Manjegani

In this short note, we provide a simple version of an accelerated forward-backward method (a.k.a. Nesterov's accelerated proximal gradient method) possibly relying on approximate proximal operators and allowing to exploit strong convexity…

Optimization and Control · Mathematics 2022-01-24 Mathieu Barré , Adrien Taylor , Francis Bach

In this paper, we propose a unified view of gradient-based algorithms for stochastic convex composite optimization by extending the concept of estimate sequence introduced by Nesterov. More precisely, we interpret a large class of…

Machine Learning · Statistics 2020-09-07 Andrei Kulunchakov , Julien Mairal

The sandwiched R\'enyi divergences of two finite-dimensional density operators quantify their asymptotic distinguishability in the strong converse domain. This establishes the sandwiched R\'enyi divergences as the operationally relevant…

Quantum Physics · Physics 2025-08-12 Milán Mosonyi

This thesis addresses the interplay between asymptotic hypothesis testing and entropy inequalities in quantum information theory. In the first part of the thesis we focus on hypothesis testing. We consider two main settings; one can either…

Quantum Physics · Physics 2018-12-14 Christoph Hirche

R\'enyi complexity ratio of two density functions is introduced for three and multidimensional quantum systems. Localization property of several density functions are defined and five theorems about near continuous property of R\'enyi…

Mathematical Physics · Physics 2021-06-29 Debraj Nath

This paper considers the recovery of a rank $r$ positive semidefinite matrix $X X^T\in\mathbb{R}^{n\times n}$ from $m$ scalar measurements of the form $y_i := a_i^T X X^T a_i$ (i.e., quadratic measurements of $X$). Such problems arise in a…

Numerical Analysis · Mathematics 2016-06-02 Chris D. White , Sujay Sanghavi , Rachel Ward

A task is randomly drawn from a finite set of tasks and is described using a fixed number of bits. All the tasks that share its description must be performed. Upper and lower bounds on the minimum $\rho$-th moment of the number of performed…

Information Theory · Computer Science 2014-10-07 Christoph Bunte , Amos Lapidoth

We introduce a variant of the R\'enyi entropy definition that aligns it with the well-known H\"older mean: in the new formulation, the r-th order R\'enyi Entropy is the logarithm of the inverse of the r-th order H\"older mean. This brings…

Information Theory · Computer Science 2018-11-16 Francisco José Valverde-Albacete , Carmen Peláez-Moreno

Shannon entropy is not the only entropy that is relevant to machine-learning datasets, nor possibly even the most important one. Traditional entropies such as Shannon entropy capture information represented by elements' frequencies but not…

Information Theory · Computer Science 2026-04-01 Phuc Nguyen , Josiah Couch , Rahul Bansal , Alexandra Morgan , Chris Tam , Miao Li , Rima Arnaout , Ramy Arnaout

We consider unconstrained randomized optimization of convex objective functions. We analyze the Random Pursuit algorithm, which iteratively computes an approximate solution to the optimization problem by repeated optimization over a…

Optimization and Control · Mathematics 2012-05-25 Sebastian U. Stich , Christian L. Müller , Bernd Gärtner

The need to estimate a particular quantile of a distribution is an important problem which frequently arises in many computer vision and signal processing applications. For example, our work was motivated by the requirements of many…

Data Structures and Algorithms · Computer Science 2014-11-11 Ognjen Arandjelovic , Duc-Son Pham , Svetha Venkatesh