English
Related papers

Related papers: Computationally Efficient Approximations for Matri…

200 papers

In this paper we first identify a basic limitation in gradient descent-based optimization methods when used in conjunctions with smooth kernels. An analysis based on the spectral properties of the kernel demonstrates that only a vanishingly…

Machine Learning · Statistics 2017-06-20 Siyuan Ma , Mikhail Belkin

Consider an $n \times p$ data matrix $X$ whose rows are independently sampled from a population with covariance $\Sigma$. When $n,p$ are both large, the eigenvalues of the sample covariance matrix are substantially different from those of…

Numerical Analysis · Mathematics 2017-10-03 Edgar Dobriban

Randomized SVD has become an extremely successful approach for efficiently computing a low-rank approximation of matrices. In particular the paper by Halko, Martinsson, and Tropp (SIREV 2011) contains extensive analysis, and has made it a…

Numerical Analysis · Mathematics 2020-09-25 Yuji Nakatsukasa

Finding the minimal relative entropy of two quantum states under semidefinite constraints is a pivotal problem located at the mathematical core of various applications in quantum information theory. An efficient method for providing…

Quantum Physics · Physics 2026-02-02 Gereon Koßmann , René Schwonnek

In this paper we propose and study a new complexity model for approximation algorithms. The main motivation are practical problems over large data sets that need to be solved many times for different scenarios, e.g., many multicast trees…

Data Structures and Algorithms · Computer Science 2010-06-18 Marek Cygan , Lukasz Kowalik , Marcin Mucha , Marcin Pilipczuk , Piotr Sankowski

This work presents a highly optimized computational framework for the Discrete Dipole Approximation, a numerical method for calculating the optical properties associated with a target of arbitrary geometry that is widely used in…

Instrumentation and Methods for Astrophysics · Physics 2009-08-07 James Mc Donald , Aaron Golden , S. Gerard Jennings

We propose a new formula for computing holographic Renyi entropies in the presence of multiple extremal surfaces. Our proposal is based on computing the wave function in the basis of fixed-area states and assuming a diagonal approximation…

High Energy Physics - Theory · Physics 2024-09-20 Xi Dong , Jonah Kudler-Flam , Pratik Rath

We discuss the properties of invariant measures corresponding to iterated function systems (IFSs) with place-dependent probabilities and compute their Renyi entropies, generalized dimensions, and multifractal spectra. It is shown that with…

chao-dyn · Physics 2009-10-31 Wojciech Slomczynski , Jaroslaw Kwapien , Karol Zyczkowski

The R{\'e}nyi entropy is one of the important information measures that generalizes Shannon's entropy. The quantum R{\'e}nyi entropy has a fundamental role in quantum information theory, therefore, bounding this quantity is of vital…

Mathematical Physics · Physics 2016-09-26 Hadi Reisizadeh , S. Mahmoud Manjegani

Modern statistical estimation is often performed in a distributed setting where each sample belongs to a single user who shares their data with a central server. Users are typically concerned with preserving the privacy of their samples,…

Machine Learning · Computer Science 2023-05-16 Gecia Bravo-Hermsdorff , Róbert Busa-Fekete , Mohammad Ghavamzadeh , Andres Muñoz Medina , Umar Syed

The study of generic properties of quantum states has led to an abundance of insightful results. A meaningful set of states that can be efficiently prepared in experiments are ground states of gapped local Hamiltonians, which are well…

Quantum Physics · Physics 2022-05-03 Jonas Haferkamp , Christian Bertoni , Ingo Roth , Jens Eisert

Quantum Renyi relative entropies provide a one-parameter family of distances between density matrices, which generalizes the relative entropy and the fidelity. We study these measures for renormalization group flows in quantum field theory.…

High Energy Physics - Theory · Physics 2018-10-17 Horacio Casini , Raimel Medina , Ignacio Salazar , Gonzalo Torroba

Motivated by the recent discovery that the interpretation maps of CNNs could easily be manipulated by adversarial attacks against network interpretability, we study the problem of interpretation robustness from a new perspective of \Renyi…

Machine Learning · Computer Science 2021-07-06 Ao Liu , Xiaoyu Chen , Sijia Liu , Lirong Xia , Chuang Gan

In supervised learning using kernel methods, we often encounter a large-scale finite-sum minimization over a reproducing kernel Hilbert space (RKHS). Large-scale finite-sum problems can be solved using efficient variants of Newton method,…

Machine Learning · Computer Science 2022-06-07 Ting-Jui Chang , Shahin Shahrampour

We study the problem of approximating the cone of positive semidefinite (PSD) matrices with a cone that can be described by smaller-sized PSD constraints. Specifically, we ask the question: "how closely can we approximate the set of…

Optimization and Control · Mathematics 2022-09-08 Dogyoon Song , Pablo A. Parrilo

We compute the Renyi entropy in a one-dimensional transverse-field quantum Ising model by employing a swapping operator acting on the states which are prepared from the neural network methods. In the static ground state, Renyi entropy can…

Disordered Systems and Neural Networks · Physics 2024-03-15 Han-Qing Shi , Hai-Qing Zhang

In this work we consider the problem of numerical integration, i.e., approximating integrals with respect to a target probability measure using only pointwise evaluations of the integrand. We focus on the setting in which the target…

Machine Learning · Statistics 2025-06-17 Antoine Chatalic , Nicolas Schreuder , Ernesto De Vito , Lorenzo Rosasco

A novel definition of the conditional smooth Renyi entropy, which is different from that of Renner and Wolf, is introduced. It is shown that our definition of the conditional smooth Renyi entropy is appropriate to give lower and upper…

Information Theory · Computer Science 2019-01-25 Shigeaki Kuzuoka

We present a new sublinear time algorithm for approximating the spectral density (eigenvalue distribution) of an $n\times n$ normalized graph adjacency or Laplacian matrix. The algorithm recovers the spectrum up to $\epsilon$ accuracy in…

Data Structures and Algorithms · Computer Science 2022-04-18 Vladimir Braverman , Aditya Krishnan , Christopher Musco

Two typical fixed-length random number generation problems in information theory are considered for general sources. One is the source resolvability problem and the other is the intrinsic randomness problem. In each of these problems, the…

Information Theory · Computer Science 2024-05-14 Ryo Nomura , Hideki Yagi