English
Related papers

Related papers: Gradient optimization of fermionic projected entan…

200 papers

We discuss several methods that improve the partial-global stochastic Metropolis (PGSM) algorithm for smeared link staggered fermions. We present autocorrelation time measurements and argue that this update is feasible even on reasonably…

High Energy Physics - Lattice · Physics 2009-11-07 Anna Hasenfratz , Andrei Alexandru

We show how fermionic statistics can be naturally incorporated in tensor networks on arbitrary graphs through the use of graded Hilbert spaces. This formalism allows to use tensor network methods for fermionic lattice systems in a local…

Stochastic gradient methods for machine learning and optimization problems are usually analyzed assuming data points are sampled \emph{with} replacement. In practice, however, sampling \emph{without} replacement is very common, easier to…

Machine Learning · Computer Science 2016-10-18 Ohad Shamir

This paper presents enhancement strategies for the Hermitian and skew-Hermitian splitting method based on gradient iterations. The spectral properties are exploited for the parameter estimation, often resulting in a better convergence. In…

Numerical Analysis · Mathematics 2020-07-08 Qinmeng Zou , Frederic Magoules

An efficient proximal-gradient-based method, called proximal extrapolated gradient method, is designed for solving monotone variational inequality in Hilbert space. The proposed method extends the acceptable range of parameters to obtain…

Optimization and Control · Mathematics 2019-12-05 Xiaokai Chang , Sanyang Liu , Jianchao Bai , Jun Yang

This paper proposes a projection-based implicit modeling method (PIMM) for functionally graded lattice optimization, which does not require any homogenization techniques. In this method, a parametric projection function is proposed to link…

Computational Physics · Physics 2020-08-18 Hao Deng , Albert C. To

We consider (stochastic) softmax policy gradient (PG) methods for bandits and tabular Markov decision processes (MDPs). While the PG objective is non-concave, recent research has used the objective's smoothness and gradient domination…

Machine Learning · Computer Science 2024-10-01 Michael Lu , Matin Aghaei , Anant Raj , Sharan Vaswani

The Expectation Maximization (EM) algorithm is a key reference for inference in latent variable models; unfortunately, its computational cost is prohibitive in the large scale learning setting. In this paper, we propose an extension of the…

Machine Learning · Statistics 2020-11-26 Gersende Fort , Eric Moulines , Hoi-To Wai

Physics informed neural networks (PINNs) represent a very popular class of neural solvers for partial differential equations. In practice, one often employs stochastic gradient descent type algorithms to train the neural network. Therefore,…

Machine Learning · Computer Science 2025-09-01 Bangti Jin , Longjun Wu

Projected entangled pair states (PEPS) are very useful in the description of strongly correlated systems, partly because they allow encoding symmetries, either global or local (gauge), naturally. In recent years, PEPS with local symmetries…

High Energy Physics - Lattice · Physics 2025-08-25 David Blanik , José Garre-Rubio , András Molnár , Erez Zohar

Within the Projected Entangled Pair State (PEPS) tensor network formalism, a simple update (SU) method has been used to investigate the time evolution of a two-dimensional U(1) critical spin-1/2 spin liquid under Hamiltonian quench [Phys.…

Strongly Correlated Electrons · Physics 2023-10-11 Ravi Teja Ponnaganti , Matthieu Mambrini , Didier Poilblanc

We develop tangent space methods for projected entangled-pair states (PEPS) that provide direct access to the low-energy sector of strongly-correlated two-dimensional quantum systems. More specifically, we construct a variational ansatz for…

Strongly Correlated Electrons · Physics 2015-12-02 Laurens Vanderstraeten , Michaël Mariën , Frank Verstraete , Jutho Haegeman

This paper tackles the challenge of parameter calibration in stochastic models, particularly in scenarios where the likelihood function is unavailable in an analytical form. We introduce a gradient-based simulated parameter estimation…

Machine Learning · Statistics 2025-03-25 Zehao Li , Yijie Peng

Simulating strongly-correlated quantum many-body systems at finite temperatures is a significant challenge in computational physics. In this work, we present a scalable finite-temperature tensor network algorithm for two-dimensional quantum…

Strongly Correlated Electrons · Physics 2024-09-10 Meng Zhang , Hao Zhang , Chao Wang , Lixin He

An infinite projected entangled pair state (iPEPS) is a tensor network ansatz to represent a quantum state on an infinite 2D lattice whose accuracy is controlled by the bond dimension $D$. Its real, Lindbladian or imaginary time evolution…

Strongly Correlated Electrons · Physics 2019-01-16 Piotr Czarnik , Jacek Dziarmaga , Philippe Corboz

In this paper, we propose a low rank approximation method for efficiently solving stochastic partial differential equations. Specifically, our method utilizes a novel low rank approximation of the stiffness matrices, which can significantly…

Numerical Analysis · Mathematics 2023-10-20 Yujun Zhu , Ju Ming , Jie Zhu , Zhongming Wang

This paper is devoted to first-order algorithms for smooth convex optimization with inexact gradients. Unlike the majority of the literature on this topic, we consider the setting of relative rather than absolute inexactness. More…

Optimization and Control · Mathematics 2023-10-03 Nikita Kornilov , Eduard Gorbunov , Mohammad Alkousa , Fedor Stonyakin , Pavel Dvurechensky , Alexander Gasnikov

We develop an efficient stochastic variance reduced gradient descent algorithm to solve the affine rank minimization problem consists of finding a matrix of minimum rank from linear measurements. The proposed algorithm as a stochastic…

Optimization and Control · Mathematics 2022-11-08 Ningning Han , Juan Nie , Jian Lu , Michael K. Ng

The edge partition model (EPM) is a generative model for extracting an overlapping community structure from static graph-structured data. In the EPM, the gamma process (GaP) prior is adopted to infer the appropriate number of latent…

Social and Information Networks · Computer Science 2024-03-04 Sikun Yang , Heinz Koeppl

Empirical risk minimization is the main tool for prediction problems, but its extension to relational data remains unsolved. We solve this problem using recent ideas from graph sampling theory to (i) define an empirical risk for relational…

Machine Learning · Statistics 2019-02-25 Victor Veitch , Morgane Austern , Wenda Zhou , David M. Blei , Peter Orbanz