English
Related papers

Related papers: Variance Reduction Result for a Projected Adaptive…

200 papers

A new method for calculating the free energy of an inhomogeneous superconductor is presented. This method is based on the quasiclassical limit (or Andreev approximation) of the Bogoliubov-de Gennes (or wave function) formulation of the…

Superconductivity · Physics 2009-10-31 Ioan Kosztin , Simon Kos , Michael Stone , Anthony J. Leggett

This paper is devoted to show a discrete adaptive finite element approximation result for the isotropic two-dimensional Griffith energy arising in fracture mechanics. The problem is addressed in the geometric measure theoretic framework of…

Numerical Analysis · Mathematics 2023-06-16 Jean-François Babadjian , Élise Bonhomme

For adaptive mixed finite element methods (AMFEM), we first introduce the data oscillation to analyze, without the restriction that the inverse of the coefficient matrix of the partial differential equations (PDEs) is a piecewise polynomial…

Numerical Analysis · Mathematics 2011-01-07 Shaohong Du , Xiaoping Xie

In real-time applications involving power flow equations, measuring of voltage phase angle difference of the connected buses is essential. However, it needs special techniques to measure voltage angle difference, which may enlarge the…

Signal Processing · Electrical Eng. & Systems 2018-06-21 Irfan Khan , Vikram Bhattacharjee

This paper proposes a gradient descent based optimization method that relies on automatic differentiation for the computation of gradients. The method uses tools and techniques originally developed in the field of artificial neural networks…

Systems and Control · Electrical Eng. & Systems 2023-09-29 Georg Kordowich , Johann Jaeger

In most machine learning training paradigms a fixed, often handcrafted, loss function is assumed to be a good proxy for an underlying evaluation metric. In this work we assess this assumption by meta-learning an adaptive loss function to…

Machine Learning · Computer Science 2019-05-16 Chen Huang , Shuangfei Zhai , Walter Talbott , Miguel Angel Bautista , Shih-Yu Sun , Carlos Guestrin , Josh Susskind

The Jarzynski equality is one of the most influential results in the field of non equilibrium statistical mechanics. This celebrated equality allows to calculate equilibrium free energy differences from work distributions of nonequilibrium…

Statistical Mechanics · Physics 2017-09-13 Shahaf Asban , Saar Rahav

Adaptive sampling algorithms are modern and efficient methods that dynamically adjust the sample size throughout the optimization process. However, they may encounter difficulties in risk-averse settings, particularly due to the challenge…

Optimization and Control · Mathematics 2025-02-17 Sandra Pieraccini , Tommaso Vanzan

We develop a rigorous error analysis for coarse-graining of defect-formation free energy. For a one-dimensional constrained atomistic system, we establish the thermodynamic limit of the defect-formation free energy and obtain explicitly the…

Numerical Analysis · Mathematics 2016-03-10 Matthew Dobson , Manh Hong Duong , Christoph Ortner

We consider the problem of minimizing the average of a large number of smooth but possibly non-convex functions. In the context of most machine learning applications, each loss function is non-negative and thus can be expressed as the…

Optimization and Control · Mathematics 2024-07-08 Antonio Orvieto , Lin Xiao

For the generalized statistical mechanics based on the Tsallis entropy, a variational perturbation approximation method with the principle of minimal sensitivity is developed by calculating the generalized free energy up to the third order…

Statistical Mechanics · Physics 2007-05-23 Wen-Fa Lu

We consider the variational free energy approach for compressed sensing. We first show that the na\"ive mean field approach performs remarkably well when coupled with a noise learning procedure. We also notice that it leads to the same…

Information Theory · Computer Science 2014-10-03 Florent Krzakala , Andre Manoel , Eric W. Tramel , Lenka Zdeborova

It is well known that for gradient systems in Euclidean space or on a Riemannian manifold, the energy decreases monotonically along solutions. In this letter we derive and analyse functionally fitted energy-diminishing methods to preserve…

Numerical Analysis · Mathematics 2018-04-17 Bin Wang , Ting Li , Yajun Wu

Non-negative matrix factorization (NMF) is a knowledge discovery method that is used in many fields. Variational inference and Gibbs sampling methods for it are also wellknown. However, the variational approximation error has not been…

Statistics Theory · Mathematics 2020-03-24 Naoki Hayashi

Jarzynski's equality [1] allows us to investigate free energy landscapes (FELs) by constructing distributions of work performed on a system from an initial ensemble of states to final states. This work is experimentally measured by…

Biological Physics · Physics 2011-05-24 Van Ngo

We propose and analyze a class of adaptive sampling algorithms for multimodal distributions on a bounded domain, which share a structural resemblance to the classic overdamped Langevin dynamics. We first demonstrate that this class of…

Machine Learning · Computer Science 2024-11-26 Björn Engquist , Kui Ren , Yunan Yang

Boltzmann-Gibbs random fields are defined in terms of the exponential expression exp(-H), where H is a suitably defined energy functional of the field states x(s). This paper presents a new Boltzmann-Gibbs model which features local…

Mathematical Physics · Physics 2022-11-22 Dionissios T. Hristopulos

In many modern machine learning applications, structures of underlying mathematical models often yield nonconvex optimization problems. Due to the intractability of nonconvexity, there is a rising need to develop efficient methods for…

Machine Learning · Computer Science 2017-05-16 Qunwei Li , Yi Zhou , Yingbin Liang , Pramod K. Varshney

An efficient proximal-gradient-based method, called proximal extrapolated gradient method, is designed for solving monotone variational inequality in Hilbert space. The proposed method extends the acceptable range of parameters to obtain…

Optimization and Control · Mathematics 2019-12-05 Xiaokai Chang , Sanyang Liu , Jianchao Bai , Jun Yang

The present article is dedicated to proving convergence of the stochastic gradient method in case of random shape optimization problems. To that end, we consider Bernoulli's exterior free boundary problem with a random interior boundary. We…

Optimization and Control · Mathematics 2024-08-12 Marc Dambrine , Caroline Geiersbach , Helmut Harbrecht