English
Related papers

Related papers: The Pade Approximant Based Network for Variational…

200 papers

We present a novel method for using Neural Networks (NNs) for finding solutions to a class of Partial Differential Equations (PDEs). Our method builds on recent advances in Neural Radiance Field research (NeRFs) and allows for a NN to…

Machine Learning · Computer Science 2022-05-31 Jaroslaw Rzepecki , Daniel Bates , Chris Doran

A principled method to obtain approximate solutions of general constrained integer optimization problems is introduced. The approach is based on the calculation of a mean field probability distribution for the decision variables which is…

Optimization and Control · Mathematics 2013-05-08 Arturo Berrones , Jonás Velasco , Juan Banda

Motivated by the gap between theoretical optimal approximation rates of deep neural networks (DNNs) and the accuracy realized in practice, we seek to improve the training of DNNs. The adoption of an adaptive basis viewpoint of DNNs leads to…

Machine Learning · Computer Science 2019-12-11 Eric C. Cyr , Mamikon A. Gulian , Ravi G. Patel , Mauro Perego , Nathaniel A. Trask

The numerical methods for differential equation solution allow obtaining a discrete field that converges towards the solution if the method is applied to the correct problem. Nevertheless, the numerical methods have the restricted class of…

Numerical Analysis · Mathematics 2023-07-03 Alexander Hvatov , Tatiana Tikhonova

Variational methods are widely applied to ill-posed inverse problems for they have the ability to embed prior knowledge about the solution. However, the level of performance of these methods significantly depends on a set of parameters,…

Optimization and Control · Mathematics 2020-01-23 Carla Bertocchi , Emilie Chouzenoux , Marie-Caroline Corbineau , Jean-Christophe Pesquet , Marco Prato

Partial differential equations (PDEs) are typically used as models of physical processes but are also of great interest in PDE-based image processing. However, when it comes to their use in imaging, conventional numerical methods for…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Pascal Tom Getreuer , Peyman Milanfar , Xiyang Luo

Proximal algorithms have gained popularity in recent years in large-scale and distributed optimization problems. One such problem is the phase retrieval problem, for which proximal operators have been proposed recently. The phase retrieval…

Optimization and Control · Mathematics 2018-08-16 Biel Roig-Solvas , Lee Makowski , Dana H. Brooks

Mean-field variational inference is a method for approximate Bayesian posterior inference. It approximates a full posterior distribution with a factorized set of distributions by maximizing a lower bound on the marginal likelihood. This…

Machine Learning · Computer Science 2012-07-03 John Paisley , David Blei , Michael Jordan

Recent works have shown that deep neural networks can be employed to solve partial differential equations, giving rise to the framework of physics informed neural networks. We introduce a generalization for these methods that manifests as a…

Numerical Analysis · Mathematics 2021-03-25 Remco van der Meer , Cornelis Oosterlee , Anastasia Borovykh

In this paper we propose a new model-based unsupervised learning method, called VarNet, for the solution of partial differential equations (PDEs) using deep neural networks (NNs). Particularly, we propose a novel loss function that relies…

Machine Learning · Computer Science 2019-12-17 Reza Khodayi-Mehr , Michael M. Zavlanos

In this paper we present an inexact proximal point method for variational inequality problem on Hadamard manifolds and study its convergence properties. The proposed algorithm is inexact in two sense. First, each proximal subproblem is…

Optimization and Control · Mathematics 2021-03-04 G. C. Bento , O. P. Ferreira , E. A. Papa Quiroz

Variational Bayes (VB) has shown itself to be a powerful approximation method in many application areas. This paper describes some diagnostics methods which can assess how well the VB approximates the true posterior, particularly with…

Computation · Statistics 2013-09-23 Hui Zhao , Paul Marriott

In this work, we study the problem of finding approximate, with minimum support set, solutions to matrix max-plus equations, which we call sparse approximate solutions. We show how one can obtain such solutions efficiently and in polynomial…

Optimization and Control · Mathematics 2020-12-22 Nikos Tsilivis , Anastasios Tsiamis , Petros Maragos

Combining the techniques of approximation algorithms and parameterized complexity has long been considered a promising research area, but relatively few results are currently known. In this paper we study the parameterized approximability…

Data Structures and Algorithms · Computer Science 2014-02-18 Michael Lampis

Modern statistical applications involving large data sets have focused attention on statistical methodologies which are both efficient computationally and able to deal with the screening of large numbers of different candidate models. Here…

Methodology · Statistics 2014-02-26 David J. Nott , Minh-Ngoc Tran , Chenlei Leng

We consider the linear discriminant analysis problem in the high-dimensional settings. In this work, we propose PANDA(PivotAl liNear Discriminant Analysis), a tuning-insensitive method in the sense that it requires very little effort to…

Statistics Theory · Mathematics 2023-09-19 Ethan X. Fang , Yajun Mei , Yuyang Shi , Qunzhi Xu , Tuo Zhao

Recently, progress has been made in the application of neural networks to the numerical analysis of partial differential equations (PDEs). In the latter the variational formulation of the Poisson problem is used in order to obtain an…

Numerical Analysis · Mathematics 2020-01-14 Johannes Müller , Marius Zeinhofer

Variational inference offers scalable and flexible tools to tackle intractable Bayesian inference of modern statistical models like Bayesian neural networks and Gaussian processes. For largely over-parameterized models, however, the…

Machine Learning · Statistics 2019-12-03 Simone Rossi , Sebastien Marmin , Maurizio Filippone

In this paper, we propose an adaptive group Lasso deep neural network for high-dimensional function approximation where input data are generated from a dynamical system and the target function depends on few active variables or few linear…

Machine Learning · Computer Science 2021-12-06 Lam Si Tung Ho , Nicholas Richardson , Giang Tran

In this paper, we investigate the existence of nontrivial weak solutions for the Prandtl-Batchelor type free boundary value elliptic problem driven by a power nonlinearity. The algebraic topology approach will be used to establish the…

Analysis of PDEs · Mathematics 2024-12-24 Debajyoti Choudhuri , Jiabin Zuo