English
Related papers

Related papers: Unifying Finite Differences and Semi-Lagrangian Sc…

200 papers

We develop a mesh-free, derivative-free, matrix-free, and highly parallel localized stochastic method for high-dimensional semilinear parabolic PDEs. The efficiency of the proposed method is built upon four essential components: (i) a…

Numerical Analysis · Mathematics 2025-10-14 Shuixin Fang , Changtao Sheng , Bihao Su , Tao Zhou

In this paper, we implement exponential integrators, specifically Integrating Factor (IF) and Exponential Time Differencing (ETD) methods, using pseudo-spectral techniques to solve phase-field equations within a Python framework. These…

Numerical Analysis · Mathematics 2023-05-17 Elvis do A. Soares , Amaro G. Barreto , Frederico W. Tavares

We investigate finite-dimensional constrained structured optimization problems, featuring composite objective functions and set-membership constraints. Offering an expressive yet simple language, this problem class provides a modeling…

Optimization and Control · Mathematics 2023-02-09 Alberto De Marchi , Xiaoxi Jia , Christian Kanzow , Patrick Mehlitz

The Expectation-Maximization (EM) algorithm has been predominantly used to approximate the maximum likelihood estimation of the location-scale Gaussian mixtures. However, when the models are over-specified, namely, the chosen number of…

Machine Learning · Statistics 2022-05-24 Tongzheng Ren , Fuheng Cui , Sujay Sanghavi , Nhat Ho

Locally Purified Density Operators (LPDOs) are state-of-the-art tensor network ansatze candidates that efficiently represent mixed quantum states at scale. However, given their non-uniqueness, their representational complexity is generally…

Quantum Physics · Physics 2025-12-10 Amit Jamadagni , Eugene Dumitrescu

We present a unified algorithmic framework for the numerical solution, constrained optimization, and physics-informed learning of PDEs with a variational structure. Our framework is based on a Galerkin discretization of the underlying…

Machine Learning · Computer Science 2026-05-26 Shizheng Wen , Mingyuan Chi , Tianwei Yu , Ben Moseley , Mike Yan Michelis , Pu Ren , Hao Sun , Siddhartha Mishra

This paper introduces Exp-ParaDiag, a novel time-parallel method that combines the strength of exponential integrators into the ParaDiag framework. We develop and analyze Exp-ParaDiag based on first and second order accurate exponential…

Numerical Analysis · Mathematics 2026-03-05 Gobinda Garai , Nagaiah Chamakuri

The Expectation Maximization (EM) algorithm is of key importance for inference in latent variable models including mixture of regressors and experts, missing observations. This paper introduces a novel EM algorithm, called…

Machine Learning · Computer Science 2020-12-04 Gersende Fort , Eric Moulines , Hoi-To Wai

This paper studies a class of double-loop (inner-outer) algorithms for convex composite optimization. For unconstrained problems, we develop a restarted accelerated composite gradient method that attains the optimal first-order complexity…

Optimization and Control · Mathematics 2026-02-23 Matthew X. Burns , Jiaming Liang

We present the first rigorous convergence analysis of the smoothed adaptive finite element method (S-AFEM) proposed in [Mulita, Giani, Heltai: SIAM J. Sci. Comput. 43, 2021]. S-AFEM modifies the classical adaptive finite element method…

Numerical Analysis · Mathematics 2026-01-29 Philipp Bringmann , Christoph Lietz , Dirk Praetorius

Finite differences, finite elements, and their generalizations are widely used for solving partial differential equations, and their high-order variants have respective advantages and disadvantages. Traditionally, these methods are treated…

Numerical Analysis · Mathematics 2020-01-22 Rebecca Conley , Xiangmin Jiao , Tristan J. Delaney

A variational formulation of accelerated optimization on normed spaces was recently introduced by considering a specific family of time-dependent Bregman Lagrangian and Hamiltonian systems whose corresponding trajectories converge to the…

Optimization and Control · Mathematics 2022-01-11 Valentin Duruisseaux , Melvin Leok

We introduce a novel kernel learning framework toward efficiently solving nonlinear partial differential equations (PDEs). In contrast to the state-of-the-art kernel solver that embeds differential operators within kernels, posing…

Machine Learning · Computer Science 2025-06-09 Zhitong Xu , Da Long , Yiming Xu , Guang Yang , Shandian Zhe , Houman Owhadi

In this paper, we propose a linearized finite element method (FEM) for solving the cubic nonlinear Schr\"{o}dinger equation with wave operator. In this method, a modified leap-frog scheme is applied for time discretization and a Galerkin…

Numerical Analysis · Mathematics 2019-02-25 Wentao Cai , Dongdong He , Kejia Pan

In this work, we present a new approach to the construction of variational integrators. In the general case, the estimation of the action integral in a time interval $[q_k,q_{k+1}]$ is used to construct a symplectic map $(q_k,q_{k+1})\to…

Mathematical Physics · Physics 2009-05-12 D S Vlachos , O T Kosmas

This paper considers the problem of distributed estimation in a sensor network, where multiple sensors are deployed to infer the state of a linear time-invariant (LTI) Gaussian system. By proposing a lossless decomposition of Kalman filter,…

Systems and Control · Electrical Eng. & Systems 2022-04-19 Jiaqi Yan , Yilin Mo , Hideaki Ishii

An efficient $hp$-multigrid scheme is presented for local discontinuous Galerkin (LDG) discretizations of elliptic problems, formulated around the idea of separately coarsening the underlying discrete gradient and divergence operators. We…

Numerical Analysis · Mathematics 2019-03-14 Daniel Fortunato , Chris H. Rycroft , Robert Saye

Many machine learning tasks can be formulated in terms of predicting structured outputs. In frameworks such as the structured support vector machine (SVM-Struct) and the structured perceptron, discriminative functions are learned by…

Machine Learning · Computer Science 2015-03-05 Kui Tang , Nicholas Ruozzi , David Belanger , Tony Jebara

We propose a new approach for metric learning by framing it as learning a sparse combination of locally discriminative metrics that are inexpensive to generate from the training data. This flexible framework allows us to naturally derive…

Machine Learning · Computer Science 2019-01-25 Yuan Shi , Aurélien Bellet , Fei Sha

We propose a unified framework to solve general low-rank plus sparse matrix recovery problems based on matrix factorization, which covers a broad family of objective functions satisfying the restricted strong convexity and smoothness…

Machine Learning · Statistics 2018-02-21 Xiao Zhang , Lingxiao Wang , Quanquan Gu