English
Related papers

Related papers: A New Scalar Auxiliary Variable Approach for Gradi…

200 papers

The iterative nature of many discretisation methods for continuous dynamical systems has led to the study of the connections between iterative numerical methods in numerical linear algebra and continuous dynamical systems. Certain…

Numerical Analysis · Mathematics 2018-06-28 Yuto Miyatake , Tomohiro Sogabe , Shao-Liang Zhang

In this paper we combine a flexible covariant formulation of the shallow water equations with the semi-implicit numerical scheme developed over the years by Casulli and collaborators. After adopting an orthogonal, but non-orthonormal,…

Fluid Dynamics · Physics 2026-05-26 Maurizio Tavelli , Olindo Zanotti

We study outlier (a.k.a., anomaly) detection for single-pass non-stationary streaming data. In the well-studied offline or batch outlier detection problem, traditional methods such as kernel One-Class SVM (OCSVM) are both computationally…

Machine Learning · Statistics 2025-12-15 Joe Suk , Samory Kpotufe

Classical solvable stochastic volatility models (SVM) use a CEV process for instantaneous variance where the CEV parameter $\gamma$ takes just few values: 0 - the Ornstein-Uhlenbeck process, 1/2 - the Heston (or square root) process, 1-…

Pricing of Securities · Quantitative Finance 2012-07-03 Andrey Itkin

Variational empirical Bayes (VEB) methods provide a practically attractive approach to fitting large, sparse, multiple regression models. These methods usually use coordinate ascent to optimize the variational objective function, an…

Methodology · Statistics 2024-11-25 Saikat Banerjee , Peter Carbonetto , Matthew Stephens

We describe a method for the identification of models for dynamical systems from observational data. The method is based on the concept of symbolic regression and uses genetic programming to evolve a system of ordinary differential…

Machine Learning · Computer Science 2021-07-14 Gabriel Kronberger , Lukas Kammerer , Michael Kommenda

Traditional regression models assume stationary relationships between predictors and responses, failing to capture the spatial heterogeneity present in many environmental, epidemiological, and ecological processes. To address this…

Methodology · Statistics 2025-05-27 Justice Akuoko-Frimpong , Edward Shao , Jonathan Ta

Value-at-risk (VaR) has been playing the role of a standard risk measure since its introduction. In practice, the delta-normal approach is usually adopted to approximate the VaR of portfolios with option positions. Its effectiveness,…

Methodology · Statistics 2019-04-22 Junyao Chen , Tony Sit , Hoi Ying Wong

Stochastic differential equations (SDEs) are well suited to modelling noisy and irregularly sampled time series found in finance, physics, and machine learning. Traditional approaches require costly numerical solvers to sample between…

Machine Learning · Computer Science 2025-10-30 Naoki Kiyohara , Edward Johns , Yingzhen Li

Accelerated gradient methods are the cornerstones of large-scale, data-driven optimization problems that arise naturally in machine learning and other fields concerning data analysis. We introduce a gradient-based optimization framework for…

Optimization and Control · Mathematics 2022-03-22 Param Budhraja , Mayank Baranwal , Kunal Garg , Ashish Hota

We propose an energy-optimized invariant energy quadratization method to solve the gradient flow models in this paper, which requires only one linear energy-optimized step to correct the auxiliary variables on each time step. In addition to…

Numerical Analysis · Mathematics 2024-04-03 Xiaoqing Meng , Aijie Cheng , Zhengguang Liu

We derive a second-order ordinary differential equation (ODE) which is the limit of Nesterov's accelerated gradient method. This ODE exhibits approximate equivalence to Nesterov's scheme and thus can serve as a tool for analysis. We show…

Machine Learning · Statistics 2015-10-29 Weijie Su , Stephen Boyd , Emmanuel J. Candes

The URANS equations provide a computationally efficient tool to simulate unsteady turbulent flows for a wide range of applications. To account for the errors introduced by the turbulence closure model, recent works have adopted data…

Fluid Dynamics · Physics 2025-01-22 Justin Plogmann , Oliver Brenner , Patrick Jenny

Recently introduced invariant energy quadratization (IEQ) and scalar auxiliary variable (SAV) approaches have proven to be very powerful ways to construct energy stable schemes for phase field models. Both methods require an assumption…

Analysis of PDEs · Mathematics 2019-11-05 Zhengguang Liu

In this work we introduce a new optimisation method called SAGA in the spirit of SAG, SDCA, MISO and SVRG, a set of recently proposed incremental gradient algorithms with fast linear convergence rates. SAGA improves on the theory behind SAG…

Machine Learning · Computer Science 2014-12-17 Aaron Defazio , Francis Bach , Simon Lacoste-Julien

Irregular sampling intervals and missing values in real-world time series data present challenges for conventional methods that assume consistent intervals and complete data. Neural Ordinary Differential Equations (Neural ODEs) offer an…

Machine Learning · Computer Science 2025-01-28 YongKyung Oh , Dong-Young Lim , Sungil Kim

We present adaptive sequential SAA (sample average approximation) algorithms to solve large-scale two-stage stochastic linear programs. The iterative algorithm framework we propose is organized into \emph{outer} and \emph{inner} iterations…

Optimization and Control · Mathematics 2020-12-08 Raghu Pasupathy , Yongjia Song

Comparing with the classical local gradient flow and phase field models, the nonlocal models such as nonlocal Cahn-Hilliard equations equipped with nonlocal diffusion operator can describe more practical phenomena for modeling phase…

Analysis of PDEs · Mathematics 2019-03-12 Zhengguang liu , Aijie Cheng , Xiaoli Li

We develop and analyze high-order ensemble schemes for the unsteady Navier--Stokes--Darcy system with uncertain initial conditions, forcing terms, hydraulic conductivity tensors, and Lions-Beavers-Joseph-Saffman interface conditions. The…

Numerical Analysis · Mathematics 2026-05-25 Wei-Wei Han , Fukeng Huang , Changxin Qiu

The data-driven discovery of interpretable models approximating the underlying dynamics of a physical system has gained attraction in the past decade. Current approaches employ pre-specified functional forms or basis functions and often…

Machine Learning · Computer Science 2025-07-30 Rahul Golder , M. M. Faruque Hasan