English
Related papers

Related papers: Convergence Acceleration for Time Dependent Parame…

200 papers

In this paper, we propose a unified two-phase scheme to accelerate any high-order regularized tensor approximation approach on the smooth part of a composite convex optimization model. The proposed scheme has the advantage of not needing to…

Optimization and Control · Mathematics 2020-07-06 Bo Jiang , Tianyi Lin , Shuzhong Zhang

Stochastic gradient methods are scalable for solving large-scale optimization problems that involve empirical expectations of loss functions. Existing results mainly apply to optimization problems where the objectives are one- or two-level…

Optimization and Control · Mathematics 2018-01-15 Shuoguang Yang , Mengdi Wang , Ethan X. Fang

We propose an online algorithm for tracking a multidimensional time-varying parameter of a time series, which is also allowed to be a predictable process with respect to the underlying time series. The algorithm is driven by a gain…

Statistics Theory · Mathematics 2013-11-15 Eduard Belitser , Paulo Serra

Diffusion models accomplish remarkable success in data generation tasks across various domains. However, the iterative sampling process is computationally expensive. Consistency models are proposed to learn consistency functions to map from…

Machine Learning · Computer Science 2025-05-07 Yiding Chen , Yiyi Zhang , Owen Oertell , Wen Sun

Models of stochastic processes are widely used in almost all fields of science. Theory validation, parameter estimation, and prediction all require model calibration and statistical inference using data. However, data are almost always…

Computation · Statistics 2022-09-07 David J. Warne , Thomas P. Prescott , Ruth E. Baker , Matthew J. Simpson

In this report, we propose a new adaptive time filter algorithm for the unsteady Stokes/Darcy model. First we present a first order ${\theta}$-scheme with the variable time step which is one parameter family of Linear Multi-step methods and…

Numerical Analysis · Mathematics 2022-08-29 Yi Qin , Yang Wang , Yi Li , Jian Li

This work aims at making a comprehensive contribution in the general area of parametric inference for discretely observed diffusion processes. Established approaches for likelihood-based estimation invoke a time-discretisation scheme for…

Methodology · Statistics 2024-01-30 Yuga Iguchi , Alexandros Beskos , Matthew M. Graham

We introduce a numerical framework to verify the finite step convergence of first-order methods for parametric convex quadratic optimization. We formulate the verification problem as a mathematical optimization problem where we maximize a…

Optimization and Control · Mathematics 2025-04-18 Vinit Ranjan , Bartolomeo Stellato

We develop a new approximative estimation method for conditional Shapley values obtained using a linear regression model. We develop a new estimation method and outperform existing methodology and implementations. Compared to the sequential…

Methodology · Statistics 2025-04-28 Fredrik Lohne Aanes

Recent advances in deep learning have shown that uncertainty estimation is becoming increasingly important in applications such as medical imaging, natural language processing, and autonomous systems. However, accurately quantifying…

Machine Learning · Computer Science 2023-07-04 Uddeshya Upadhyay , Jae Myung Kim , Cordelia Schmidt , Bernhard Schölkopf , Zeynep Akata

Turning pass-through network architectures into iterative ones, which use their own output as input, is a well-known approach for boosting performance. In this paper, we argue that such architectures offer an additional benefit: The…

Artificial Intelligence · Computer Science 2025-05-27 Nikita Durasov , Doruk Oner , Jonathan Donier , Hieu Le , Pascal Fua

We extend the Approximate-Proximal Point (aProx) family of model-based methods for solving stochastic convex optimization problems, including stochastic subgradient, proximal point, and bundle methods, to the minibatch and accelerated…

Optimization and Control · Mathematics 2021-01-08 Karan Chadha , Gary Cheng , John C. Duchi

As a popular meta-learning approach, the model-agnostic meta-learning (MAML) algorithm has been widely used due to its simplicity and effectiveness. However, the convergence of the general multi-step MAML still remains unexplored. In this…

Machine Learning · Computer Science 2020-07-14 Kaiyi Ji , Junjie Yang , Yingbin Liang

The construction of efficient methods for uncertainty quantification in kinetic equations represents a challenge due to the high dimensionality of the models: often the computational costs involved become prohibitive. On the other hand,…

Numerical Analysis · Mathematics 2021-12-03 Giacomo Dimarco , Liu Liu , Lorenzo Pareschi , Xueyu Zhu

This paper proposes a new sampling-based nonlinear model predictive control (MPC) algorithm, with a bound on complexity quadratic in the prediction horizon N and linear in the number of samples. The idea of the proposed algorithm is to use…

Systems and Control · Computer Science 2017-01-13 R. V. Bobiti , M. Lazar

Multi-step temporal-difference (TD) learning, where the update targets contain information from multiple time steps ahead, is one of the most popular forms of TD learning for linear function approximation. The reason is that multi-step…

Artificial Intelligence · Computer Science 2016-08-19 Harm van Seijen

We propose a new multistep deep learning-based algorithm for the resolution of moderate to high dimensional nonlinear backward stochastic differential equations (BSDEs) and their corresponding parabolic partial differential equations (PDE).…

Numerical Analysis · Mathematics 2023-08-29 Daniel Bussell , Camilo Andrés García-Trillos

Gradient descent is slow to converge for ill-conditioned problems and non-convex problems. An important technique for acceleration is step-size adaptation. The first part of this paper contains a detailed review of step-size adaptation…

Machine Learning · Computer Science 2022-05-27 Hengshuai Yao

This paper proposes several explicit and implicit multistep frequency response optimized integrators considering first or second order derivative. A prediction-based method aiming at accelerating a novel power system transient simulation…

Systems and Control · Electrical Eng. & Systems 2021-02-16 Sheng Lei , Alexander Flueck

We present a novel, realtime algorithm to compute the trajectory of each pedestrian in moderately dense crowd scenes. Our formulation is based on an adaptive particle filtering scheme that uses a multi-agent motion model based on…

Computer Vision and Pattern Recognition · Computer Science 2014-02-13 Aniket Bera , Dinesh Manocha