English
Related papers

Related papers: Recursive Score and Hessian Computation in Regime-…

200 papers

A new method to represent and approximate rotation matrices is introduced. The method represents approximations of a rotation matrix $Q$ with linearithmic complexity, i.e. with $\frac{1}{2}n\lg(n)$ rotations over pairs of coordinates,…

Machine Learning · Computer Science 2014-04-30 Michael Mathieu , Yann LeCun

Accurate learning of system dynamics is becoming increasingly crucial for advanced control and decision-making in engineering. However, real-world systems often exhibit multiple channels and highly nonlinear transition dynamics, challenging…

Machine Learning · Statistics 2025-10-20 Tengjie Zheng , Jilan Mei , Di Wu , Lin Cheng , Shengping Gong

Switched reluctance motors are appealing because they are inexpensive in both construction and maintenance. The aim of this paper is to develop a commutation function that linearizes the nonlinear motor dynamics in such a way that the…

Systems and Control · Electrical Eng. & Systems 2022-09-15 Max van Meer , Gert Witvoet , Tom Oomen

Gaussian building blocks are essential for photonic quantum information processing, and universality can be practically achieved by equipping Gaussian circuits with adaptive measurement and feedforward. The number of adaptive steps then…

Quantum Physics · Physics 2026-02-17 Changhun Oh , Youngrong Lim

The main purpose is to estimate the regression function of a real random variable with functional explanatory variable by using a recursive nonparametric kernel approach. The mean square error and the almost sure convergence of a family of…

Statistics Theory · Mathematics 2013-08-07 Aboubacar Amiri , Christophe Crambes , Baba Thiam

In this paper, a simulation-based method for the analysis and design of abstracted models for a stochastic hybrid system is proposed. The accuracy of a model is evaluated in terms of its capability to reproduce the system output for all the…

Systems and Control · Computer Science 2014-05-29 M. Prandini , S. Garatti , R. Vignali

We study online inference and asymptotic covariance estimation for the stochastic gradient descent (SGD) algorithm. While classical methods (such as plug-in and batch-means estimators) are available, they either require inaccessible…

Machine Learning · Statistics 2026-04-24 Ziyang Wei , Wanrong Zhu , Jingyang Lyu , Wei Biao Wu

This paper considers the problem of approximating the inverse of the wave-equation Hessian, also called normal operator, in seismology and other types of wave-based imaging. An expansion scheme for the pseudodifferential symbol of the…

Numerical Analysis · Mathematics 2015-03-17 Laurent Demanet , Pierre-David Létourneau , Nicolas Boumal , Henri Calandra , Jiawei Chiu , Stanley Snelson

We study a dynamic version of the implicit trace estimation problem. Given access to an oracle for computing matrix-vector multiplications with a dynamically changing matrix A, our goal is to maintain an accurate approximation to A's trace…

Data Structures and Algorithms · Computer Science 2021-10-27 Prathamesh Dharangutte , Christopher Musco

This paper investigates a recursive formulation of auto-regressive multi-fidelity Gaussian process regression in the challenging setting of noisy and non-nested high- and low-fidelity data. We propose a decoupled optimization strategy based…

Applications · Statistics 2026-05-21 Nils Baillie , Baptiste Kerleguer , Cyril Feau , Josselin Garnier

We consider the problem of estimating the asymptotic variance of a function defined on a Markov chain, an important step for statistical inference of the stationary mean. We design a novel recursive estimator that requires $O(1)$…

Statistics Theory · Mathematics 2024-09-24 Shubhada Agrawal , Prashanth L. A. , Siva Theja Maguluri

Model predictive control solves a constrained optimization problem online in order to compute an implicit closed-loop control policy. Recursive feasibility -- guaranteeing that the optimal control problem will have a solution at every time…

Optimization and Control · Mathematics 2024-10-16 Jacob W. Knaup , Panagiotis Tsiotras

In this paper, we study parametric nonlinear regression under the Harris recurrent Markov chain framework. We first consider the nonlinear least squares estimators of the parameters in the homoskedastic case, and establish asymptotic theory…

Statistics Theory · Mathematics 2016-09-15 Degui Li , Dag Tjøstheim , Jiti Gao

We discuss the computational complexity and feasibility properties of scenario based techniques for uncertain optimization programs. We consider different solution alternatives ranging from the standard scenario approach to recursive…

Optimization and Control · Mathematics 2014-12-16 Nikolaos Kariotoglou , Kostas Margellos , John Lygeros

We propose a novel tree-based ensemble method named Selective Cascade of Residual ExtraTrees (SCORE). SCORE draws inspiration from representation learning, incorporates regularized regression with variable selection features, and utilizes…

Machine Learning · Computer Science 2020-09-30 Qimin Liu , Fang Liu

We introduce a new restarting scheme for a continuous inertial dynamics with Hessian driven-damping, and establish a linear convergence rate for the function values along the restarted trajectories. The proposed routine is implemented…

Optimization and Control · Mathematics 2026-04-13 Juan José Maulén , Huiyuan Guo , Juan Peypouquet

We derive methods to compute higher order differentials (Hessians and Hessian-vector products) of the rendering operator. Our approach is based on importance sampling of a convolution that represents the differentials of rendering…

Graphics · Computer Science 2025-08-07 Zican Wang , Michael Fischer , Tobias Ritschel

In this work we adapt a prediction-correction algorithm for continuous time-varying convex optimization problems to solve dynamic programs arising from Model Predictive Control. In particular, the prediction step tracks the evolution of the…

Systems and Control · Electrical Eng. & Systems 2019-11-25 Santiago Paternain , Manfred Morari , Alejandro Ribeiro

In this paper, we consider a mean-reverting stochastic volatility equation with regime switching, and present some sufficient conditions for the existence of global positive solution, asymptotic boundedness in pth moment, positive…

Probability · Mathematics 2019-12-16 Yanling Zhu , Kai Wang , Yong Ren

Psychological change processes, such as university student dropout in math, often exhibit discrete latent state transitions and can be studied using regime-switching models with intensive longitudinal data (ILD). Recently, regime-switching…

Methodology · Statistics 2025-12-23 Kento Okuyama , Tim Fabian Schaffland , Pascal Kilian , Holger Brandt , Augustin Kelava