English
Related papers

Related papers: New Algorithms for Discrete-Time Parameter Estimat…

200 papers

We introduce estimation and test procedures through divergence minimization for models satisfying linear constraints with unknown parameter. Several statistical examples and motivations are given. These procedures extend the empirical…

Statistics Theory · Mathematics 2008-11-24 Michel Broniatowski , Amor Keziou

This paper considers fixed effects (FE) estimation for linear panel data models under possible model misspecification when both the number of individuals, $n$, and the number of time periods, $T$, are large. We first clarify the probability…

Statistics Theory · Mathematics 2014-03-12 Antonio F. Galvao , Kengo Kato

We present convergence and error estimates of the time-discrete consensus-based optimization(CBO) algorithms proposed in [arXiv:1909.09249] for general nonconvex functions. In authors' recent work [arxiv: 1910.08239], rigorous error…

Optimization and Control · Mathematics 2020-03-12 Seug-Yeal Ha , Shi Jin , Doheon Kim

The Parareal algorithm allows to solve evolution problems exploiting parallelization in time. Its convergence and stability have been proved under the assumption of regular (smooth) inputs. We present and analyze here a new Parareal…

Numerical Analysis · Mathematics 2019-04-09 Martin J. Gander , Iryna Kulchytska-Ruchka , Innocent Niyonzima , Sebastian Schöps

We study statistical inference for small-noise-perturbed multiscale dynamical systems under the assumption that we observe a single time series from the slow process only. We construct estimators for both averaging and homogenization…

Probability · Mathematics 2018-09-13 Siragan Gailus , Konstantinos Spiliopoulos

In this work, we show that for all statistical estimation problems, a natural MMSE instability (discontinuity) condition implies the failure of stable algorithms, serving as a version of OGP for estimation tasks. Using this criterion, we…

Statistics Theory · Mathematics 2026-03-24 Xifan Yu , Ilias Zadik

High-order tuners are algorithms that show promise in achieving greater efficiency than classic gradient-based algorithms in identifying the parameters of parametric models and/or in facilitating the progress of a control or optimization…

Systems and Control · Electrical Eng. & Systems 2022-04-05 Justin H. Le , Andrew R. Teel

We propose an improved method for estimating partial differential equations and delay partial differential equations from data, using Bayesian optimization and the Bayesian information criterion to automatically find suitable…

Computational Physics · Physics 2026-02-23 Oliver Mai , Tim W. Kroll , Uwe Thiele , Oliver Kamps

We propose new compressive parameter estimation algorithms that make use of polar interpolation to improve the estimator precision. Our work extends previous approaches involving polar interpolation for compressive parameter estimation in…

Information Theory · Computer Science 2016-11-17 Karsten Fyhn , Marco F. Duarte , Søren Holdt Jensen

This work establishes a rigorous connection between stability properties of discrete-time algorithms (DTAs) and corresponding continuous-time dynamical systems derived through $ O(s^r) $-resolution ordinary differential equations (ODEs). We…

Optimization and Control · Mathematics 2026-03-03 Amir Ali Farzin , Yuen-Man Pun , Philipp Braun , Iman Shames

In Compressed Sensing, a real-valued sparse vector has to be estimated from an underdetermined system of linear equations. In many applications, however, the elements of the sparse vector are drawn from a finite set. For the estimation of…

Information Theory · Computer Science 2016-08-24 Susanne Sparrer , Robert F. H. Fischer

We study efficient differentially private algorithms for estimating monotone statistics, i.e., statistics that are monotone under the addition of new observations. The starting point for our investigation is subsample-and-aggregate: a…

Cryptography and Security · Computer Science 2026-05-28 Gavin Brown , Ephraim Linder , Mahbod Majid , Vikrant Singhal

We investigate differentially private estimators for individual parameters within larger parametric models. While generic private estimators exist, the estimators we provide repose on new local notions of estimand stability, and these…

Machine Learning · Computer Science 2025-03-24 Hilal Asi , John C. Duchi , Kunal Talwar

We consider the problem of tracking an unknown time varying parameter that characterizes the probabilistic evolution of a sequence of independent observations. To this aim, we propose a stochastic gradient descent-based recursive scheme in…

Statistics Theory · Mathematics 2023-03-01 Alberto Lanconelli , Christopher S. A. Lauria

In this paper we consider the estimation of unknown parameters in Bayesian inverse problems. In most cases of practical interest, there are several barriers to performing such estimation, This includes a numerical approximation of a…

Methodology · Statistics 2025-02-07 Neil K. Chada , Ajay Jasra , Mohamed Maama , Raul Tempone

Physical models with uncertain inputs are commonly represented as parametric partial differential equations (PDEs). That is, PDEs with inputs that are expressed as functions of parameters with an associated probability distribution.…

Numerical Analysis · Mathematics 2023-05-15 Benjamin M. Kent , Catherine E. Powell , David J. Silvester , Małgorzata J. Zimoń

An algorithm for continuous time-delay estimation from sampled output data and known input of finite energy is presented. The continuous time-delay modeling allows for the estimation of subsample delays. The proposed estimation algorithm…

Systems and Control · Electrical Eng. & Systems 2022-11-22 Mohamed Abdalmoaty , Alexander Medvedev

The goal of this paper is to understand how exponential-time approximation algorithms can be obtained from existing polynomial-time approximation algorithms, existing parameterized exact algorithms, and existing parameterized approximation…

Data Structures and Algorithms · Computer Science 2023-06-28 Barış Can Esmer , Ariel Kulik , Dániel Marx , Daniel Neuen , Roohani Sharma

Prescribed-time algorithms based on time-varying gains may have remarkable properties, such as regulation in a user-prescribed finite time that is the same for every nonzero initial condition and that holds even under matched disturbances.…

Systems and Control · Electrical Eng. & Systems 2023-12-18 Rodrigo Aldana-López , Richard Seeber , Hernan Haimovich , David Gómez-Gutiérrez

Under a standard assumption in complexity theory (NP not in P/poly), we demonstrate a gap between the minimax prediction risk for sparse linear regression that can be achieved by polynomial-time algorithms, and that achieved by optimal…

Statistics Theory · Mathematics 2014-05-22 Yuchen Zhang , Martin J. Wainwright , Michael I. Jordan