English
Related papers

Related papers: Multivariate GARCH estimation via a Bregman-proxim…

200 papers

We consider the problem of joint estimation of structured covariance matrices. Assuming the structure is unknown, estimation is achieved using heterogeneous training sets. Namely, given groups of measurements coming from centered…

Statistics Theory · Mathematics 2016-04-20 Ilya Soloveychik , Ami Wiesel

In the gravitational-wave analysis of pulsar-timing-array datasets, parameter estimation is usually performed using Markov Chain Monte Carlo methods to explore posterior probability densities. We introduce an alternative procedure that…

General Relativity and Quantum Cosmology · Physics 2024-05-16 Michele Vallisneri , Marco Crisostomi , Aaron D. Johnson , Patrick M. Meyers

This paper introduces an online approach for identifying time-varying subspaces defined by linear dynamical systems. The approach of representing linear systems by non-parametric subspace models has received significant interest in the…

Systems and Control · Electrical Eng. & Systems 2025-12-01 András Sasfi , Alberto Padoan , Ivan Markovsky , Florian Dörfler

Many large-scale optimization problems arising in science and engineering are naturally defined at multiple levels of discretization or model fidelity. Multilevel methods exploit this hierarchy to accelerate convergence by combining coarse-…

Optimization and Control · Mathematics 2025-12-02 Robert Baraldi , Michael Hintermüller , Qi Wang

Modern large-scale statistical models require to estimate thousands to millions of parameters. This is often accomplished by iterative algorithms such as gradient descent, projected gradient descent or their accelerated versions. What are…

Machine Learning · Statistics 2020-03-04 Michael Celentano , Andrea Montanari , Yuchen Wu

In this contribution, we are concerned with parameter optimization problems that are constrained by multiscale PDE state equations. As an efficient numerical solution approach for such problems, we introduce and analyze a new relaxed and…

Numerical Analysis · Mathematics 2023-04-13 Tim Keil , Mario Ohlberger

Generalized autoregressive conditional heteroscedasticity (GARCH) models have long been considered as one of the most successful families of approaches for volatility modeling in financial return series. In this paper, we propose an…

Machine Learning · Computer Science 2013-01-29 Emmanouil A. Platanios , Sotirios P. Chatzis

In this article we consider Bayesian estimation of static parameters for a class of partially observed McKean-Vlasov diffusion processes with discrete-time observations over a fixed time interval. This problem features several obstacles to…

Computation · Statistics 2025-04-23 Ajay Jasra , Amin Wu

Due to the need for robust uncertainty quantification, Bayesian neural learning has gained attention in the era of deep learning and big data. Markov Chain Monte-Carlo (MCMC) methods typically implement Bayesian inference which faces…

Machine Learning · Computer Science 2020-05-15 Rohitash Chandra , Konark Jain , Arpit Kapoor , Ashray Aman

There is a recent proliferation of research on the integration of machine learning and optimization. One expansive area within this research stream is predictive-model embedded optimization, which proposes the use of pre-trained predictive…

Machine Learning · Computer Science 2022-10-20 Chenbo Shi , Mohsen Emadikhiav , Leonardo Lozano , David Bergman

Multivariate time series anomaly detection has numerous real-world applications and is being extensively studied. Modeling pairwise correlations between variables is crucial. Existing methods employ learnable graph structures and graph…

Machine Learning · Computer Science 2025-01-24 Zehao Liu , Mengzhou Gao , Pengfei Jiao

Gaussian process regression is a popular Bayesian framework for surrogate modeling of expensive data sources. As part of a broader effort in scientific machine learning, many recent works have incorporated physical constraints or other a…

Machine Learning · Computer Science 2021-01-07 Laura Swiler , Mamikon Gulian , Ari Frankel , Cosmin Safta , John Jakeman

Estimation and prediction in high dimensional multivariate factor stochastic volatility models is an important and active research area because such models allow a parsimonious representation of multivariate stochastic volatility. Bayesian…

Computation · Statistics 2021-04-27 David Gunawan , Robert Kohn , David Nott

We consider robust covariance estimation with group symmetry constraints. Non-Gaussian covariance estimation, e.g., Tyler scatter estimator and Multivariate Generalized Gaussian distribution methods, usually involve non-convex minimization…

Machine Learning · Statistics 2013-06-19 Ilya Soloveychik , Ami Wiesel

For time series with long-range temporal dependence, inference for covariance and precision matrices is non-trivial. We propose a Berry-Esseen type Gaussian approximation result that gives a finite-sample bound for the Kolmogorov distance…

Statistics Theory · Mathematics 2026-04-20 Percy S. Zhai , Mladen Kolar , Wei Biao Wu

The linearized Bregman method is a method to calculate sparse solutions to systems of linear equations. We formulate this problem as a split feasibility problem, propose an algorithmic framework based on Bregman projections and prove a…

Optimization and Control · Mathematics 2013-09-11 Dirk A. Lorenz , Frank Schöpfer , Stephan Wenger

One of the outstanding problems in the numerical discretization of the Feynman-Kac formula calls for the design of arbitrary-order short-time approximations that are constructed in a stable way, yet only require knowledge of the potential…

Mathematical Physics · Physics 2007-05-23 Cristian Predescu

Worst-case complexity guarantees for nonconvex optimization algorithms have been a topic of growing interest. Multiple frameworks that achieve the best known complexity bounds among a broad class of first- and second-order strategies have…

Optimization and Control · Mathematics 2020-11-23 Frank E. Curtis , Daniel P. Robinson , Clément Royer , Stephen J. Wright

Modeling real-world multidimensional time series can be particularly challenging when these are sporadically observed (i.e., sampling is irregular both in time and across dimensions)-such as in the case of clinical patient data. To address…

Machine Learning · Computer Science 2019-12-02 Edward De Brouwer , Jaak Simm , Adam Arany , Yves Moreau

Estimation of spatially-varying parameters for computationally expensive forward models governed by partial differential equations is addressed. A novel multiscale Bayesian inference approach is introduced based on deep probabilistic…

Machine Learning · Statistics 2022-03-02 Yingzhi Xia , Nicholas Zabaras