English
Related papers

Related papers: Regularized estimation of linear functionals of pr…

200 papers

We first study the properties of solutions of quadratic programs with linear equality constraints whose parameters are estimated from data in the high-dimensional setting where p, the number of variables in the problem, is of the same order…

Statistics Theory · Mathematics 2012-11-14 Noureddine El Karoui

When observations are curves over some natural time interval, the field of functional data analysis comes into play. Functional linear processes account for temporal dependence in the data. The prediction problem for functional linear…

Methodology · Statistics 2023-12-12 Johannes Klepsch , Claudia Klüppelberg

Continuous-time empirical dynamic discrete choice games offer notable computational advantages over discrete-time models. This paper addresses remaining computational and econometric challenges to further improve both model solution and…

Econometrics · Economics 2025-11-11 Jason R. Blevins

We propose solution of the problem of the mean square optimal estimation of linear functionals which depend on the unobserved values of a continuous time stochastic process with periodically correlated increments based on observations of…

Statistics Theory · Mathematics 2024-01-18 Maksym Luz , Mikhail Moklyachuk

Inference and prediction under the sparsity assumption have been a hot research topic in recent years. However, in practice, the sparsity assumption is difficult to test, and more importantly can usually be violated. In this paper, to study…

Statistics Theory · Mathematics 2022-10-18 Yanmei Shi , Zhiruo Li , Qi Zhang

We consider the estimation of large covariance and precision matrices from high-dimensional sub-Gaussian or heavier-tailed observations with slowly decaying temporal dependence. The temporal dependence is allowed to be long-range so with…

Statistics Theory · Mathematics 2019-12-23 Hai Shu , Bin Nan

The Markowitz mean-variance portfolio optimization model aims to balance expected return and risk when investing. However, there is a significant limitation when solving large portfolio optimization problems efficiently: the large and dense…

Portfolio Management · Quantitative Finance 2023-06-23 Cassidy K. Buhler , Hande Y. Benson

The randomized version of the Kaczmarz method for the solution of linear systems is known to converge linearly in expectation. In this work we extend this result and show that the recently proposed Randomized Sparse Kaczmarz method for…

Optimization and Control · Mathematics 2016-10-11 Frank Schöpfer , Dirk A. Lorenz

Approximate dynamic programming has been used successfully in a large variety of domains, but it relies on a small set of provided approximation features to calculate solutions reliably. Large and rich sets of features can cause existing…

Artificial Intelligence · Computer Science 2015-03-17 Marek Petrik , Gavin Taylor , Ron Parr , Shlomo Zilberstein

Transductive methods are useful in prediction problems when the training dataset is composed of a large number of unlabeled observations and a smaller number of labeled observations. In this paper, we propose an approach for developing…

Statistics Theory · Mathematics 2010-06-16 Pierre Alquier , Mohamed Hebiri

We consider the linear regression problem, where the number $p$ of covariates is possibly larger than the number $n$ of observations $(x_{i},y_{i})_{i\leq i \leq n}$, under sparsity assumptions. On the one hand, several methods have been…

Statistics Theory · Mathematics 2009-06-08 Pierre Alquier , Mohamed Hebiri

Piecewise deterministic Markov processes (PDMPs) are a class of continuous-time Markov processes that were recently used to develop a new class of Markov chain Monte Carlo algorithms. However, the implementation of the processes is…

Computation · Statistics 2024-08-08 Charly Andral , Kengo Kamatani

Attention mechanisms have been extensively employed in various applications, including time series modeling, owing to their capacity to capture intricate dependencies; however, their utility is often constrained by quadratic computational…

Machine Learning · Computer Science 2025-11-06 Mingtao Zhang , Guoli Yang , Zhanxing Zhu , Mengzhu Wang , Xiaoying Bai

High-dimensional time series has diverse applications in econometrics and finance. Recent models for capturing temporal dependence have employed a bilinear representation for matrix time series, or the Tucker-decomposition based…

Methodology · Statistics 2025-06-03 Debika Ghosh , Samrat Roy , Nilanjana Chakraborty

Functional linear regression is one of the fundamental and well-studied methods in functional data analysis. In this work, we investigate the functional linear regression model within the context of reproducing kernel Hilbert space by…

Statistics Theory · Mathematics 2024-12-12 Naveen Gupta , S. Sivananthan , Bharath K. Sriperumbudur

We study general singular value shrinkage estimators in high-dimensional regression and classification, when the number of features and the sample size both grow proportionally to infinity. We allow models with general covariance matrices…

Statistics Theory · Mathematics 2020-04-01 Panagiotis Lolas

This paper investigates the convergence of the randomized Kaczmarz algorithm for the problem of phase retrieval of complex-valued objects. While this algorithm has been studied for the real-valued case}, its generalization to the…

Information Theory · Computer Science 2020-10-14 Teng Zhang , Feng Yu

Estimation of a sparse spectral precision matrix, the inverse of a spectral density matrix, is a canonical problem in frequency-domain analysis of high-dimensional time series (HDTS), with applications in neurosciences and environmental…

Methodology · Statistics 2025-11-11 Navonil Deb , Amy Kuceyeski , Sumanta Basu

Sparse linear regression methods including the well-known LASSO and the Dantzig selector have become ubiquitous in the engineering practice, including in medical imaging. Among other tasks, they have been successfully applied for the…

Signal Processing · Electrical Eng. & Systems 2023-01-03 Anna Pidnebesna , Iveta Fajnerova , Jiri Horacek , Jaroslav Hlinka

This paper is concerned with the problem of policy evaluation with linear function approximation in discounted infinite horizon Markov decision processes. We investigate the sample complexities required to guarantee a predefined estimation…

Machine Learning · Statistics 2024-05-03 Gen Li , Weichen Wu , Yuejie Chi , Cong Ma , Alessandro Rinaldo , Yuting Wei