English
Related papers

Related papers: An autocovariance-based learning framework for hig…

200 papers

Estimating covariance matrices with high-dimensional complex data presents significant challenges, particularly concerning positive definiteness, sparsity, and numerical stability. Existing robust sparse estimators often fail to guarantee…

Methodology · Statistics 2025-12-30 Shaoxin Wang , Ziyun Ma

A good measure of similarity between data points is crucial to many tasks in machine learning. Similarity and metric learning methods learn such measures automatically from data, but they do not scale well respect to the dimensionality of…

Machine Learning · Computer Science 2019-09-10 Kuan Liu , Aurélien Bellet , Fei Sha

This paper studies model selection consistency for high dimensional sparse regression when data exhibits both cross-sectional and serial dependency. Most commonly-used model selection methods fail to consistently recover the true model when…

Methodology · Statistics 2018-09-12 Jianqing Fan , Yuan Ke , Kaizheng Wang

Functional magnetic resonance imaging (fMRI) data provides information concerning activity in the brain and in particular the interactions between brain regions. Resting state fMRI data is widely used for inferring connectivities in the…

Applications · Statistics 2019-03-04 Christina Stoehr , John A D Aston , Claudia Kirch

This paper studies linear reconstruction of partially observed functional data which are recorded on a discrete grid. We propose a novel estimation approach based on approximate factor models with increasing rank taking into account…

Statistics Theory · Mathematics 2024-05-22 Maximilian Ofner , Siegfried Hörmann

This paper addresses the problem of fault diagnosis in multistation assembly systems. Fault diagnosis is to identify process faults that cause the excessive dimensional variation of the product using dimensional measurements. For such…

Applications · Statistics 2022-10-31 Jihoon Chung , Bo Shen , Zhenyu , Kong

We propose a new estimator for the high-dimensional linear regression model with observation error in the design where the number of coefficients is potentially larger than the sample size. The main novelty of our procedure is that the…

Methodology · Statistics 2019-09-09 Alexandre Belloni , Abhishek Kaul , Mathieu Rosenbaum

We propose a two-step procedure to detect cointegration in high-dimensional settings, focusing on sparse relationships. First, we use the adaptive LASSO to identify the small subset of integrated covariates driving the equilibrium…

Methodology · Statistics 2026-03-05 Jesus Gonzalo , Jean-Yves Pitarakis

Existing black box modeling approaches in machine learning suffer from a fixed input and output feature combination. In this paper, a new approach to reconstruct missing variables in a set of time series is presented. An autoencoder is…

Machine Learning · Computer Science 2023-08-22 Jan-Philipp Roche , Oliver Niggemann , Jens Friebe

Trajectory estimation involves determining the trajectory of a mobile robot by combining prior knowledge about its dynamic model with noisy observations of its state obtained using sensors. The accuracy of such a procedure is dictated by…

Robotics · Computer Science 2026-02-20 Abhishek Goudar , Angela P. Schoellig

We consider the class of convex minimization problems, composed of a self-concordant function, such as the $\log\det$ metric, a convex data fidelity term $h(\cdot)$ and, a regularizing -- possibly non-smooth -- function $g(\cdot)$. This…

Machine Learning · Statistics 2014-05-14 Anastasios Kyrillidis , Rabeeh Karimi Mahabadi , Quoc Tran-Dinh , Volkan Cevher

We examine the linear regression problem in a challenging high-dimensional setting with correlated predictors where the vector of coefficients can vary from sparse to dense. In this setting, we propose a combination of probabilistic…

Methodology · Statistics 2025-05-13 Roman Parzer , Peter Filzmoser , Laura Vana-Gür

There are many time series in the literature with high dimension yet limited sample sizes, such as macroeconomic variables, and it is almost impossible to obtain efficient estimation and accurate prediction by using the corresponding…

Methodology · Statistics 2025-10-30 Yuchang Lin , Qianqian Zhu , Guodong Li

In this paper, we investigate the problem of optimization multivariate performance measures, and propose a novel algorithm for it. Different from traditional machine learning methods which optimize simple loss functions to learn prediction…

Machine Learning · Computer Science 2015-08-03 Jiachen Yanga , Zhiyong Dinga , Fei Guoa , Huogen Wanga , Nick Hughesb

We reconcile the two worlds of dense and sparse modeling by exploiting the positive aspects of both. We employ a factor model and assume {the dynamic of the factors is non-pervasive while} the idiosyncratic term follows a sparse vector…

Methodology · Statistics 2022-05-25 Jonas Krampe , Luca Margaritella

Data assimilation algorithms estimate the state of a dynamical system from partial observations, where the successful performance of these algorithms hinges on costly parameter tuning and on employing an accurate model for the dynamics.…

Machine Learning · Statistics 2026-03-24 Melissa Adrian , Daniel Sanz-Alonso , Rebecca Willett

The classical sparse parameter identification methods are usually based on the iterative basis selection such as greedy algorithms, or the numerical optimization of regularized cost functions such as LASSO and Bayesian posterior probability…

Systems and Control · Electrical Eng. & Systems 2026-05-05 Yanxin Fu , Wenxiao Zhao

We study the problem of discovering functional dependencies (FD) from a noisy dataset. We focus on FDs that correspond to statistical dependencies in a dataset and draw connections between FD discovery and structure learning in…

Databases · Computer Science 2019-05-07 Zhihan Guo , Theodoros Rekatsinas

Although a majority of the theoretical literature in high-dimensional statistics has focused on settings which involve fully-observed data, settings with missing values and corruptions are common in practice. We consider the problems of…

Machine Learning · Statistics 2017-11-06 Yining Wang , Jialei Wang , Sivaraman Balakrishnan , Aarti Singh

We deal with the problem of optimal estimation of the linear functionals constructed from unobserved values of a continuous time stochastic process with periodically correlated increments based on past observations of this process. To solve…

Statistics Theory · Mathematics 2023-04-25 Maksym Luz , Mikhail Moklyachuk