English
Related papers

Related papers: Online Covariance Matrix Estimation in Sketched Ne…

200 papers

In this work, we present a globalized stochastic semismooth Newton method for solving stochastic optimization problems involving smooth nonconvex and nonsmooth convex terms in the objective function. We assume that only noisy gradient and…

Optimization and Control · Mathematics 2018-03-12 Andre Milzarek , Xiantao Xiao , Shicong Cen , Zaiwen Wen , Michael Ulbrich

In sketched clustering, a dataset of $T$ samples is first sketched down to a vector of modest size, from which the centroids are subsequently extracted. Advantages include i) reduced storage complexity and ii) centroid extraction complexity…

Information Theory · Computer Science 2019-05-21 Evan Byrne , Antoine Chatalic , Remi Gribonval , Philip Schniter

This paper addresses the optimization problem of minimizing non-convex continuous functions, which is relevant in the context of high-dimensional machine learning applications characterized by over-parametrization. We analyze a randomized…

Machine Learning · Computer Science 2025-02-28 Jim Zhao , Aurelien Lucchi , Nikita Doikov

Random projections or sketching are widely used in many algorithmic and learning contexts. Here we study the performance of iterative Hessian sketch for least-squares problems. By leveraging and extending recent results from random matrix…

Optimization and Control · Mathematics 2020-10-26 Jonathan Lacotte , Sifan Liu , Edgar Dobriban , Mert Pilanci

We present a variational method for online state estimation and parameter learning in state-space models (SSMs), a ubiquitous class of latent variable models for sequential data. As per standard batch variational techniques, we use…

Machine Learning · Statistics 2022-06-16 Andrew Campbell , Yuyang Shi , Tom Rainforth , Arnaud Doucet

Covariance estimation is ubiquitous in functional data analysis. Yet, the case of functional observations over multidimensional domains introduces computational and statistical challenges, rendering the standard methods effectively…

Methodology · Statistics 2022-11-02 Soham Sarkar , Victor M. Panaretos

In this paper we derive an online estimator for sparse parameter vectors which, unlike the LASSO approach, does not require the tuning of any hyperparameters. The algorithm is based on a covariance matching approach and is equivalent to a…

Statistics Theory · Mathematics 2015-06-04 Dave Zachariah , Petre Stoica

Sequential prediction problems such as imitation learning, where future observations depend on previous predictions (actions), violate the common i.i.d. assumptions made in statistical learning. This leads to poor performance in theory and…

Machine Learning · Computer Science 2015-03-17 Stephane Ross , Geoffrey J. Gordon , J. Andrew Bagnell

Optimization plays a key role in machine learning. Recently, stochastic second-order methods have attracted much attention due to their low computational cost in each iteration. However, these algorithms might perform poorly especially if…

Machine Learning · Computer Science 2017-10-25 Haishan Ye , Zhihua Zhang

In this paper, we consider stochastic second-order methods for minimizing a finite summation of nonconvex functions. One important key is to find an ingenious but cheap scheme to incorporate local curvature information. Since the true…

Optimization and Control · Mathematics 2021-03-26 Minghan Yang , Dong Xu , Hongyu Chen , Zaiwen Wen , Mengyun Chen

In recent years, various subspace algorithms have been developed to handle large-scale optimization problems. Although existing subspace Newton methods require fewer iterations to converge in practice, the matrix operations and full…

Optimization and Control · Mathematics 2024-06-05 Taisei Miyaishi , Ryota Nozawa , Pierre-Louis Poirion , Akiko Takeda

We develop an online learning method for prediction, which is important in problems with large and/or streaming data sets. We formulate the learning approach using a covariance-fitting methodology, and show that the resulting predictor has…

Machine Learning · Computer Science 2017-03-16 Dave Zachariah , Petre Stoica , Thomas B. Schön

With network data becoming ubiquitous in many applications, many models and algorithms for network analysis have been proposed. Yet methods for providing uncertainty estimates in addition to point estimates of network parameters are much…

Methodology · Statistics 2022-06-28 Qianhua Shan , Elizaveta Levina

This article proposes an online bootstrap scheme for nonparametric level estimation in nonstationary time series. Our approach applies to a broad class of level estimators expressible as weighted sample averages over time windows, including…

Methodology · Statistics 2026-03-02 Thomas Nagler , Tobias Brock , Nicolai Palm

In data mining, estimating the number of distinct values (NDV) is a fundamental problem with various applications. Existing methods for estimating NDV can be broadly classified into two categories: i) scanning-based methods, which scan the…

Databases · Computer Science 2022-06-14 Jiajun Li , Zhewei Wei , Bolin Ding , Xiening Dai , Lu Lu , Jingren Zhou

In this work, we consider the problem of online (real-time, single-shot) estimation of static or slow-varying parameters along quantum trajectories in quantum dynamical systems. Based on the measurement signal of a continuously-monitored…

Quantum Physics · Physics 2024-06-19 Henrik Glavind Clausen , Pierre Rouchon , Rafal Wisniewski

We present a quasi-Newton method for unconstrained stochastic optimization. Most existing literature on this topic assumes a setting of stochastic optimization in which a finite sum of component functions is a reasonable approximation of an…

Optimization and Control · Mathematics 2024-09-04 Matt Menickelly , Stefan M. Wild , Miaolan Xie

We study stochastic second-order methods for solving general non-convex optimization problems. We propose using a special version of momentum to stabilize the stochastic gradient and Hessian estimates in Newton's method. We show that…

Optimization and Control · Mathematics 2025-06-27 El Mahdi Chayti , Nikita Doikov , Martin Jaggi

When the sample path of a Hawkes process is observed discretely, such that only the total event counts in disjoint time intervals are known, the likelihood function becomes intractable. To overcome the challenge of likelihood-based…

Methodology · Statistics 2025-06-24 Jason J. Lambe , Feng Chen , Tom Stindl , Tsz-Kit Jeffrey Kwan

This paper describes a new algorithm for computing a low-Tucker-rank approximation of a tensor. The method applies a randomized linear map to the tensor to obtain a sketch that captures the important directions within each mode, as well as…

Numerical Analysis · Mathematics 2021-05-04 Yiming Sun , Yang Guo , Charlene Luo , Joel Tropp , Madeleine Udell