English
Related papers

Related papers: High-Dimensional Yield Estimation using Shrinkage …

200 papers

In real-world applications, it is important for machine learning algorithms to be robust against data outliers or corruptions. In this paper, we focus on improving the robustness of a large class of learning algorithms that are formulated…

Machine Learning · Computer Science 2021-06-04 Quanming Yao , Hangsi Yang , En-Liang Hu , James Kwok

This paper considers improved forecasting in possibly nonlinear dynamic settings, with high-dimension predictors ("big data" environments). To overcome the curse of dimensionality and manage data and model complexity, we examine shrinkage…

Econometrics · Economics 2019-04-26 Ali Habibnia , Esfandiar Maasoumi

Asynchronous stochastic gradient descent (ASGD) is a popular parallel optimization algorithm in machine learning. Most theoretical analysis on ASGD take a discrete view and prove upper bounds for their convergence rates. However, the…

Machine Learning · Statistics 2018-05-09 Li He , Qi Meng , Wei Chen , Zhi-Ming Ma , Tie-Yan Liu

Being able to efficiently obtain an accurate estimate of the failure probability of SRAM components has become a central issue as model circuits shrink their scale to submicrometer with advanced technology nodes. In this work, we revisit…

Machine Learning · Computer Science 2023-08-01 Yanfang Liu , Guohao Dai , Wei W. Xing

Supervised dimensionality reduction strategies have been of great interest. However, current supervised dimensionality reduction approaches are difficult to scale for situations characterized by large datasets given the high computational…

Machine Learning · Computer Science 2018-11-09 Amir-Hossein Karimi , Alexander Wong , Ali Ghodsi

Stochastic gradient methods are central to large-scale learning, but they treat mini-batch gradients as unbiased estimators, which classical decision theory shows are inadmissible in high dimensions. We formulate gradient computation as a…

Machine Learning · Computer Science 2026-02-10 M. Arashi , M. Amintoosi

This paper shows how to carry out efficient asymptotic variance reduction when estimating volatility in the presence of stochastic volatility and microstructure noise with the realized kernels (RK) from [Barndorff-Nielsen et al., 2008] and…

Statistical Finance · Quantitative Finance 2018-06-28 Simon Clinet , Yoann Potiron

Stochastic gradient descent (SGD) is a widely used algorithm in machine learning, particularly for neural network training. Recent studies on SGD for canonical quadratic optimization or linear regression show it attains well generalization…

Machine Learning · Computer Science 2024-09-17 Haihan Zhang , Yuanshi Liu , Qianwen Chen , Cong Fang

In this paper we estimate the mean-variance portfolio in the high-dimensional case using the recent results from the theory of random matrices. We construct a linear shrinkage estimator which is distribution-free and is optimal in the sense…

Statistical Finance · Quantitative Finance 2023-04-19 Taras Bodnar , Yarema Okhrin , Nestor Parolya

Despite the numerous uses of semidefinite programming (SDP) and its universal solvability via interior point methods (IPMs), it is rarely applied to practical large-scale problems. This mainly owes to the computational cost of IPMs that…

Optimization and Control · Mathematics 2024-03-19 Yifan Ran , Stefan Vlaski , Wei Dai

We derive an optimal shrinkage sample covariance matrix (SCM) estimator which is suitable for high dimensional problems and when sampling from an unspecified elliptically symmetric distribution. Specifically, we derive the optimal (oracle)…

Methodology · Statistics 2017-07-03 Esa Ollila

Symbolic regression (SR) aims to discover interpretable analytical expressions that accurately describe observed data. Amortized SR promises to be much more efficient than the predominant genetic programming SR methods, but currently…

Machine Learning · Computer Science 2026-02-24 Paul Saegert , Ullrich Köthe

Sparsity regularized loss minimization problems play an important role in various fields including machine learning, data mining, and modern statistics. Proximal gradient descent method and coordinate descent method are the most popular…

Machine Learning · Computer Science 2023-11-13 Runxue Bao , Bin Gu , Heng Huang

Stochastic Gradient Descent (SGD) and its Ruppert-Polyak averaged variant (ASGD) lie at the heart of modern large-scale learning, yet their theoretical properties in high-dimensional settings are rarely understood. In this paper, we provide…

Machine Learning · Statistics 2025-10-15 Jiaqi Li , Zhipeng Lou , Johannes Schmidt-Hieber , Wei Biao Wu

Spiking neural networks (SNNs), recognized as an energy-efficient alternative to traditional artificial neural networks (ANNs), have advanced rapidly through the scaling of models and datasets. However, such scaling incurs considerable…

Neural and Evolutionary Computing · Computer Science 2025-10-07 Chenxiang Ma , Xinyi Chen , Yujie Wu , Kay Chen Tan , Jibin Wu

In this paper we derive the optimal linear shrinkage estimator for the high-dimensional mean vector using random matrix theory. The results are obtained under the assumption that both the dimension $p$ and the sample size $n$ tend to…

Statistics Theory · Mathematics 2018-07-17 Taras Bodnar , Ostap Okhrin , Nestor Parolya

Depth estimation is a critical task in computer vision, with applications in autonomous navigation, robotics, and augmented reality. Event cameras, which encode temporal changes in light intensity as asynchronous binary spikes, offer unique…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Xin Zhang , Liangxiu Han , Tam Sobeih , Lianghao Han , Darren Dancey

The purpose of sufficient dimension reduction (SDR) is to find the low-dimensional subspace of input features that is sufficient for predicting output values. In this paper, we propose a novel distribution-free SDR method called sufficient…

Machine Learning · Statistics 2011-03-28 Makoto Yamada , Gang Niu , Jun Takagi , Masashi Sugiyama

We study spectral algorithms in the setting where kernels are learned from data. We introduce the effective span dimension (ESD), an alignment-sensitive complexity measure that depends jointly on the signal, spectrum, and noise level…

Machine Learning · Computer Science 2026-05-12 Dongming Huang , Zhifan Li , Yicheng Li , Qian Lin

For solving pseudo-convex global optimization problems, we present a novel fully adaptive steepest descent method (or ASDM) without any hard-to-estimate parameters. For the step-size regulation in an $\varepsilon$-normalized direction, we…

Optimization and Control · Mathematics 2021-08-12 Z. R. Gabidullina
‹ Prev 1 2 3 10 Next ›