English
Related papers

Related papers: On the missing log in upper tail estimates

200 papers

Stochastic approximation methods play a central role in maximum likelihood estimation problems involving intractable likelihood functions, such as marginal likelihoods arising in problems with missing or incomplete data, and in parametric…

Computation · Statistics 2020-06-02 Valentin De Bortoli , Alain Durmus , Marcelo Pereyra , Ana F. Vidal

We propose a method to reconstruct and cluster incomplete high-dimensional data lying in a union of low-dimensional subspaces. Exploring the sparse representation model, we jointly estimate the missing data while imposing the intrinsic…

Computer Vision and Pattern Recognition · Computer Science 2017-09-06 João Carvalho , Manuel Marques , João P. Costeira

Sparse linear regression methods such as Lasso require a tuning parameter that depends on the noise variance, which is typically unknown and difficult to estimate in practice. In the presence of heavy-tailed noise or adversarial outliers,…

Statistics Theory · Mathematics 2025-06-17 Takeyuki Sasai , Hironori Fujisawa

Monotone inclusions have wide applications in solving various convex optimization problems arising in signal and image processing, machine learning, and medical image reconstruction. In this paper, we propose a new splitting algorithm for…

Optimization and Control · Mathematics 2020-09-29 Hui Yu , Chunxiang Zong , Yuchao Tang

This paper presents precise large deviation estimates for solutions to stochastic fixed point equations of the type V =_d f(V), where f(v) = Av + g(v) for a random function g(v) = o(v) a.s. as v tends to infinity. Specifically, we provide…

Probability · Mathematics 2011-03-15 Jeffrey F. Collamore , Anand N. Vidyashankar

Higher-order tensor datasets arise commonly in recommendation systems, neuroimaging, and social networks. Here we develop probable methods for estimating a possibly high rank signal tensor from noisy observations. We consider a generative…

Methodology · Statistics 2023-04-11 Chanwoo Lee , Miaoyan Wang

Consider the upper tail probability that the homomorphism count of a fixed graph $H$ within a large sparse random graph $G_n$ exceeds its expected value by a fixed factor $1+\delta$. Going beyond the Erd\H{o}s-R\'enyi model, we establish…

Probability · Mathematics 2021-02-01 Sohom Bhattacharya , Amir Dembo

The randomized Kaczmarz (RK) method is a well-known approach for solving linear least-squares problems with a large number of rows. RK accesses and processes just one row at a time, leading to exponentially fast convergence for consistent…

Numerical Analysis · Mathematics 2025-04-11 Ethan N. Epperly , Gil Goldshlager , Robert J. Webber

Multi-label classification has received considerable interest in recent years. Multi-label classifiers have to address many problems including: handling large-scale datasets with many instances and a large set of labels, compensating…

Machine Learning · Computer Science 2016-06-21 Amirhossein Akbarnejad , Mahdieh Soleymani Baghshah

Handling multiplicity without losing much power has been a persistent challenge in various fields that often face the necessity of managing numerous statistical tests simultaneously. Recently, $p$-value combination methods based on…

Statistics Theory · Mathematics 2024-02-06 Yeonwoo Rho

In this paper, we recover sparse signals from their noisy linear measurements by solving nonlinear differential inclusions, which is based on the notion of inverse scale space (ISS) developed in applied mathematics. Our goal here is to…

Statistics Theory · Mathematics 2016-01-22 Stanley Osher , Feng Ruan , Jiechao Xiong , Yuan Yao , Wotao Yin

Efficient and accurate low-rank approximation (LRA) methods are of great significance for large-scale data analysis. Randomized tensor decompositions have emerged as powerful tools to meet this need, but most existing methods perform poorly…

Machine Learning · Computer Science 2022-11-29 Yichun Qiu , Weijun Sun , Guoxu Zhou , Qibin Zhao

This paper develops asymptotic approximations of $P(\int_Te^{f(t)}\,dt>b)$ as $b\rightarrow\infty$ for a homogeneous smooth Gaussian random field, $f$, living on a compact $d$-dimensional Jordan measurable set $T$. The integral of an…

Probability · Mathematics 2012-05-29 Jingchen Liu

The Laplace approximation has been one of the workhorses of Bayesian inference. It often delivers good approximations in practice despite the fact that it does not strictly take into account where the volume of posterior density lies.…

Machine Learning · Statistics 2022-03-02 Nikolaos Gianniotis

For the problem of estimating lower tail and upper tail copulas, we propose two bootstrap procedures for approximating the distribution of the corresponding empirical tail copulas. The first method uses a multiplier bootstrap of the…

Statistics Theory · Mathematics 2013-12-12 Axel Bücher , Holger Dette

In extreme value inference it is a fundamental problem how the target value is required to be extreme by the extreme value theory. In iid settings this study both theoretically and numerically compares tail estimators, which are based on…

Statistics Theory · Mathematics 2024-09-04 Taku Moriyama

We consider the problem of recovering an unknown vector from noisy data with the help of projection estimates. The goal is to find a convex combination of these estimates with the minimal risk. We study an aggregation method based on the…

Statistics Theory · Mathematics 2012-06-20 Yu. Golubev

Classification on long-tailed distributed data is a challenging problem, which suffers from serious class-imbalance and accordingly unpromising performance especially on tail classes. Recently, the ensembling based methods achieve the…

Machine Learning · Computer Science 2022-03-28 Bolian Li , Zongbo Han , Haining Li , Huazhu Fu , Changqing Zhang

Let $\bx_j = \btheta +\bep_j, j=1,...,n$, be observations of an unknown parameter $\btheta$ in a Euclidean or separable Hilbert space $\scrH$, where $\bep_j$ are noises as random elements in $\scrH$ from a general distribution. We study the…

Statistics Theory · Mathematics 2022-01-03 Fan Zhou , Ping Li , Cun-Hui Zhang

The upsilon distribution, the sum of independent chi random variates and a normal, is introduced. As a special case, the upsilon distribution includes Lecoutre's lambda-prime distribution. The upsilon distribution finds application in…

Statistical Finance · Quantitative Finance 2021-08-17 Steven E. Pav