English
Related papers

Related papers: Landscape Complexity for the Empirical Risk of Gen…

200 papers

Analytic continuation of imaginary time or frequency data to the real axis is a crucial step in extracting dynamical properties from quantum Monte Carlo simulations. The average spectrum method provides an elegant solution by integrating…

Computational Physics · Physics 2020-07-15 Khaldoon Ghanem , Erik Koch

While linear mixed modeling methods are foundational concepts introduced in any statistical education, adequate general methods for interval estimation involving models with more than a few variance components are lacking, especially in the…

Methodology · Statistics 2012-11-07 Jessi Cisewski , Jan Hannig

Generalized power asymptotic expansions of solutions to differential equations that depend on parameters are investigated. The changing nature of these expansions as the parameters of the model cross critical values is discussed. An…

Classical Analysis and ODEs · Mathematics 2007-05-23 Alejandro S. Jakubi

We propose a novel framework for exploring weak and $L_2$ generalization errors of algorithms through the lens of differential calculus on the space of probability measures. Specifically, we consider the KL-regularized empirical risk…

Machine Learning · Statistics 2023-06-21 Gholamali Aminian , Samuel N. Cohen , Łukasz Szpruch

Motivated by the pressing needs for capturing complex but interpretable variable relationships in scientific research, here we generalize the squared Pearson correlation to capture a mixture of linear dependences between two real-valued…

Methodology · Statistics 2020-07-01 Jingyi Jessica Li , Xin Tong , Peter J. Bickel

We introduce a modified version of the excess risk, which can be used to obtain tighter, fast-rate PAC-Bayesian generalisation bounds. This modified excess risk leverages information about the relative hardness of data examples to reduce…

Machine Learning · Computer Science 2023-01-25 Felix Biggs , Benjamin Guedj

In this article, by using composite asymmetric least squares (CALS) and empirical likelihood, we propose a two-step procedure to estimate the conditional value at risk (VaR) and conditional expected shortfall (ES) for the GARCH series.…

Statistics Theory · Mathematics 2018-07-05 Sheng Wu , Yi Zhang , Jun Zhao , Liming Shen

A new averaging method linking discrete to continuum variables of granular materials is developed and used to derive average balance equations. Its novelty lies in the choice of the decomposition between mean values and fluctuations of…

Soft Condensed Matter · Physics 2015-06-24 Riccardo Artoni , Patrick Richard

Estimation of crossed random effects models commonly requires computational costs that grow faster than linearly in the sample size $N$, often as fast as $\Omega(N^{3/2})$, making them unsuitable for large data sets. For non-Gaussian…

Methodology · Statistics 2025-05-01 Ruggero Bellio , Swarnadip Ghosh , Art B. Owen , Cristiano Varin

We provide an axiomatic approach to general premium principles in a probability-free setting that allows for Knightian uncertainty. Every premium principle is the sum of a risk measure, as a generalization of the expected value, and a…

Risk Management · Quantitative Finance 2020-12-21 Max Nendel , Frank Riedel , Maren Diane Schmeck

Generalized linear models (GLMs) form one of the most popular classes of models in statistics. The gamma variant is used, for instance, in actuarial science for the modelling of claim amounts in insurance. A flaw of GLMs is that they are…

Methodology · Statistics 2024-02-12 Philippe Gagnon , Yuxi Wang

In this paper, we explain a new Iterative Method-Fixed Point and develop its convergence theory for finding approximate solutions of nonlinear equations in the setting of Banach spaces. First, we discuss the convergence analysis of our…

General Mathematics · Mathematics 2022-05-10 Nikos Mantzakouras , Eteri Biragova

We employ random matrix theory to establish consistency of generalized cross validation (GCV) for estimating prediction risks of sketched ridge regression ensembles, enabling efficient and consistent tuning of regularization and sketching…

Statistics Theory · Mathematics 2024-03-21 Pratik Patil , Daniel LeJeune

The importance of exploring a potential integration among surveys has been acknowledged in order to enhance effectiveness and minimize expenses. In this work, we employ the alignment method to combine information from two different surveys…

Methodology · Statistics 2024-04-09 Vasilis Chasiotis , Dimitris Karlis

We study statistical problems, such as planted clique, its variants, and sparse principal component analysis in the context of average-case communication complexity. Our motivation is to understand the statistical-computational trade-offs…

Computational Complexity · Computer Science 2021-07-06 Cyrus Rashtchian , David P. Woodruff , Peng Ye , Hanlin Zhu

Motivated by current interest in understanding statistical properties of random landscapes in high-dimensional spaces, we consider a model of the landscape in $\mathbb{R}^N$ obtained by superimposing $M>N$ plane waves of random wavevectors…

Statistical Mechanics · Physics 2022-09-14 Bertrand Lacroix-A-Chez-Toine , Sirio Belga Fedeli , Yan V. Fyodorov

The method of generalized estimating equations (GEE) is popular in the biostatistics literature for analyzing longitudinal binary and count data. It assumes a generalized linear model (GLM) for the outcome variable, and a working…

Methodology · Statistics 2016-06-03 Aristidis K. Nikoloulopoulos

We analyze the generalization and robustness of the batched weighted average algorithm for V-geometrically ergodic Markov data. This algorithm is a good alternative to the empirical risk minimization algorithm when the latter suffers from…

Machine Learning · Statistics 2014-08-13 Nguyen Viet Cuong , Lam Si Tung Ho , Vu Dinh

We introduce the formalism of generalized Fourier transforms in the context of risk management. We develop a general framework to efficiently compute the most popular risk measures, Value-at-Risk and Expected Shortfall (also known as…

Risk Management · Quantitative Finance 2012-05-08 G. Bormetti , V. Cazzola , G. Livan , G. Montagna , O. Nicrosini

We propose generalized additive partial linear models for complex data which allow one to capture nonlinear patterns of some covariates, in the presence of linear components. The proposed method improves estimation efficiency and increases…

Statistics Theory · Mathematics 2014-05-26 Li Wang , Lan Xue , Annie Qu , Hua Liang