English
Related papers

Related papers: Estimation Beyond Data Reweighting: Kernel Method …

200 papers

A companion paper develops a framework in which probability measures are represented by distribution-kernel pairs (T,phi) with T a tempered distribution and phi a Schwartz kernel, so that weak moments of all orders exist unconditionally.…

Methodology · Statistics 2026-04-28 R. Labouriau

In this paper, we consider the estimation of regression coefficients and signal-to-noise (SNR) ratio in high-dimensional Generalized Linear Models (GLMs), and explore their implications in inferring popular estimands such as average…

Statistics Theory · Mathematics 2025-05-07 Xingyu Chen , Lin Liu , Rajarshi Mukherjee

Latent class model (LCM), which is a finite mixture of different categorical distributions, is one of the most widely used models in statistics and machine learning fields. Because of its non-continuous nature and the flexibility in shape,…

Machine Learning · Statistics 2021-03-23 Hao Chen , Lanshan Han , Alvin Lim

Descriptive statistics for parametric models are currently highly sensative to departures, gross errors, and/or random errors. Here, leveraging the structures of parametric distributions and their central moment kernel distributions, a…

Statistics Theory · Mathematics 2024-09-11 Li Tuobang

The exponential growth in data sizes and storage costs has brought considerable challenges to the data science community, requiring solutions to run learning methods on such data. While machine learning has scaled to achieve predictive…

Methodology · Statistics 2024-09-10 Lionel Voirol , Haotian Xu , Yuming Zhang , Luca Insolia , Roberto Molinari , Stéphane Guerrier

The restricted mean survival time (RMST) difference offers an interpretable causal contrast to estimate the treatment effect for time-to-event outcomes, yet a wide range of available estimators leaves limited guidance for practice. We…

Methodology · Statistics 2026-03-02 Charlotte Voinot , Clément Berenfeld , Imke Mayer , Bernard Sebastien , Julie Josse

We provide an approach for learning deep neural net representations of models described via conditional moment restrictions. Conditional moment restrictions are widely used, as they are the language by which social scientists describe the…

Econometrics · Economics 2018-04-25 Greg Lewis , Vasilis Syrgkanis

We investigate a simple objective for nonlinear instrumental variable (IV) regression based on a kernelized conditional moment restriction (CMR) known as a maximum moment restriction (MMR). The MMR objective is formulated by maximizing the…

Machine Learning · Computer Science 2023-02-10 Rui Zhang , Masaaki Imaizumi , Bernhard Schölkopf , Krikamol Muandet

Longitudinal studies frequently incorporate covariates that evolve over time, creating complex dependence structures between outcomes and predictors. When covariates are time dependent, standard power analysis tools--largely developed for…

Methodology · Statistics 2026-05-29 Niloofar Ramezani , Oliver Hurst

We propose a semi-partitioned Generalized Method of Moments (GMM) framework for analyzing longitudinal data with time-dependent covariates, within a marginal modeling paradigm. This approach addresses limitations of both aggregated and…

Methodology · Statistics 2026-03-04 Niloofar Ramezani , Jeffrey R. Wilson

Measurement error in count data is common but underexplored in the literature, particularly in contexts where observed scores are bounded and arise from discrete scoring processes. Motivated by applications in oral reading fluency…

Methodology · Statistics 2025-06-26 Yuqiu Yang , Christina Vu , Cornelis J. Potgieter , Xinlei Wang , Akihito Kamata

Method of moment estimators exhibit appealing statistical properties, such as asymptotic unbiasedness, for nonconvex problems. However, they typically require a large number of samples and are extremely sensitive to model misspecification.…

Computation · Statistics 2016-03-30 Dustin Tran , Minjae Kim , Finale Doshi-Velez

Mixture models are a fundamental tool in applied statistics and machine learning for treating data taken from multiple subpopulations. The current practice for estimating the parameters of such models relies on local search heuristics…

Machine Learning · Computer Science 2012-09-07 Animashree Anandkumar , Daniel Hsu , Sham M. Kakade

Generalized linear models (GLMs) are fundamental tools for statistical modeling, with maximum likelihood estimation (MLE) serving as the classical approach for parameter inference. While MLE performs well for canonical GLMs, it can become…

Methodology · Statistics 2026-03-03 Linglingzhi Zhu , Jonghyeok Lee , Yao Xie

Kernel techniques are among the most popular and flexible approaches in data science allowing to represent probability measures without loss of information under mild conditions. The resulting mapping called mean embedding gives rise to a…

Machine Learning · Statistics 2024-11-27 Linda Chamakh , Zoltan Szabo

This paper explores the effects of simulated moments on the performance of inference methods based on moment inequalities. Commonly used confidence sets for parameters are level sets of criterion functions whose boundary points may depend…

Econometrics · Economics 2018-04-12 Hiroaki Kaido , Jiaxuan Li , Marc Rysman

The Generalized Method of Moments (GMM) is a partition of unity based technique for solving electromagnetic and acoustic boundary integral equations. Past work on the GMM for electromagnetics was confined to geometries modeled by piecewise…

Computational Physics · Physics 2015-06-18 Daniel Dault , Naveen V. Nair , Jie Li , Balasubramaniam Shanker

The Method of Moments [Pea94] is one of the most widely used methods in statistics for parameter estimation, by means of solving the system of equations that match the population and estimated moments. However, in practice and especially…

Statistics Theory · Mathematics 2019-04-16 Yihong Wu , Pengkun Yang

This paper proposes a linear categorical random coefficient model, in which the random coefficients follow parametric categorical distributions. The distributional parameters are identified based on a linear recurrence structure of moments…

Econometrics · Economics 2023-03-01 Zhan Gao , M. Hashem Pesaran

We introduce a new set of consistent measures of risks, in terms of the semi-invariants of pdf's, such that the centered moments and the cumulants of the portfolio distribution of returns that put more emphasis on the tail the…

Statistical Mechanics · Physics 2008-12-10 Y. Malevergne , D. Sornette