English
Related papers

Related papers: Inference with non-differentiable surrogate loss i…

200 papers

The debiased estimator is a crucial tool in statistical inference for high-dimensional model parameters. However, constructing such an estimator involves estimating the high-dimensional inverse Hessian matrix, incurring significant…

Machine Learning · Statistics 2023-12-18 Jiyuan Tu , Weidong Liu , Xiaojun Mao , Mingyue Xu

This paper investigates lung nodule classification by using deep neural networks (DNNs). Hyperparameter optimization in DNNs is a computationally expensive problem, where evaluating a hyperparameter configuration may take several hours or…

Machine Learning · Computer Science 2019-01-03 Miao Zhang , Huiqi Li , Juan Lyu , Sai Ho Ling , Steven Su

Modern AI agents such as large language models are trained on diverse tasks -- translation, code generation, mathematical reasoning, and text prediction -- simultaneously. A key question is how to quantify the influence of each individual…

Machine Learning · Computer Science 2026-05-12 Zhenshuo Zhang , Minxuan Duan , Hongyang R. Zhang

For temporal regularly spaced datasets, a lot of methods are available and the properties of these methods are extensively investigated. Less research has been performed on irregular temporal datasets subject to measurement error with…

Methodology · Statistics 2018-03-15 Haiyan Liu , Jeanine Houwing-Duistermaat

We propose Nodewise Loreg, a nodewise $L_0$-penalized regression method for estimating high-dimensional sparse precision matrices. We establish its asymptotic properties, including convergence rates, support recovery, and asymptotic…

Statistics Theory · Mathematics 2024-06-11 Hai Shu , Ziqi Chen , Yingjie Zhang , Hongtu Zhu

In the continual effort to improve product quality and decrease operations costs, computational modeling is increasingly being deployed to determine feasibility of product designs or configurations. Surrogate modeling of these computer…

Machine Learning · Statistics 2021-11-10 Nathan Wycoff , Mickaël Binois , Robert B. Gramacy

Surrogate models provide a quick-to-evaluate approximation to complex computational models and are essential for multi-query problems like design optimisation. The inputs of current deterministic computational models are usually…

Applications · Statistics 2024-10-15 Thomas A. Archbold , Ieva Kazlauskaite , Fehmi Cirak

Conformal prediction is a simple and powerful tool that can quantify uncertainty without any distributional assumptions. Many existing methods only address the average coverage guarantee, which is not ideal compared to the stronger…

Machine Learning · Statistics 2023-02-21 Xing Han , Ziyang Tang , Joydeep Ghosh , Qiang Liu

We propose a generalized partially linear functional single index risk score model for repeatedly measured outcomes where the index itself is a function of time. We fuse the nonparametric kernel method and regression spline method, and…

Statistics Theory · Mathematics 2015-10-15 Fei Jiang , Yanyuan Ma , Yuanjia Wang

This work proposes a data-driven surrogate modeling framework for cost-effectively inferring the torque of a permanent magnet synchronous machine under geometric design variations. The framework is separated into a reduced-order modeling…

Computational Engineering, Finance, and Science · Computer Science 2025-03-13 Aylar Partovizadeh , Sebastian Schöps , Dimitrios Loukrezis

We develop semiparametrically efficient inference for kernel measures of noise heterogeneity in additive noise models. In many applications, the regression function is estimated using flexible machine learning methods. Downstream procedures…

Machine Learning · Statistics 2026-05-28 Jakub Wornbard , Zikai Shen , Dimitri Meunier , Arthur Gretton

We present a novel statistical inference framework for convex empirical risk minimization, using approximate stochastic Newton steps. The proposed algorithm is based on the notion of finite differences and allows the approximation of a…

Machine Learning · Computer Science 2019-02-06 Tianyang Li , Anastasios Kyrillidis , Liu Liu , Constantine Caramanis

Non-parametric inference for functional data over two-dimensional domains entails additional computational and statistical challenges, compared to the one-dimensional case. Separability of the covariance is commonly assumed to address these…

Methodology · Statistics 2021-03-19 Tomas Masak , Tomas Rubin , Victor Panaretos

In this paper, we propose a covariate-adjusted nonlinear regression model. In this model, both the response and predictors can only be observed after being distorted by some multiplicative factors. Because of nonlinearity, existing methods…

Statistics Theory · Mathematics 2009-08-14 Xia Cui , Wensheng Guo , Lu Lin , Lixing Zhu

Causal inference is central to statistics and scientific discovery, enabling researchers to identify cause-and-effect relationships beyond associations. While traditionally studied within Euclidean spaces, contemporary applications…

Methodology · Statistics 2025-07-01 Satarupa Bhattacharjee , Bing Li , Xiao Wu , Lingzhou Xue

We study regression discontinuity designs in which many predetermined covariates, possibly much more than the number of observations, can be used to increase the precision of treatment effect estimates. We consider a two-step estimator…

Econometrics · Economics 2022-05-06 Alexander Kreiß , Christoph Rothe

Data integration methods aim to extract low-dimensional embeddings from high-dimensional outcomes to remove unwanted variations, such as batch effects and unmeasured covariates, across heterogeneous datasets. However, multiple hypothesis…

Methodology · Statistics 2025-12-15 Jin-Hong Du , Kathryn Roeder , Larry Wasserman

This paper presents an efficient variational inference framework for deriving a family of structured gaussian process regression network (SGPRN) models. The key idea is to incorporate auxiliary inducing variables in latent functions and…

Machine Learning · Computer Science 2021-11-19 Rui Meng , Herbie Lee , Kristofer Bouchard

We propose estimators based on kernel ridge regression for nonparametric causal functions such as dose, heterogeneous, and incremental response curves. Treatment and covariates may be discrete or continuous in general spaces. Due to a…

Econometrics · Economics 2022-10-25 Rahul Singh , Liyuan Xu , Arthur Gretton

We formalize and study the natural approach of designing convex surrogate loss functions via embeddings, for problems such as classification, ranking, or structured prediction. In this approach, one embeds each of the finitely many…

Machine Learning · Computer Science 2022-06-30 Jessie Finocchiaro , Rafael M. Frongillo , Bo Waggoner