English
Related papers

Related papers: Local Projection Inference is Simpler and More Rob…

200 papers

We propose a novel semi-supervised structured output prediction method based on local linear regression in this paper. The existing semi-supervise structured output prediction methods learn a global predictor for all the data points in a…

Machine Learning · Computer Science 2016-08-17 Ru-Ze Liang , Wei Xie , Weizhi Li , Xin Du , Jim Jing-Yan Wang , Jingbin Wang

Machine learning models with both good predictability and high interpretability are crucial for decision support systems. Linear regression is one of the most interpretable prediction models. However, the linearity in a simple linear…

Machine Learning · Statistics 2022-04-29 Lkhagvadorj Munkhdalai , Tsendsuren Munkhdalai , Keun Ho Ryu

Crucial for building trust in deep learning models for critical real-world applications is efficient and theoretically sound uncertainty quantification, a task that continues to be challenging. Useful uncertainty information is expected to…

Machine Learning · Computer Science 2021-10-28 Zhen Lin , Shubhendu Trivedi , Jimeng Sun

Local robustness ensures that a model classifies all inputs within an $\ell_2$-ball consistently, which precludes various forms of adversarial inputs. In this paper, we present a fast procedure for checking local robustness in feed-forward…

Machine Learning · Computer Science 2021-02-19 Aymeric Fromherz , Klas Leino , Matt Fredrikson , Bryan Parno , Corina Păsăreanu

Fitting linear regression models can be computationally very expensive in large-scale data analysis tasks if the sample size and the number of variables are very large. Random projections are extensively used as a dimension reduction tool…

Statistics Theory · Mathematics 2017-01-20 Gian-Andrea Thanei , Christina Heinze , Nicolai Meinshausen

We propose a novel framework for modeling time-varying persistence in economic time series, allowing for smoothly evolving heterogeneity in shock dynamics. We leverage localized regression techniques to flexibly identify changes in…

General Finance · Quantitative Finance 2025-06-06 Jozef Barunik , Lukas Vacha

We propose a new inference framework called localized conformal prediction. It generalizes the framework of conformal prediction by offering a single-test-sample adaptive construction that emphasizes a local region around this test sample,…

Statistics Theory · Mathematics 2022-03-02 Leying Guan

Regression models with both high-dimensional responses and covariates have attracted growing attention. Standard multivariate regression models become inadequate when the response variables depend not only on observed covariates but also on…

Methodology · Statistics 2026-05-01 Jing Ouyang , Chengyu Cui , Yunxiao Chen , Kean Ming Tan , Gongjun Xu

We present a generic algorithm for learning and approximate inference with an intuitive epistemic interpretation: iteratively focus on a subset of the model and resolve inconsistencies using the parameters under control. This framework,…

Artificial Intelligence · Computer Science 2026-04-21 Oliver E. Richardson , Mandana Samiei , Mehran Shakerinava , Joseph D. Viviano , Abdessamad El Kabid , Ali Parviz , Yoshua Bengio

Shape constraints yield flexible middle grounds between fully nonparametric and fully parametric approaches to modeling distributions of data. The specific assumption of log-concavity is motivated by applications across economics, survival…

Methodology · Statistics 2024-04-16 Robin Dunn , Aditya Gangrade , Larry Wasserman , Aaditya Ramdas

Motivated by a variety of applications, high-dimensional time series have become an active topic of research. In particular, several methods and finite-sample theories for individual stable autoregressive processes with known lag have…

Statistics Theory · Mathematics 2023-03-06 Somnath Chakraborty , Johannes Lederer , Rainer von Sachs

Fr\'echet regression extends the principles of linear regression to accommodate responses valued in generic metric spaces. While this approach has primarily focused on exploring relationships between Euclidean predictors and non-Euclidean…

Statistics Theory · Mathematics 2026-02-25 Chang Jun Im , Jeong Min Jeon

We consider the on-line predictive version of the standard problem of linear regression; the goal is to predict each consecutive response given the corresponding explanatory variables and all the previous observations. We are mainly…

Statistics Theory · Mathematics 2011-11-22 Vladimir Vovk , Ilia Nouretdinov , Alex Gammerman

We consider statistical inference for impulse responses in sparse, structural high-dimensional vector autoregressive (SVAR) systems. We introduce consistent estimators of impulse responses in the high-dimensional setting and suggest valid…

Methodology · Statistics 2021-06-03 Jonas Krampe , Efstathios Paparoditis , Carsten Trenkler

Local regression is widely used to explore spatial heterogeneity, but anisotropic or effectively low-dimensional neighborhoods can produce ill-conditioned local solves, causing coefficient variation driven by numerical artifacts rather than…

Methodology · Statistics 2026-03-31 Yuichiro Otani

In longitudinal study, it is common that response and covariate are not measured at the same time, which complicates the analysis to a large extent. In this paper, we take into account the estimation of generalized varying coefficient model…

Methodology · Statistics 2022-06-10 Rou Zhong , Chunming Zhang , Jingxiao Zhang

We present an extension of local sensitivity analysis, also referred to as the perturbation approach for uncertainty quantification, to Bayesian inverse problems. More precisely, we show how moments of random variables with respect to the…

Numerical Analysis · Mathematics 2026-04-06 Jürgen Dölz , David Ebert

In modeling multivariate time series, it is important to allow time-varying smoothness in the mean and covariance process. In particular, there may be certain time intervals exhibiting rapid changes and others in which changes are slow. If…

Applications · Statistics 2014-06-02 Daniele Durante , Bruno Scarpa , David B. Dunson

Reliable uncertainty quantification at unobserved spatial locations, especially in the presence of complex and heterogeneous datasets, remains a core challenge in spatial statistics. Traditional approaches like Kriging rely heavily on…

Machine Learning · Statistics 2025-02-18 Hanyang Jiang , Yao Xie

Shape-constrained inference has wide applicability in bioassay, medicine, economics, risk assessment, and many other fields. Although there has been a large amount of work on monotone-constrained univariate curve estimation, multivariate…

Methodology · Statistics 2019-11-19 Lizhen Lin , Brian St. Thomas , Walter W. Piegorsch , James Scott , Carlos Carvalho