English
Related papers

Related papers: Cheating with (Recursive) Models

200 papers

We propose new methods for multivariate linear regression when the regression coefficient matrix is sparse and the error covariance matrix is dense. We assume that the error covariance matrix has equicorrelation across the response…

Methodology · Statistics 2025-08-13 Daeyoung Ham , Bradley S. Price , Adam J. Rothman

We consider the problem of efficient statistical inference for comparing two regression curves estimated from two samples of dependent measurements. Based on a representation of the best pair of linear unbiased estimators in continuous time…

Methodology · Statistics 2016-01-29 Holger Dette , Kirsten Schorning , Maria Konstantinou

How does one find dimensions in multivariate data that are reliably expressed across repetitions? For example, in a brain imaging study one may want to identify combinations of neural signals that are reliably expressed across multiple…

Machine Learning · Statistics 2022-12-05 Lucas C. Parra , Stefan Haufe , Jacek P. Dmochowski

In this paper, we propose a covariate-adjusted nonlinear regression model. In this model, both the response and predictors can only be observed after being distorted by some multiplicative factors. Because of nonlinearity, existing methods…

Statistics Theory · Mathematics 2009-08-14 Xia Cui , Wensheng Guo , Lu Lin , Lixing Zhu

The paper introduces a new estimation method for the standard linear regression model. The procedure is not driven by the optimisation of any objective function rather, it is a simple weighted average of slopes from observation pairs. The…

Econometrics · Economics 2024-02-27 Felix Chan , Laszlo Matyas

In this paper, we propose a model averaging approach for addressing model uncertainty in the context of partial linear functional additive models. These models are designed to describe the relation between a response and mixed-types of…

Methodology · Statistics 2023-06-12 Shishi Liu , Jingxiao Zhang

Entity typing aims at predicting one or more words that describe the type(s) of a specific mention in a sentence. Due to shortcuts from surface patterns to annotated entity labels and biased training, existing entity typing models are…

Computation and Language · Computer Science 2022-10-27 Nan Xu , Fei Wang , Bangzheng Li , Mingtao Dong , Muhao Chen

Recent research has generated hope that inference scaling, such as resampling solutions until they pass verifiers like unit tests, could allow weaker models to match stronger ones. Beyond inference, this approach also enables training…

Machine Learning · Computer Science 2026-03-27 Benedikt Stroebl , Sayash Kapoor , Arvind Narayanan

The interpretation of coefficients from multivariate linear regression relies on the assumption that the conditional expectation function is linear in the variables. However, in many cases the underlying data generating process is…

Econometrics · Economics 2025-12-16 Nadav Kunievsky

Linear regression without correspondences concerns the recovery of a signal in the linear regression setting, where the correspondences between the observations and the linear functionals are unknown. The associated maximum likelihood…

Information Theory · Computer Science 2020-09-15 Liangzu Peng , Manolis C. Tsakiris

Kernel and linear regression have been recently explored in the prediction of graph signals as the output, given arbitrary input signals that are agnostic to the graph. In many real-world problems, the graph expands over time as new nodes…

Machine Learning · Computer Science 2019-11-27 Arun Venkitaraman , Saikat Chatterjee , Bo Wahlberg

We consider the problem of large-scale inference on the row or column variables of data in the form of a matrix. Often this data is transposable, meaning that both the row variables and column variables are of potential interest. An example…

Methodology · Statistics 2015-03-13 Genevera I. Allen , Robert Tibshirani

An appeal for symmetry is made to build established notions of specific representation and specific nonlinearity of measurement (often called model error) into a canonical linear regression model. Additive components are derived from the…

Applications · Statistics 2021-10-19 Richard E. Danielson

The statistical properties of estimator using covariance matrix for the account of point-to-point correlations due to systematic errors are analyzed. It is shown that the covariance matrix estimator (CME) is consistent for the realistic…

High Energy Physics - Experiment · Physics 2007-05-23 Alekhin Sergey

Estimating large covariance and precision matrices are fundamental in modern multivariate analysis. The problems arise from statistical analysis of large panel economics and finance data. The covariance matrix reveals marginal correlations…

Methodology · Statistics 2015-04-17 Jianqing Fan , Yuan Liao , Han Liu

For the last two decades, high-dimensional data and methods have proliferated throughout the literature. Yet, the classical technique of linear regression has not lost its usefulness in applications. In fact, many high-dimensional…

Statistics Theory · Mathematics 2021-05-18 Arun Kumar Kuchibhotla , Lawrence D. Brown , Andreas Buja , Edward I. George , Linda Zhao

Quantifying model uncertainty is critical for understanding prediction reliability, yet distinguishing between aleatoric and epistemic uncertainty remains challenging. We extend recent work from classification to regression to provide a…

In this paper we study the problem of making predictions using multiple structural casual models defined by different agents, under the constraint that the prediction satisfies the criterion of counterfactual fairness. Relying on the…

Artificial Intelligence · Computer Science 2021-05-25 Fabio Massimo Zennaro , Magdalena Ivanovska

Traditionally model averaging has been viewed as an alternative to model selection with the ultimate goal to incorporate the uncertainty associated with the model selection process in standard errors and confidence intervals by using a…

Methodology · Statistics 2021-03-05 Michael Schomaker , Christian Heumann

We introduce a recursive algorithm of conveniently general form for estimating the coefficient of a moving average model of order one and obtain convergence results for both correct and misspecified MA(1) models. The algorithm encompasses…

Statistics Theory · Mathematics 2007-06-13 James L. Cantor , David F. Findley