English
Related papers

Related papers: When regression coefficients change over time: A p…

200 papers

Quantile regression provides a framework for modeling statistical quantities of interest other than the conditional mean. The regression methodology is well developed for linear models, but less so for nonparametric models. We consider…

Statistics Theory · Mathematics 2009-09-29 Mi-Ok Kim

Tree-based ensemble methods, as Random Forests and Gradient Boosted Trees, have been successfully used for regression in many applications and research studies. Furthermore, these methods have been extended in order to deal with uncertainty…

Machine Learning · Computer Science 2018-11-20 Myriam Tami , Marianne Clausel , Emilie Devijver , Adrien Dulac , Eric Gaussier , Stefan Janaqi , Meriam Chebre

It can be difficult to interpret a coefficient of an uncertain model. A slope coefficient of a regression model may change as covariates are added or removed from the model. In the context of high-dimensional data, there are too many model…

Methodology · Statistics 2024-08-20 Brian Knaeble , R. Mitchell Hughes , George Rudolph , Mark A. Abramson , Daniel Razo

We study linear regressions in a context where the outcome of interest and some of the covariates are observed in two different datasets that cannot be matched. Traditional approaches obtain point identification by relying, often…

Econometrics · Economics 2025-11-18 Xavier D'Haultfoeuille , Christophe Gaillac , Arnaud Maurel

Linear regression is a data analysis technique, which is categorized as supervised learning. By utilizing known data, we can predict unknown data. Recently, researchers have explored the use of quantum annealing (QA) to perform linear…

Quantum Physics · Physics 2024-10-14 Asuka Koura , Takashi Imoto , Katsuki Ura , Yuichiro Matsuzaki

Spatial models are used in a variety research areas, such as environmental sciences, epidemiology, or physics. A common phenomenon in many spatial regression models is spatial confounding. This phenomenon takes place when spatially indexed…

Methodology · Statistics 2021-06-08 Isa Marques , Thomas Kneib , Nadja Klein

Scholars frequently use covariate balance tests to test the validity of natural experiments and related designs. Unfortunately, when measured covariates are unrelated to potential outcomes, balance is uninformative about key identification…

Methodology · Statistics 2025-10-15 Clara Bicalho , Adam Bouyamourn , Thad Dunning

Performance estimation aims at estimating the loss that a predictive model will incur on unseen data. These procedures are part of the pipeline in every machine learning project and are used for assessing the overall generalisation ability…

Machine Learning · Computer Science 2021-08-31 Vitor Cerqueira , Luis Torgo , Igor Mozetic

The large majority of inferences drawn in empirical political research follow from model-based associations (e.g. regression). Here, we articulate the benefits of predictive modeling as a complement to this approach. Predictive models aim…

Methodology · Statistics 2016-12-20 Skyler J. Cranmer , Bruce A. Desmarais

In the prediction of oscillating time series, the interest is in the turning points of successive oscillations rather than the samples themselves. For this purpose a scheme has been proposed; the state space reconstruction is limited to the…

Chaotic Dynamics · Physics 2008-09-15 D. Kugiumtzis , I. Vlachos

In a variety of business situations, the introduction or improvement of machine learning approaches is impaired as these cannot draw on existing analytical models. However, in many cases similar problems may have already been solved…

Machine Learning · Computer Science 2020-05-22 Robin Hirt , Niklas Kühl , Yusuf Peker , Gerhard Satzger

While there have been a lot of recent developments in the context of Bayesian model selection and variable selection for high dimensional linear models, there is not much work in the presence of change point in literature, unlike the…

Methodology · Statistics 2021-02-26 Nilabja Guha , Jyotishka Datta

Regression for spatially dependent outcomes poses many challenges, for inference and for computation. Non-spatial models and traditional spatial mixed-effects models each have their advantages and disadvantages, making it difficult for…

Methodology · Statistics 2017-08-02 John Hughes

The most widely used method for finding relationships between several quantities is multiple regression. This however is restricted to a single dependent variable. We present a more general method which allows models to be constructed with…

Statistics Theory · Mathematics 2011-09-06 Chris Tofallis

Regression models with both high-dimensional responses and covariates have attracted growing attention. Standard multivariate regression models become inadequate when the response variables depend not only on observed covariates but also on…

Methodology · Statistics 2026-05-01 Jing Ouyang , Chengyu Cui , Yunxiao Chen , Kean Ming Tan , Gongjun Xu

Sparse and irregularly sampled multivariate time series are common in clinical, climate, financial and many other domains. Most recent approaches focus on classification, regression or forecasting tasks on such data. In forecasting, it is…

Machine Learning · Computer Science 2020-04-08 Shivam Srivastava , Prithviraj Sen , Berthold Reinwald

Empirical modelling often aims for the simplest model consistent with the data. A new technique is presented which quantifies the consistency of the model dynamics as a function of location in state space. As is well-known, traditional…

Chaotic Dynamics · Physics 2009-11-10 Patrick E. McSharry , Leonard A. Smith

Concerning bivariate least squares linear regression, the classical results obtained for extreme structural models in earlier attempts are reviewed using a new formalism in terms of deviation (matrix) traces which, for homoscedastic data,…

Instrumentation and Methods for Astrophysics · Physics 2017-11-17 R. Caimmi

Overfitting, which happens when the number of parameters in a model is too large compared to the number of data points available for determining these parameters, is a serious and growing problem in survival analysis. While modern medicine…

Applications · Statistics 2017-09-13 ACC Coolen , JE Barrett , P Paga , CJ Perez-Vicente

When machine learning systems meet real world applications, accuracy is only one of several requirements. In this paper, we assay a complementary perspective originating from the increasing availability of pre-trained and regularly…