English
Related papers

Related papers: On-line predictive linear regression

200 papers

We consider the on-line predictive version of the standard problem of linear regression; the goal is to predict each consecutive response given the corresponding explanatory variables and all the previous observations. The standard…

Statistics Theory · Mathematics 2009-06-18 Vladimir Vovk , Ilia Nouretdinov , Alex Gammerman

In online interval scheduling, the input is an online sequence of intervals, and the goal is to accept a maximum number of non-overlapping intervals. In the more general disjoint path allocation problem, the input is a sequence of requests,…

Data Structures and Algorithms · Computer Science 2025-01-24 Joan Boyar , Lene M. Favrholdt , Shahin Kamali , Kim S. Larsen

For the last two decades, high-dimensional data and methods have proliferated throughout the literature. Yet, the classical technique of linear regression has not lost its usefulness in applications. In fact, many high-dimensional…

Statistics Theory · Mathematics 2021-05-18 Arun Kumar Kuchibhotla , Lawrence D. Brown , Andreas Buja , Edward I. George , Linda Zhao

Linear regression is a fundamental and popular statistical method. There are various kinds of linear regression, such as mean regression and quantile regression. In this paper, we propose a new one called distribution regression, which…

Methodology · Statistics 2017-12-27 Xin Chen , Xuejun Ma , Wang Zhou

Over the last few decades, various methods have been proposed for estimating prediction intervals in regression settings, including Bayesian methods, ensemble methods, direct interval estimation methods and conformal prediction methods. An…

Machine Learning · Statistics 2024-04-02 Nicolas Dewolf , Bernard De Baets , Willem Waegeman

The machine learning literature contains several constructions for prediction intervals that are intuitively reasonable but ultimately ad-hoc in that they do not come with provable performance guarantees. We present methods from the…

Machine Learning · Statistics 2020-02-25 Danijel Kivaranovic , Kory D. Johnson , Hannes Leeb

We reexamine the classical linear regression model when the model is subject to two types of uncertainty: (i) some of covariates are either missing or completely inaccessible, and (ii) the variance of the measurement error is undetermined…

Statistics Theory · Mathematics 2021-08-05 Shuzhen Yang , Jianfeng Yao

We consider the problem of on-line prediction of real-valued labels, assumed bounded in absolute value by a known constant, of new objects from known labeled objects. The prediction algorithm's performance is measured by the squared…

Machine Learning · Computer Science 2007-05-23 Vladimir Vovk

Linear regression is arguably the most prominent among statistical inference methods, popular both for its simplicity as well as its broad applicability. On par with data-intensive applications, the sheer size of linear regression problems…

Applications · Statistics 2016-06-29 Dimitris Berberidis , Vassilis Kekatos , Georgios B. Giannakis

As neural networks become more popular, the need for accompanying uncertainty estimates increases. There are currently two main approaches to test the quality of these estimates. Most methods output a density. They can be compared by…

Machine Learning · Statistics 2024-06-05 Laurens Sluijterman , Eric Cator , Tom Heskes

We study online interval scheduling in the irrevocable setting, where each interval must be immediately accepted or rejected upon arrival. The objective is to maximize the total length of accepted intervals while ensuring that no two…

Machine Learning · Computer Science 2025-11-21 Antonios Antoniadis , Ali Shahheidar , Golnoosh Shahkarami , Abolfazl Soltani

A prediction interval covers a future observation from a random process in repeated sampling, and is typically constructed by identifying a pivotal quantity that is also an ancillary statistic. Analogously, a tolerance interval covers a…

Methodology · Statistics 2022-01-19 Geoffrey S Johnson

We consider the problem of online active learning to collect data for regression modeling. Specifically, we consider a decision maker with a limited experimentation budget who must efficiently learn an underlying linear population model.…

Machine Learning · Statistics 2016-12-22 Carlos Riquelme , Ramesh Johari , Baosen Zhang

Regression models are essential for a wide range of real-world applications. However, in practice, target values are not always precisely known; instead, they may be represented as intervals of acceptable values. This challenge has led to…

Machine Learning · Computer Science 2025-12-08 Tung L Nguyen , Toby Dylan Hocking

Nonlinear expectation, including sublinear expectation as its special case, is a new and original framework of probability theory and has potential applications in some scientific fields, especially in finance risk measure and management.…

Statistics Theory · Mathematics 2013-04-15 Lu Lin , Yufeng Shi , Xin Wang , Shuzhen Yang

Understanding model performance on unlabeled data is a fundamental challenge of developing, deploying, and maintaining AI systems. Model performance is typically evaluated using test sets or periodic manual quality assessments, both of…

Machine Learning · Computer Science 2020-12-17 Benjamin Elder , Matthew Arnold , Anupama Murthi , Jiri Navratil

We present methods for online linear optimization that take advantage of benign (as opposed to worst-case) sequences. Specifically if the sequence encountered by the learner is described well by a known "predictable process", the algorithms…

Machine Learning · Statistics 2014-05-27 Alexander Rakhlin , Karthik Sridharan

We study prediction intervals based on leave-one-out residuals in a linear regression model where the number of explanatory variables can be large compared to sample size. We establish uniform asymptotic validity (conditional on the…

Statistics Theory · Mathematics 2016-02-19 Lukas Steinberger , Hannes Leeb

Regression is typically treated as a curve-fitting process where the goal is to fit a prediction function to data. With the help of conditional generative adversarial networks, we propose to solve this age-old problem in a different way; we…

Machine Learning · Computer Science 2024-04-23 Deddy Jobson , Eddy Hudson

Symbolic regression is a nonlinear regression method which is commonly performed by an evolutionary computation method such as genetic programming. Quantification of uncertainty of regression models is important for the interpretation of…

Machine Learning · Computer Science 2022-09-15 Fabricio Olivetti de Franca , Gabriel Kronberger
‹ Prev 1 2 3 10 Next ›