English
Related papers

Related papers: Fundamentals of Regression

200 papers

Regression plays a key role in many research areas and its variable selection is a classic and major problem. This study emphasizes cost of predictors to be purchased for future use, when we select a subset of them. Its economic aspect is…

Methodology · Statistics 2021-03-19 Steven N. MacEachern , Koji Miyawaki

Identifying the relevant coarse-grained degrees of freedom in a complex physical system is a key stage in developing powerful effective theories in and out of equilibrium. The celebrated renormalization group provides a framework for this…

Statistical Mechanics · Physics 2024-11-27 Doruk Efe Gökmen , Zohar Ringel , Sebastian D. Huber , Maciej Koch-Janusz

In this paper we present a discussion of the basic aspects of the well-known problem of prediction and inference in physics, with specific attention to the role of models, the use of data and the application of recent developments in…

General Physics · Physics 2024-10-07 Luca Gammaitoni , Angelo Vulpiani

Function regression/approximation is a fundamental application of machine learning. Neural networks (NNs) can be easily trained for function regression using a sufficient number of neurons and epochs. The forward-forward learning algorithm…

Machine Learning · Computer Science 2025-10-16 Shivam Padmani , Akshay Joshi

Linear regression is perhaps one of the most popular statistical concepts, which permeates almost every scientific field of study. Due to the technical simplicity and wide applicability of linear regression, attention is almost always…

Statistics Theory · Mathematics 2020-10-09 Yu-Lin Chou

Software developed using modern agile practices delivers a stream of software versions that require continuous regression testing rather than testing once close to the delivery or maintenance phase, as assumed by classical…

Software Engineering · Computer Science 2025-11-05 Suddhasvatta Das , Kevin Gary

Machine learning is the science of discovering statistical dependencies in data, and the use of those dependencies to perform predictions. During the last decade, machine learning has made spectacular progress, surpassing human performance…

Machine Learning · Statistics 2016-07-13 David Lopez-Paz

Consider a regression or some regression-type model for a certain response variable where the linear predictor includes an ordered factor among the explanatory variables. The inclusion of a factor of this type can take place is a few…

Methodology · Statistics 2023-11-27 Adelchi Azzalini

Often we wish to predict a large number of variables that depend on each other as well as on other observed variables. Structured prediction methods are essentially a combination of classification and graphical modeling, combining the…

Machine Learning · Statistics 2010-11-19 Charles Sutton , Andrew McCallum

In this review, we present some fundamental classical and quantum phenomena in view of time fractional formalism. Time fractional formalism is a very useful tool in describing systems with memory and delay. We hope that this study can…

General Physics · Physics 2012-03-27 Hosein Nasrolahpour

This text presents an unified approach of probability and statistics in the pursuit of understanding and computation of randomness in engineering or physical or social system with prediction with generalizability. Starting from elementary…

History and Overview · Mathematics 2024-01-19 Lakshman Mahto

Regression methods dominate the practice of biostatistical analysis, but biostatistical training emphasises the details of regression models and methods ahead of the purposes for which such modelling might be useful. More broadly,…

Methodology · Statistics 2024-09-12 John B. Carlin , Margarita Moreno-Betancur

Classical functional linear regression models the relationship between a scalar response and a functional covariate, where the coefficient function is assumed to be identical for all subjects. In this paper, the classical model is extended…

Methodology · Statistics 2022-11-29 Yifan Sun , Ziyi Liu , Wu Wang

Regression analysis is a well known quantitative research method that primarily explores the relationship between one or more independent variables and a dependent variable. Conducting regression analysis manually on large datasets with…

Machine Learning · Computer Science 2022-05-17 Ayon Roy , Tausif Al Zubayer , Nafisa Tabassum , Muhammad Nazrul Islam , Md. Abdus Sattar

In the emerging era of big data, larger available clinical datasets and computational advances have sparked a massive interest in machine learning-based approaches. The number of manuscripts related to machine learning or artificial…

Machine Learning · Statistics 2020-06-29 Julius M. Kernbach , Victor E. Staartjes

We present a continuous formulation of machine learning, as a problem in the calculus of variations and differential-integral equations, in the spirit of classical numerical analysis. We demonstrate that conventional machine learning models…

Numerical Analysis · Mathematics 2020-10-02 Weinan E , Chao Ma , Lei Wu

Machine learning is rapidly making its path into natural sciences, including high-energy physics. We present the first study that infers, directly from experimental data, a functional form of fragmentation functions. The latter represent a…

High Energy Physics - Phenomenology · Physics 2025-01-14 Nour Makke , Sanjay Chawla

Quantitative social science is not only about regression analysis or, in general, data inference. Computer simulations of social mechanisms have a 60-year long history. They have been used for many different purposes -- to test scenarios,…

Physics and Society · Physics 2021-10-01 Petter Holme , Fredrik Liljeros

Symbolic regression automates the process of learning closed-form mathematical models from data. Standard approaches to symbolic regression, as well as newer deep learning approaches, rely on heuristic model selection criteria, heuristic…

Machine Learning · Statistics 2025-07-29 Roger Guimera , Marta Sales-Pardo

Although regression analysis has a great history, we consider that it has always continued being confused. For example, the fundamental terms in regression analysis (e.g., "regression", "least-squares method", "explanatory variable",…

Statistics Theory · Mathematics 2014-03-04 Shiro Ishikawa