English
Related papers

Related papers: Model Selection in High-Dimensional Linear Regress…

200 papers

This paper proposes a new method for estimating high-dimensional binary choice models. We consider a semiparametric model that places no distributional assumptions on the error term, allows for heteroskedastic errors, and permits endogenous…

Econometrics · Economics 2025-07-15 Fu Ouyang , Thomas Tao Yang

A popular technique for selecting and tuning machine learning estimators is cross-validation. Cross-validation evaluates overall model fit, usually in terms of predictive accuracy. In causal inference, the optimal choice of estimator…

Methodology · Statistics 2021-07-07 Dominik Rothenhäusler

This paper presents a machine learning approach to multidimensional item response theory (MIRT), a class of latent factor models that can be used to model and predict student performance from observed assessment data. Inspired by…

Machine Learning · Statistics 2025-01-08 Yoav Bergner , Peter F. Halpin , Jill-Jênn Vie

High-dimensional tests are applied to find relevant sets of variables and relevant models. If variables are selected by analyzing the sums of products matrices and a corresponding mean-value test is performed, there is the danger that the…

Methodology · Statistics 2012-02-10 Juergen Laeuter , Maciej Rosolowski , Ekkehard Glimm

This paper proposes a simple, novel, and fully-Bayesian approach for causal inference in partially linear models with high-dimensional control variables. Off-the-shelf machine learning methods can introduce biases in the causal parameter…

Econometrics · Economics 2025-08-19 Francis J. DiTraglia , Laura Liu

The theory of boosting provides a computational framework for aggregating approximate weak learning algorithms, which perform marginally better than a random predictor, into an accurate strong learner. In the realizable case, the success of…

Machine Learning · Computer Science 2024-11-01 Udaya Ghai , Karan Singh

Gradient Boosting (GB) is a popular methodology used to solve prediction problems by minimizing a differentiable loss function, $L$. GB performs very well on tabular machine learning (ML) problems; however, as a pure ML solver it lacks the…

Machine Learning · Computer Science 2022-11-08 Michael T. Horrell

Machine learning (ML) has been widely applied in high energy physics to help the physical community in particle classification and data analysis. Here we describe the application of machine learning to solve the problem of classifying…

Instrumentation and Detectors · Physics 2020-09-03 Alexey Grobov , Aidar Ilyasov

While model selection is a well-studied topic in parametric and nonparametric regression or density estimation, selection of possibly high-dimensional nuisance parameters in semiparametric problems is far less developed. In this paper, we…

Methodology · Statistics 2023-09-06 Yifan Cui , Eric Tchetgen Tchetgen

The scaling of Large Multimodal Models (LMMs) is constrained by the quality-quantity trade-off inherent in synthetic data. Previous approaches, such as LLM-as-a-Judge, have proven their effectiveness in addressing this but suffer from…

Artificial Intelligence · Computer Science 2026-05-11 Jinhao Jing , Qiannian Zhao , Chao Huang , Zhan Su

The boom of DL technology leads to massive DL models built and shared, which facilitates the acquisition and reuse of DL models. For a given task, we encounter multiple DL models available with the same functionality, which are considered…

Software Engineering · Computer Science 2021-03-10 Linghan Meng , Yanhui Li , Lin Chen , Zhi Wang , Di Wu , Yuming Zhou , Baowen Xu

Capturing complex dependence structures between outcome variables (e.g., study endpoints) is of high relevance in contemporary biomedical data problems and medical research. Distributional copula regression provides a flexible tool to model…

Methodology · Statistics 2022-02-28 Nicolai Hans , Nadja Klein , Florian Faschingbauer , Michael Schneider , Andreas Mayr

The effectiveness of Multimodal Chain-of-Thought (MCoT) prompting is often limited by the use of randomly or manually selected examples. These examples fail to account for both model-specific knowledge distributions and the intrinsic…

Computation and Language · Computer Science 2025-10-14 Xinglong Yang , Quan Feng , Zhongying Pan , Xiang Chen , Yu Tian , Wentong Li , Shuofei Qiao , Yuxia Geng , Xingyu Zhao , Sheng-Jun Huang

We investigate boosted online regression and propose a novel family of regression algorithms with strong theoretical bounds. In addition, we implement several variants of the proposed generic algorithm. We specifically provide theoretical…

Statistics Theory · Mathematics 2016-12-07 Dariush Kari , Farhan Khan , Selami Ciftci , Suleyman Serdar Kozat

Gradient Boosted Decision Trees (GBDT) is a very successful ensemble learning algorithm widely used across a variety of applications. Recently, several variants of GBDT training algorithms and implementations have been designed and heavily…

Machine Learning · Computer Science 2019-06-27 Yu Shi , Jian Li , Zhize Li

Large language models (LLMs) have recently been employed as agents to solve sequential decision-making tasks such as Bayesian optimization and multi-armed bandits (MAB). These works usually adopt an LLM for sequential action selection by…

Machine Learning · Computer Science 2025-02-04 Mingze Kong , Zhiyong Wang , Yao Shu , Zhongxiang Dai

The statistical regression technique is an extraordinarily essential data fitting tool to explore the potential possible generation mechanism of the random phenomenon. Therefore, the model selection or the variable selection is becoming…

Methodology · Statistics 2020-03-25 Yue Su , Patrick Kandege Mwanakatwe

We focus on the high-dimensional linear regression problem, where the algorithmic goal is to efficiently infer an unknown feature vector $\beta^*\in\mathbb{R}^p$ from its linear measurements, using a small number $n$ of samples. Unlike most…

Statistics Theory · Mathematics 2023-09-19 David Gamarnik , Eren C. Kızıldağ , Ilias Zadik

Conventional demographic inference methods have predominantly operated under the supervision of accurately labeled data, yet struggle to adapt to shifting social landscapes and diverse cultural contexts, leading to narrow specialization and…

Computer Vision and Pattern Recognition · Computer Science 2024-05-27 Yongsheng Yu , Jiebo Luo

Many real-world problems involve massive amounts of data. Under these circumstances learning algorithms often become prohibitively expensive, making scalability a pressing issue to be addressed. A common approach is to perform sampling to…

Machine Learning · Computer Science 2015-08-10 Uday Kamath , Carlotta Domeniconi , Kenneth De Jong