English
Related papers

Related papers: Hyperparameter Selection for Subsampling Bootstrap…

200 papers

In the field of big data analytics, the search for efficient subdata selection methods that enable robust statistical inferences with minimal computational resources is of high importance. A procedure prior to subdata selection could…

Methodology · Statistics 2024-11-12 Vasilis Chasiotis , Lin Wang , Dimitris Karlis

We investigate popular resampling methods for estimating the uncertainty of statistical models, such as subsampling, bootstrap and the jackknife, and their performance in high-dimensional supervised regression tasks. We provide a tight…

Hyper-parameter Tuning (HPT) is a necessary step in machine learning (ML) pipelines but becomes computationally expensive and opaque with larger models. Recently, Large Language Models (LLMs) have been explored for HPT, yet most rely on…

Machine Learning · Computer Science 2025-09-26 Om Naphade , Saksham Bansal , Parikshit Pareek

Instruction tuning is a vital step of training large language models (LLMs), so how to enhance the effect of instruction tuning has received increased attention. Existing works indicate that the quality of the dataset is more crucial than…

Computation and Language · Computer Science 2025-08-27 Bolin Zhang , Jiahao Wang , Qianlong Du , Jiajun Zhang , Zhiying Tu , Dianhui Chu

It is widely acknowledged that hyperparameter selection plays a critical role in the effectiveness of sparse optimization problems. The bilevel optimization provides a robust framework for addressing this issue, but these existing methods…

Optimization and Control · Mathematics 2026-03-11 Yunhai Xiao , Anqi Liu , Peili Li , Yanyun Ding

In this paper we develop a Bayesian optimization based hyperparameter tuning framework inspired by statistical learning theory for classifiers. We utilize two key facts from PAC learning theory; the generalization bound will be higher for a…

Machine Learning · Computer Science 2019-02-08 Tinu Theckel Joy , Santu Rana , Sunil Gupta , Svetha Venkatesh

For many tasks of data analysis, we may only have the information of the explanatory variable and the evaluation of the response values are quite expensive. While it is impractical or too costly to obtain the responses of all units, a…

Computation · Statistics 2023-04-07 Wei Zheng , Ting Tian , Xueqin Wang

The tuning of hyperparameters becomes increasingly important as machine learning (ML) models have been extensively applied in data mining applications. Among various approaches, Bayesian optimization (BO) is a successful methodology to tune…

Machine Learning · Computer Science 2022-06-07 Yang Li , Yu Shen , Huaijun Jiang , Tianyi Bai , Wentao Zhang , Ce Zhang , Bin Cui

In this paper we present a technique for using the bootstrap to estimate the operating characteristics and their variability for certain types of ensemble methods. Bootstrapping a model can require a huge amount of work if the training data…

Machine Learning · Statistics 2017-10-26 Anthony Gamst , Jay-Calvin Reyes , Alden Walker

In real-world applications, as data availability increases, obtaining labeled data for machine learning (ML) projects remains challenging due to the high costs and intensive efforts required for data annotation. Many ML projects,…

Machine Learning · Computer Science 2024-12-24 Ismail Hakki Karaman , Gulser Koksal , Levent Eriskin , Salih Salihoglu

Massive data bring the big challenges of memory and computation for analysis. These challenges can be tackled by taking subsamples from the full data as a surrogate. For functional data, it is common to collect multiple measurements over…

Methodology · Statistics 2021-07-07 Hua Liu , Jinhong You , Jiguo Cao

Proper hyperparameter tuning is essential for achieving optimal performance of modern machine learning (ML) methods in predictive tasks. While there is an extensive literature on tuning ML learners for prediction, there is only little…

Econometrics · Economics 2024-02-08 Philipp Bach , Oliver Schacht , Victor Chernozhukov , Sven Klaassen , Martin Spindler

Tabular data synthesis is crucial in machine learning, yet existing general methods-primarily based on statistical or deep learning models-are highly data-dependent and often fall short in recommender systems. This limitation arises from…

Information Retrieval · Computer Science 2025-02-12 Jingtong Gao , Zhaocheng Du , Xiaopeng Li , Yichao Wang , Xiangyang Li , Huifeng Guo , Ruiming Tang , Xiangyu Zhao

Abbreviation expansion is a strategy used to speed up communication by limiting the amount of typing and using a language model to suggest expansions. Here we look at personalizing a Large Language Model's (LLM) suggestions based on prior…

Computation and Language · Computer Science 2023-12-25 Katrin Tomanek , Shanqing Cai , Subhashini Venugopalan

Deep neural network models have demonstrated their effectiveness in classifying multi-label data from various domains. Typically, they employ a training mode that combines mini-batches with optimizers, where each sample is randomly selected…

Machine Learning · Computer Science 2024-03-28 Ao Zhou , Bin Liu , Jin Wang , Grigorios Tsoumakas

Accurate approximation of the sampling distribution of nonparametric kernel density estimators is crucial for many statistical inference problems. Since these estimators have complex asymptotic distributions, bootstrap methods are often…

Statistics Theory · Mathematics 2019-09-09 Todd A. Kuffner , Stephen M. -S. Lee , G. Alastair Young

Reducing the amount of labels required to train convolutional neural networks without performance degradation is key to effectively reduce human annotation efforts. We propose Reliable Label Bootstrapping (ReLaB), an unsupervised…

Computer Vision and Pattern Recognition · Computer Science 2021-02-26 Paul Albert , Diego Ortego , Eric Arazo , Noel E. O'Connor , Kevin McGuinness

Deep neural networks have seen great success in recent years; however, training a deep model is often challenging as its performance heavily depends on the hyper-parameters used. In addition, finding the optimal hyper-parameter…

In biomedical imaging, deep learning-based methods are state-of-the-art for every modality (virtual slides, MRI, etc.) In histopathology, these methods can be used to detect certain biomarkers or classify lesions. However, such techniques…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Adrien Nivaggioli , Nicolas Pozin , Rémy Peyret , Stéphane Sockeel , Marie Sockeel , Nicolas Nerrienet , Marceau Clavel , Clara Simmat , Catherine Miquel

For deep learning practitioners, hyperparameter tuning for optimizing model performance can be a computationally expensive task. Though visualization can help practitioners relate hyperparameter settings to overall model performance,…

Human-Computer Interaction · Computer Science 2021-05-26 Hyekang Joo , Calvin Bao , Ishan Sen , Furong Huang , Leilani Battle