English
Related papers

Related papers: Profile-Kernel likelihood inference with diverging…

200 papers

The ability to estimate epistemic uncertainty is often crucial when deploying machine learning in the real world, but modern methods often produce overconfident, uncalibrated uncertainty predictions. A common approach to quantify epistemic…

The ever-growing size of the datasets renders well-studied learning techniques, such as Kernel Ridge Regression, inapplicable, posing a serious computational challenge. Divide-and-conquer is a common remedy, suggesting to split the dataset…

Machine Learning · Statistics 2021-05-25 Valeriy Avanesov

This paper introduces a fast, general method for dictionary-free parameter estimation in quantitative magnetic resonance imaging (QMRI) via regression with kernels (PERK). PERK first uses prior distributions and the nonlinear MR signal…

Machine Learning · Statistics 2019-06-14 Gopal Nataraj , Jon-Fredrik Nielsen , Clayton Scott , Jeffrey A. Fessler

In this paper, computational aspects of the panel aggregation problem are addressed. Motivated primarily by applications of risk assessment, an algorithm is developed for aggregating large corpora of internally incoherent probability…

Artificial Intelligence · Computer Science 2007-07-13 Joel B. Predd , Sanjeev R. Kulkarni , Daniel N. Osherson , H. Vincent Poor

Deep neural networks are increasingly being used for the analysis of medical images. However, most works neglect the uncertainty in the model's prediction. We propose an uncertainty-aware deep kernel learning model which permits the…

Machine Learning · Computer Science 2021-06-11 Zhiliang Wu , Yinchong Yang , Jindong Gu , Volker Tresp

Datasets from the fields of bioinformatics, chemometrics, and face recognition are typically characterized by small samples of high-dimensional data. Among the many variants of linear discriminant analysis that have been proposed in order…

Machine Learning · Statistics 2020-04-20 Lama B. Niyazi , Abla Kammoun , Hayssam Dahrouj , Mohamed-Slim Alouini , Tareq Y. Al-Naffouri

We study the problem of estimating the parameters of a regression model from a set of observations, each consisting of a response and a predictor. The response is assumed to be related to the predictor via a regression model of unknown…

Machine Learning · Statistics 2016-05-19 Carlos Alberto Gomez-Uribe

We consider the prediction problem of a continuous-time stochastic process on an entire time-interval in terms of its recent past. The approach we adopt is based on functional kernel nonparametric regression estimation techniques where…

Statistics Theory · Mathematics 2007-06-13 Anestis Antoniadis , Efstathios Paparoditis , Theofanis Sapatinas

A low-dimensional dynamical system is observed in an experiment as a high-dimensional signal; for example, a video of a chaotic pendulums system. Assuming that we know the dynamical model up to some unknown parameters, can we estimate the…

Machine Learning · Statistics 2021-11-24 Ofir Lindenbaum , Amir Sagiv , Gal Mishne , Ronen Talmon

We consider a new criterion-based approach to model selection in linear regression. Properties of selection criteria based on p-values of a likelihood ratio statistic are studied for families of linear regression models. We prove that such…

Statistics Theory · Mathematics 2012-05-21 Piotr Pokarowski , Jan Mielniczuk , Paweł Teisseyre

Predictive recursion is an accurate and computationally efficient algorithm for nonparametric estimation of mixing densities in mixture models. In semiparametric mixture models, however, the algorithm fails to account for any uncertainty in…

Methodology · Statistics 2015-03-19 Ryan Martin , Surya T. Tokdar

In survival studies it is important to record the values of key longitudinal covariates until the occurrence of event of a subject. For this reason, it is essential to study the association between longitudinal and time-to-event outcomes…

Methodology · Statistics 2021-06-09 Khandoker Akib Mohammad , Yuichi Hirose , Yuan Yao , Budhi Surya

Kernel-based methods enjoy powerful generalization capabilities in handling a variety of learning tasks. When such methods are provided with sufficient training data, broadly-applicable classes of nonlinear functions can be approximated…

Machine Learning · Statistics 2017-12-29 Fatemeh Sheikholeslami , Dimitris Berberidis , Georgios B. Giannakis

Statistical inference in parametric models (e.g., the Bradley--Terry model and its variants) for paired-comparison data has been explored in the high-dimensional regime, in which the number of items involving in paired comparisons diverges.…

Methodology · Statistics 2026-04-01 Haoyue Song , Lianqiang Qu , Ting Yan , Yuguo Chen

In recent years, functional linear models have attracted growing attention in statistics and machine learning, with the aim of recovering the slope function or its functional predictor. This paper considers online regularized learning…

Machine Learning · Statistics 2022-11-28 Yuan Mao , Zheng-Chu Guo

We introduce ParK, a new large-scale solver for kernel ridge regression. Our approach combines partitioning with random projections and iterative optimization to reduce space and time complexity while provably maintaining the same…

Machine Learning · Statistics 2022-10-18 Luigi Carratino , Stefano Vigogna , Daniele Calandriello , Lorenzo Rosasco

This paper investigates the identification of quantiles and quantile regression parameters when observations are set valued. We define the identification set of quantiles of random sets in a way that extends the definition of quantiles for…

Methodology · Statistics 2020-04-10 Arie Beresteanu , Yuya Sasaki

Beneficial to advanced computing devices, models with massive parameters are increasingly employed to extract more information to enhance the precision in describing and predicting the patterns of objective systems. This phenomenon is…

Information Theory · Computer Science 2024-03-08 Liye Jia , Fengyufan Yang , Ka Lok Man , Erick Purwanto , Sheng-Uei Guan , Jeremy Smith , Yutao Yue

We forecast a single time series using a high-dimensional set of predictors. When these predictors share common underlying dynamics, an approximate latent factor model provides a powerful characterization of their co-movements Bai(2003).…

Econometrics · Economics 2025-12-11 Rajveer Jat , Daanish Padha

To accurately reproduce measurements from the real world, simulators need to have an adequate model of the physical system and require the parameters of the model be identified. We address the latter problem of estimating parameters through…

Robotics · Computer Science 2022-03-01 Eric Heiden , Christopher E. Denniston , David Millard , Fabio Ramos , Gaurav S. Sukhatme