English
Related papers

Related papers: Relevance Vector Machine with Weakly Informative H…

200 papers

Support vector machine (SVM), is a popular kernel method for data classification that demonstrated its efficiency for a large range of practical applications. The method suffers, however, from some weaknesses including; time processing,…

Machine Learning · Computer Science 2023-08-23 Lakhdar Remaki

This paper considers linear model selection when the response is vector-valued and the predictors are randomly observed. We propose a new approach that decouples statistical inference from the selection step in a "post-inference model…

Methodology · Statistics 2016-06-07 David Puelz , P. Richard Hahn , Carlos Carvalho

The expressive power of Bayesian kernel-based methods has led them to become an important tool across many different facets of artificial intelligence, and useful to a plethora of modern application domains, providing both power and…

Machine Learning · Computer Science 2021-07-13 Luca Martino , Jesse Read

Gaussian processes provide a powerful probabilistic kernel learning framework, which allows learning high quality nonparametric regression models via methods such as Gaussian process regression. Nevertheless, the learning phase of Gaussian…

Numerical Analysis · Mathematics 2021-01-06 Paz Fink Shustin , Haim Avron

In this work, we introduce kernels with random Fourier features in the meta-learning framework to leverage their strong few-shot learning ability. We propose meta variational random features (MetaVRF) to learn adaptive kernels for the…

Machine Learning · Computer Science 2020-08-14 Xiantong Zhen , Haoliang Sun , Yingjun Du , Jun Xu , Yilong Yin , Ling Shao , Cees Snoek

The demand of computational resources for the modeling process increases as the scale of the datasets does, since traditional approaches for regression involve inverting huge data matrices. The main problem relies on the large data size,…

Methodology · Statistics 2023-07-06 Vasilis Chasiotis , Dimitris Karlis

The presence of irrelevant features in the input dataset tends to reduce the interpretability and predictive quality of machine learning models. Therefore, the development of feature selection methods to recognize irrelevant features is a…

Machine Learning · Statistics 2020-10-13 Federico Amato , Fabian Guignard , Philippe Jacquet , Mikhail Kanevski

We extend variational autoencoders (VAEs) to collaborative filtering for implicit feedback. This non-linear probabilistic model enables us to go beyond the limited modeling capacity of linear factor models which still largely dominate…

Machine Learning · Statistics 2018-02-19 Dawen Liang , Rahul G. Krishnan , Matthew D. Hoffman , Tony Jebara

This paper considers the estimation and inference of the low-rank components in high-dimensional matrix-variate factor models, where each dimension of the matrix-variates ($p \times q$) is comparable to or greater than the number of…

Statistics Theory · Mathematics 2022-10-20 Elynn Y. Chen , Jianqing Fan

Quantum kernel methods have emerged as a promising approach for leveraging high-dimensional feature spaces in machine learning, particularly in domains where classical kernel methods face scalability limitations. In this work, we present…

Quantum Physics · Physics 2026-05-19 A. Delilbasic , A. Miroszewski , A. Wijata , J. Nalepa , J. Mielczarek , M. Riedel , G. Cavallaro

Nonlinear kernel regression models are often used in statistics and machine learning because they are more accurate than linear models. Variable selection for kernel regression models is a challenge partly because, unlike the linear…

Methodology · Statistics 2017-06-13 Lorin Crawford , Kris C. Wood , Xiang Zhou , Sayan Mukherjee

Let X be a d dimensional vector of covariates and Y be the response variable. Under the nonparametric model Y = m(X) + {\sigma}(X) \in we develop an ANOVA-type test for the null hypothesis that a particular coordinate of X has no influence…

Methodology · Statistics 2012-05-31 Adriano Zanin Zambom , Michael Akritas

The reduced-rank vector autoregressive (VAR) model can be interpreted as a supervised factor model, where two factor modelings are simultaneously applied to response and predictor spaces. This article introduces a new model, called vector…

Methodology · Statistics 2023-06-16 Di Wang , Xiaoyu Zhang , Guodong Li , Ruey Tsay

We introduce a strategy for specifying informative inverse-gamma (IG) priors for variance components in Bayesian multilevel models (MLMs), derived via transformations from chi-square to gamma to inverse-gamma distributions. A Monte Carlo…

Methodology · Statistics 2025-09-03 Liu Liu

In this paper, we are concerned with how to select significant variables in semiparametric modeling. Variable selection for semiparametric regression models consists of two components: model selection for nonparametric components and…

Statistics Theory · Mathematics 2008-12-18 Runze Li , Hua Liang

We analyze a lightweight simulation-based inference method that infers simulator parameters using only a regression-based projection of the observed data. After fitting a surrogate linear regression once, the procedure simulates small…

Methodology · Statistics 2026-02-04 Arya Farahi , Jonah Rose , Paul Torrey

We introduce a new, rigorously-formulated Bayesian meta-learning algorithm that learns a probability distribution of model parameter prior for few-shot learning. The proposed algorithm employs a gradient-based variational inference to infer…

Machine Learning · Computer Science 2022-03-21 Cuong Nguyen , Thanh-Toan Do , Gustavo Carneiro

We consider the nonparametric estimation of the univariate heavy tailed probability density function (pdf) with a support on $[0,\infty)$ by independent data. To this end we construct the new kernel estimator as a combination of the…

Probability · Mathematics 2016-04-25 L. Markovich

Negative binomial regression is essential for analyzing over-dispersed count data in in comparative studies, but parameter estimation becomes computationally challenging in large screens requiring millions of comparisons. We investigate…

Machine Learning · Statistics 2025-08-07 Valentine Svensson

The goal of this presentation is to build an efficient non-parametric Bayes classifier in the presence of large numbers of predictors. When analyzing such data, parametric models are often too inflexible while non-parametric procedures tend…

Methodology · Statistics 2013-01-07 Abhishek Bhattacharya