English
Related papers

Related papers: Multiparameter regularization and aggregation in t…

200 papers

We consider a general nonparametric regression model called the compound model. It includes, as special cases, sparse additive regression and nonparametric (or linear) regression with many covariates but possibly a small number of relevant…

Statistics Theory · Mathematics 2013-01-04 Arnak Dalalyan , Yuri Ingster , Alexandre Tsybakov

We develop a model-based methodology for integrating gene-set information with an experimentally-derived gene list. The methodology uses a previously reported sampling model, but takes advantage of natural constraints in the…

Methodology · Statistics 2015-06-02 Zhishi Wang , Qiuling He , Bret Larget , Michael A. Newton

Regularization is a popular technique in machine learning for model estimation and avoiding overfitting. Prior studies have found that modern ordered regularization can be more effective in handling highly correlated, high-dimensional data…

Machine Learning · Computer Science 2019-11-01 Mahammad Humayoo , Xueqi Cheng

In order to scale standard Gaussian process (GP) regression to large-scale datasets, aggregation models employ factorized training process and then combine predictions from distributed experts. The state-of-the-art aggregation models,…

Machine Learning · Statistics 2018-06-05 Haitao Liu , Jianfei Cai , Yi Wang , Yew-Soon Ong

Multimodal learning, particularly for pedestrian detection, has recently received emphasis due to its capability to function equally well in several critical autonomous driving scenarios such as low-light, night-time, and adverse weather…

Computer Vision and Pattern Recognition · Computer Science 2023-07-10 Arindam Das , Sudip Das , Ganesh Sistu , Jonathan Horgan , Ujjwal Bhattacharya , Edward Jones , Martin Glavin , Ciarán Eising

Combining multiple machine learning models has long been a technique for enhancing performance, particularly in distributed settings. Traditional approaches, such as model ensembles, work well, but are expensive in terms of memory and…

Machine Learning · Computer Science 2024-12-23 Albert Manuel Orozco Camacho , Stefan Horoi , Guy Wolf , Eugene Belilovsky

Metric regularity is among the central concepts of nonlinear and variational analysis, constrained optimization, and their numerous applications. However, metric regularity can be elusive for some important ill-posed classes of problems…

Optimization and Control · Mathematics 2025-03-30 Mario Jelitte , Boris S. Mordukhovich

We present a convex approach to probabilistic segmentation and modeling of time series data. Our approach builds upon recent advances in multivariate total variation regularization, and seeks to learn a separate set of parameters for the…

Machine Learning · Statistics 2015-11-17 Matt Wytock , J. Zico Kolter

We introduce profile matching, a multivariate matching method for randomized experiments and observational studies that finds the largest possible unweighted samples across multiple treatment groups that are balanced relative to a covariate…

Methodology · Statistics 2022-07-07 Eric R. Cohn , Jose R. Zubizarreta

Variational regularization of ill-posed inverse problems is based on minimizing the sum of a data fidelity term and a regularization term. The balance between them is tuned using a positive regularization parameter, whose automatic choice…

Numerical Analysis · Mathematics 2025-11-12 Markus Juvonen , Bjørn Jensen , Ilmari Pohjola , Yiqiu Dong , Samuli Siltanen

Tuning parameters is an important step for the application of metaheuristics to problem classes of interest. In this work we present a tuning framework based on the sequential optimization of perturbed regression models. Besides providing…

Neural and Evolutionary Computing · Computer Science 2019-12-02 Áthila R. Trindade , Felipe Campelo

Regularization method and Bayesian inverse method are two dominating ways for solving inverse problems generated from various fields, e.g., seismic exploration and medical imaging. The two methods are related with each other by the MAP…

Numerical Analysis · Mathematics 2019-06-18 Junxiong Jia , Qihang Sun , Bangyu Wu , Jigen Peng

A novel functional additive model is proposed which is uniquely modified and constrained to model nonlinear interactions between a treatment indicator and a potentially large number of functional and/or scalar pretreatment covariates. The…

Methodology · Statistics 2021-01-26 Hyung Park , Eva Petkova , Thaddeus Tarpey , R. Todd Ogden

In this article, we propose a class of semiparametric mixture regression models with single-index. We argue that many recently proposed semiparametric/nonparametric mixture regression models can be considered special cases of the proposed…

Methodology · Statistics 2016-10-04 Sijia Xiang , Weixin Yao

Regularization plays a key role in a variety of optimization formulations of inverse problems. A recurring theme in regularization approaches is the selection of regularization parameters, and their effect on the solution and on the optimal…

Optimization and Control · Mathematics 2018-08-23 Aleksandr Y. Aravkin , James V. Burke , Michael P. Friedlander

In this work, we consider learning over multitask graphs, where each agent aims to estimate its own parameter vector. Although agents seek distinct objectives, collaboration among them can be beneficial in scenarios where relationships…

Machine Learning · Computer Science 2025-09-23 Yara Zgheib , Luca Calatroni , Marc Antonini , Roula Nassif

We address the component-based regularisation of a multivariate Generalised Linear Mixed Model (GLMM) in the framework of grouped data. A set Y of random responses is modelled with a multivariate GLMM, based on a set X of explanatory…

Statistics Theory · Mathematics 2019-08-13 Jocelyn Chauvet , Catherine Trottier , Xavier Bry

In this work we consider the problem of finding optimal regularization parameters for general-form Tikhonov regularization using training data. We formulate the general-form Tikhonov solution as a spectral filtered solution using the…

Numerical Analysis · Mathematics 2014-07-09 Julianne Chung , Malena I. Español , Tuan Nguyen

Multi-label learning is usually used to mine the correlation between features and labels, and feature selection can retain as much information as possible through a small number of features. $\ell_{2,1}$ regularization method can get sparse…

Machine Learning · Statistics 2023-03-31 Haibao Li , Hongzhi Zhai

In this paper we propose an extension of the notion of deviation-based aggregation function tailored to aggregate multidimensional data. Our objective is both to improve the results obtained by other methods that try to select the best…