English
Related papers

Related papers: A Fused Elastic Net Logistic Regression Model for …

200 papers

Learning-to-learn or meta-learning leverages data-driven inductive bias to increase the efficiency of learning on a novel task. This approach encounters difficulty when transfer is not advantageous, for instance, when tasks are considerably…

Machine Learning · Computer Science 2019-06-20 Ghassen Jerfel , Erin Grant , Thomas L. Griffiths , Katherine Heller

Multitask learning aims at solving a set of related tasks simultaneously, by exploiting the shared knowledge for improving the performance on individual tasks. Hence, an important aspect of multitask learning is to understand the…

Machine Learning · Computer Science 2019-10-22 Changjian Shui , Mahdieh Abbasi , Louis-Émile Robitaille , Boyu Wang , Christian Gagné

The incorporation of prior knowledge into learning is essential in achieving good performance based on small noisy samples. Such knowledge is often incorporated through the availability of related data arising from domains and tasks similar…

Machine Learning · Statistics 2026-02-24 Baruch Epstein , Ron Meir , Tomer Michaeli

Multi-task learning (MTL) is an active field in deep learning in which we train a model to jointly learn multiple tasks by exploiting relationships between the tasks. It has been shown that MTL helps the model share the learned features…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Akihiro Nakano , Shi Chen , Kazuyuki Demachi

Kernel logistic regression (KLR) is a widely used supervised learning method for binary and multi-class classification, which provides estimates of the conditional probabilities of class membership for the data points. Unlike other kernel…

Machine Learning · Computer Science 2025-12-23 Antonio Consolo , Andrea Manno , Edoardo Amaldi

We consider the problem of estimating a sparse multi-response regression function, with an application to expression quantitative trait locus (eQTL) mapping, where the goal is to discover genetic variations that influence gene-expression…

Machine Learning · Statistics 2012-10-01 Seyoung Kim , Eric P. Xing

Interpretable Multi-Task Learning can be expressed as learning a sparse graph of the task relationship based on the prediction performance of the learned models. Since many natural phenomenon exhibit sparse structures, enforcing sparsity on…

Machine Learning · Computer Science 2020-09-14 Francesco Alesiani , Shujian Yu , Ammar Shaker , Wenzhe Yin

Additive models form a widely popular class of regression models which represent the relation between covariates and response variables as the sum of low-dimensional transfer functions. Besides flexibility and accuracy, a key benefit of…

Machine Learning · Statistics 2015-05-20 Alhussein Fawzi , Mathieu Sinn , Pascal Frossard

Lasso is a popular and efficient approach to simultaneous estimation and variable selection in high-dimensional regression models. In this paper, a robust LAD-lasso method for multiple outcomes is presented that addresses the challenges of…

Methodology · Statistics 2022-12-02 Jyrki Möttönen , Tero Lähderanta , Janne Salonen , Mikko J. Sillanpää

Sparse covariates are frequent in classification and regression problems and in these settings the task of variable selection is usually of interest. As it is well known, sparse statistical models correspond to situations where there are…

Methodology · Statistics 2020-02-14 Ana M. Bianco , Graciela Boente , Gonzalo Chebi

In this paper we consider high-dimensional multiclass classification by sparse multinomial logistic regression. We propose first a feature selection procedure based on penalized maximum likelihood with a complexity penalty on the model size…

Statistics Theory · Mathematics 2020-11-20 Felix Abramovich , Vadim Grinshtein , Tomer Levy

We study the multi-task learning problem that aims to simultaneously analyze multiple datasets collected from different sources and learn one model for each of them. We propose a family of adaptive methods that automatically utilize…

Machine Learning · Statistics 2023-09-19 Yaqi Duan , Kaizheng Wang

Collaborative training can improve the accuracy of a model for a user by trading off the model's bias (introduced by using data from other users who are potentially different) against its variance (due to the limited amount of data on any…

Machine Learning · Computer Science 2022-06-24 El Mahdi Chayti , Sai Praneeth Karimireddy , Sebastian U. Stich , Nicolas Flammarion , Martin Jaggi

Bayesian multinomial logistic regression provides a principled, interpretable approach to multiclass classification, but posterior sampling becomes increasingly expensive as the model dimension grows. Prior work has studied scalability in…

Computation · Statistics 2026-02-27 Jared D. Fisher , Kyle R. McEvoy

We investigate multi-task learning approaches that use a shared feature representation for all tasks. To better understand the transfer of task information, we study an architecture with a shared module for all tasks and a separate output…

Machine Learning · Computer Science 2020-05-05 Sen Wu , Hongyang R. Zhang , Christopher Ré

In statistics and machine learning, logistic regression is a widely-used supervised learning technique primarily employed for binary classification tasks. When the number of observations greatly exceeds the number of predictor variables, we…

Machine Learning · Statistics 2024-04-02 Agniva Chowdhury , Pradeep Ramuhalli

We consider multi-task learning, which simultaneously learns related prediction tasks, to improve generalization performance. We factorize a coefficient matrix as the product of two matrices based on a low-rank assumption. These matrices…

Machine Learning · Statistics 2018-08-14 Jun-Yong Jeong , Chi-Hyuck Jun

In large-scale supervised learning, penalized logistic regression (PLR) effectively mitigates overfitting through regularization, yet its performance critically depends on robust variable selection. This paper demonstrates that label noise…

Machine Learning · Computer Science 2026-02-16 Xiaofei Wu , Rongmei Liangse

Multi-task learning promises better model generalization on a target task by jointly optimizing it with an auxiliary task. However, the current practice requires additional labeling efforts for the auxiliary task, while not guaranteeing…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Menelaos Kanakis , Thomas E. Huang , David Bruggemann , Fisher Yu , Luc Van Gool

We propose clustered federated multitask learning to address statistical challenges in non-independent and identically distributed data across clients. Our approach tackles complexities in hierarchical wireless networks by clustering…

Networking and Internet Architecture · Computer Science 2024-07-15 Moqbel Hamood , Abdullatif Albaseer , Mohamed Abdallah , Ala Al-Fuqaha , Amr Mohamed