English
Related papers

Related papers: Multiple Kernel Learning: A Unifying Probabilistic…

200 papers

Marginalising over families of Gaussian Process kernels produces flexible model classes with well-calibrated uncertainty estimates. Existing approaches require likelihood evaluations of many kernels, rendering them prohibitively expensive…

Machine Learning · Statistics 2023-03-16 Saad Hamid , Sebastian Schulze , Michael A. Osborne , Stephen J. Roberts

Learning representations of nodes in a low dimensional space is a crucial task with numerous interesting applications in network analysis, including link prediction, node classification, and visualization. Two popular approaches for this…

Social and Information Networks · Computer Science 2022-08-10 Abdulkadir Celikkanat , Yanning Shen , Fragkiskos D. Malliaros

A wide array of machine learning problems are formulated as the minimization of the expectation of a convex loss function on some parameter space. Since the probability distribution of the data of interest is usually unknown, it is is often…

Optimization and Control · Mathematics 2019-05-27 Emilie Chouzenoux , Henri Gérard , Jean-Christophe Pesquet

Bayesian optimization is a popular tool for data-efficient optimization of expensive objective functions. In real-life applications like engineering design, the designer often wants to take multiple objectives as well as input uncertainty…

Artificial Intelligence · Computer Science 2022-02-28 J. Qing , I. Couckuyt , T. Dhaene

In the setting of supervised learning using reproducing kernel methods, we propose a data-dependent regularization parameter selection rule that is adaptive to the unknown regularity of the target function and is optimal both for the…

Statistics Theory · Mathematics 2019-05-28 Gilles Blanchard , Peter Mathé , Nicole Mücke

Although deep neural networks have achieved super-human performance on many classification tasks, they often exhibit a worrying lack of robustness towards adversarially generated examples. Thus, considerable effort has been invested into…

Machine Learning · Computer Science 2024-10-01 Leon Bungert , Nicolás García Trillos , Matt Jacobs , Daniel McKenzie , Đorđe Nikolić , Qingsong Wang

In this paper, we present a local information theoretic approach to explicitly learn probabilistic clustering of a discrete random variable. Our formulation yields a convex maximization problem for which it is NP-hard to find the global…

Machine Learning · Computer Science 2018-10-12 David Qiu , Anuran Makur , Lizhong Zheng

This paper introduces a new and effective algorithm for learning kernels in a Multi-Task Learning (MTL) setting. Although, we consider a MTL scenario here, our approach can be easily applied to standard single task learning, as well. As…

Machine Learning · Computer Science 2017-07-13 Niloofar Yousefi , Cong Li , Mansooreh Mollaghasemi , Georgios Anagnostopoulos , Michael Georgiopoulos

In this paper, we study the problem of sparse multiple kernel learning (MKL), where the goal is to efficiently learn a combination of a fixed small number of kernels from a large pool that could lead to a kernel classifier with a small…

Machine Learning · Computer Science 2013-02-05 Rong Jin , Tianbao Yang , Mehrdad Mahdavi

In numerous reinforcement learning (RL) problems involving safety-critical systems, a key challenge lies in balancing multiple objectives while simultaneously meeting all stringent safety constraints. To tackle this issue, we propose a…

Artificial Intelligence · Computer Science 2024-05-28 Shangding Gu , Bilgehan Sel , Yuhao Ding , Lu Wang , Qingwei Lin , Alois Knoll , Ming Jin

This paper examines the problem of learning with a finite and possibly large set of p base kernels. It presents a theoretical and empirical analysis of an approach addressing this problem based on ensembles of kernel predictors. This…

Machine Learning · Computer Science 2012-02-20 Corinna Cortes , Mehryar Mohri , Afshin Rostamizadeh

Current methods for regularization in machine learning require quite specific model assumptions (e.g. a kernel shape) that are not derived from prior knowledge about the application, but must be imposed merely to make the method work. We…

Machine Learning · Statistics 2022-11-01 Matthias Wieler

This paper presents an entirely unsupervised interest point training framework by jointly learning detector and descriptor, which takes an image as input and outputs a probability and a description for every image point. The objective of…

Computer Vision and Pattern Recognition · Computer Science 2019-07-29 Pei Yan , Yihua Tan , Yuan Xiao , Yuan Tai , Cai Wen

Multi-view clustering has become increasingly important due to the multi-source character of real-world data. Among existing multi-view clustering methods, multi-kernel clustering and matrix factorization-based multi-view clustering have…

Machine Learning · Computer Science 2024-12-13 Chenxing Jia , Mingjie Cai , Hamido Fujita

Well-calibrated probabilistic regression models are a crucial learning component in robotics applications as datasets grow rapidly and tasks become more complex. Unfortunately, classical regression models are usually either probabilistic…

Machine Learning · Computer Science 2023-09-12 Hany Abdulsamad , Peter Nickl , Pascal Klink , Jan Peters

Regularization-based approaches for injecting constraints in Machine Learning (ML) were introduced to improve a predictive model via expert knowledge. We tackle the issue of finding the right balance between the loss (the accuracy of the…

Machine Learning · Computer Science 2020-05-22 Michele Lombardi , Federico Baldo , Andrea Borghesi , Michela Milano

We study the problem of supervised learning for both binary and multiclass classification from a unified geometric perspective. In particular, we propose a geometric regularization technique to find the submanifold corresponding to a robust…

Machine Learning · Computer Science 2016-02-12 Qinxun Bai , Steven Rosenberg , Zheng Wu , Stan Sclaroff

We study the problem of learning-to-learn: inferring a learning algorithm that works well on tasks sampled from an unknown distribution. As class of algorithms we consider Stochastic Gradient Descent on the true risk regularized by the…

Machine Learning · Computer Science 2019-03-26 Giulia Denevi , Carlo Ciliberto , Riccardo Grazzi , Massimiliano Pontil

We introduce FedGVI, a probabilistic Federated Learning (FL) framework that is robust to both prior and likelihood misspecification. FedGVI addresses limitations in both frequentist and Bayesian FL by providing unbiased predictions under…

Machine Learning · Computer Science 2025-06-11 Terje Mildner , Oliver Hamelijnck , Paris Giampouras , Theodoros Damoulas

A common goal in statistics and machine learning is estimation of unknowns. Point estimates alone are of little value without an accompanying measure of uncertainty, but traditional uncertainty quantification methods, such as confidence…

Methodology · Statistics 2025-08-12 Neil Dey , Ryan Martin , Jonathan P. Williams