English
Related papers

Related papers: Learning Hierarchical Feature Space Using CLAss-sp…

200 papers

Machine Learning (ML) has widely been used for modeling and predicting physical systems. These techniques offer high expressive power and good generalizability for interpolation within observed data sets. However, the disadvantage of…

Machine Learning · Statistics 2023-03-02 Omid Sedehi , Antonina M. Kosikova , Costas Papadimitriou , Lambros S. Katafygiotis

In statistical machine learning, kernel methods allow to consider infinite dimensional feature spaces with a computational cost that only depends on the number of observations. This is usually done by solving an optimization problem…

Optimization and Control · Mathematics 2019-01-17 Guillaume Garrigos , Lorenzo Rosasco , Silvia Villa

We introduce a novel kernel-based framework for learning differential equations and their solution maps that is efficient in data requirements, in terms of solution examples and amount of measurements from each example, and computational…

Machine Learning · Statistics 2025-04-07 Yasamin Jalalian , Juan Felipe Osorio Ramirez , Alexander Hsu , Bamdad Hosseini , Houman Owhadi

Feature learning in neural networks is crucial for their expressive power and inductive biases, motivating various theoretical approaches. Some approaches describe network behavior after training through a change in kernel scale from…

Disordered Systems and Neural Networks · Physics 2025-05-29 Noa Rubin , Kirsten Fischer , Javed Lindner , David Dahmen , Inbar Seroussi , Zohar Ringel , Michael Krämer , Moritz Helias

A low-rank transformation learning framework for subspace clustering and classification is here proposed. Many high-dimensional data, such as face images and motion sequences, approximately lie in a union of low-dimensional subspaces. The…

Computer Vision and Pattern Recognition · Computer Science 2014-03-11 Qiang Qiu , Guillermo Sapiro

Deep metric learning aims to construct an embedding space where samples of the same class are close to each other, while samples of different classes are far away from each other. Most existing deep metric learning methods attempt to…

Computer Vision and Pattern Recognition · Computer Science 2023-04-24 Liu Pingping , Liu Zetong , Lang Yijun , Zhou Qiuzhan , Li Qingliang

Kernel functions in support vector machines (SVM) are needed to assess the similarity of input samples in order to classify these samples, for instance. Besides standard kernels such as Gaussian (i.e., radial basis function, RBF) or…

Machine Learning · Computer Science 2015-07-03 Tobias Reitmaier , Bernhard Sick

Metric learning aims at learning a distance which is consistent with the semantic meaning of the samples. The problem is generally solved by learning an embedding for each sample such that the embeddings of samples of the same category are…

Machine Learning · Computer Science 2018-09-13 Xu Zhang , Felix Xinnan Yu , Svebor Karaman , Wei Zhang , Shih-Fu Chang

Image classification is a fundamental computer vision task and an important baseline for deep metric learning. In decades efforts have been made on enhancing image classification accuracy by using deep learning models while less attention…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Yunfeng Zhao , Huiyu Zhou , Fei Wu , Xifeng Wu

Multiple kernel learning (MKL) aims to find an optimal, consistent kernel function. In the hierarchical multiple kernel clustering (HMKC) algorithm, sample features are extracted layer by layer from a high-dimensional space to maximize the…

Machine Learning · Computer Science 2024-10-29 Lei Wang , Liang Du , Peng Zhou

In many classification tasks, the set of target classes can be organized into a hierarchy. This structure induces a semantic distance between classes, and can be summarised under the form of a cost matrix, which defines a finite metric on…

Machine Learning · Computer Science 2021-11-30 Vivien Sainte Fare Garnot , Loic Landrieu

In the context of algorithmic decision-making, fair machine learning methods often yield multiple models that balance predictive fairness and performance in varying degrees. This diversity introduces a challenge for stakeholders who must…

Machine Learning · Computer Science 2025-10-28 Sofoklis Kitharidis , Cor J. Veenman , Thomas Bäck , Niki van Stein

The field of quantum machine learning is a promising way to lead to a revolution in intelligent data processing methods. In this way, a hybrid learning method based on classic kernel methods is proposed. This proposal also requires the…

Quantum Physics · Physics 2024-11-01 Jhordan Silveira de Borba , Jonas Maziero

Face verification can be regarded as a 2-class fine-grained visual recognition problem. Enhancing the feature's discriminative power is one of the key problems to improve its performance. Metric learning technology is often applied to…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Fu Xiong , Yang Xiao , Zhiguo Cao , Yancheng Wang , Joey Tianyi Zhou , Jianxi Wu

This paper investigates the notion of learning user and item representations in non-Euclidean space. Specifically, we study the connection between metric learning in hyperbolic space and collaborative filtering by exploring Mobius…

Information Retrieval · Computer Science 2019-12-02 Lucas Vinh Tran , Yi Tay , Shuai Zhang , Gao Cong , Xiaoli Li

In this paper, we propose a multi-kernel classifier learning algorithm to optimize a given nonlinear and nonsmoonth multivariate classifier performance measure. Moreover, to solve the problem of kernel function selection and kernel…

Machine Learning · Computer Science 2015-08-26 Jingbin Wang , Haoxiang Wang , Yihua Zhou , Nancy McDonald

Deep neural networks excel in high-dimensional problems, outperforming models such as kernel methods, which suffer from the curse of dimensionality. However, the theoretical foundations of this success remain poorly understood. We follow…

Machine Learning · Statistics 2025-10-06 Shuo Huang , Hippolyte Labarrière , Ernesto De Vito , Tomaso Poggio , Lorenzo Rosasco

As multipath components (MPCs) are experimentally observed to appear in clusters, cluster-based channel models have been focused in the wireless channel study. However, most of the MPC clustering algorithms for MIMO channels with delay and…

Information Theory · Computer Science 2022-06-29 Yi Chen , Chong Han , Jia He , Guangjian Wang

Deep learning methods have predominantly been applied to large artificial neural networks. Despite their state-of-the-art performance, these large networks typically do not generalize well to datasets with limited sample sizes. In this…

Machine Learning · Statistics 2016-11-17 Eric Strobl , Shyam Visweswaran

Multi-label classification (MLC) studies the problem where each instance is associated with multiple relevant labels, which leads to the exponential growth of output space. MLC encourages a popular framework named label compression (LC) for…

Machine Learning · Computer Science 2020-09-21 Jiaqi Lv , Tianran Wu , Chenglun Peng , Yunpeng Liu , Ning Xu , Xin Geng