English
Related papers

Related papers: A Category Space Approach to Supervised Dimensiona…

200 papers

In sentiment classification, the enormous amount of textual data, its immense dimensionality, and inherent noise make it extremely difficult for machine learning classifiers to extract high-level and complex abstractions. In order to make…

Information Retrieval · Computer Science 2020-06-09 Aftab Anjum , Mazharul Islam , Lin Wang

In statistical learning, many problem formulations have been proposed so far, such as multi-class learning, complementarily labeled learning, multi-label learning, multi-task learning, which provide theoretical models for various real-world…

Machine Learning · Computer Science 2022-11-14 Daiki Suehiro , Eiji Takimoto

Supervised dimensionality reduction strategies have been of great interest. However, current supervised dimensionality reduction approaches are difficult to scale for situations characterized by large datasets given the high computational…

Machine Learning · Computer Science 2018-11-09 Amir-Hossein Karimi , Alexander Wong , Ali Ghodsi

Automatic discovery of category-specific 3D keypoints from a collection of objects of some category is a challenging problem. One reason is that not all objects in a category necessarily have the same semantic parts. The level of difficulty…

Computer Vision and Pattern Recognition · Computer Science 2021-01-07 Clara Fernandez-Labrador , Ajad Chhatkuli , Danda Pani Paudel , Jose J. Guerrero , Cédric Demonceaux , Luc Van Gool

Discriminative linear models are a popular tool in machine learning. These can be generally divided into two types: The first is linear classifiers, such as support vector machines, which are well studied and provide state-of-the-art…

Machine Learning · Computer Science 2012-07-02 Koby Crammer , Amir Globerson

Ensemble learning has had many successes in supervised learning, but it has been rare in unsupervised learning and dimensionality reduction. This study explores dimensionality reduction ensembles, using principal component analysis and…

Machine Learning · Statistics 2017-10-13 Colleen M. Farrelly

Most camera lens systems are designed in isolation, separately from downstream computer vision methods. Recently, joint optimization approaches that design lenses alongside other components of the image acquisition and processing pipeline…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Geoffroi Côté , Fahim Mannan , Simon Thibault , Jean-François Lalonde , Felix Heide

Self-supervised learning (SSL) has emerged as a powerful paradigm for representation learning by optimizing geometric objectives, such as invariance to augmentations, variance preservation, and feature decorrelation, without requiring…

Machine Learning · Statistics 2026-03-09 M. Hadi Sepanj , Benyamin Ghojogh , Saed Moradi , Paul Fieguth

In this paper, a novel framework of sparse kernel learning for Support Vector Data Description (SVDD) based anomaly detection is presented. In this work, optimal sparse feature selection for anomaly detection is first modeled as a Mixed…

Machine Learning · Computer Science 2015-06-09 Zhimin Peng , Prudhvi Gurram , Heesung Kwon , Wotao Yin

The vast majority of Dimensionality Reduction (DR) techniques rely on second-order statistics to define their optimization objective. Even though this provides adequate results in most cases, it comes with several shortcomings. The methods…

Computer Vision and Pattern Recognition · Computer Science 2017-08-21 Nikolaos Passalis , Anastasios Tefas

We present a supervised dimensionality reduction technique called Convex Linear Discriminant Analysis (ConvexLDA). The proposed model optimizes a multi-objective cost function by balancing two complementary terms. The first term pulls the…

Machine Learning · Computer Science 2025-03-19 Sai Vijay Kumar Surineela , Prathyusha Kanakamalla , Harigovind Harikumar , Tomojit Ghosh

We propose a new approach, multi-view Laplacian support vector machines (SVMs), for semi-supervised learning under the multi-view scenario. It integrates manifold regularization and multi-view regularization into the usual formulation of…

Machine Learning · Computer Science 2013-07-29 Shiliang Sun

Semisupervised methods inevitably invoke some assumption that links the marginal distribution of the features to the regression function of the label. Most commonly, the cluster or manifold assumptions are used which imply that the…

Statistics Theory · Mathematics 2011-12-02 Martin Azizyan , Aarti Singh , Larry Wasserman

We start out by demonstrating that an elementary learning task, corresponding to the training of a single linear neuron in a convolutional neural network, can be solved for feature spaces of very high dimensionality. In a second step,…

Computer Vision and Pattern Recognition · Computer Science 2017-07-11 Marco Loog , François Lauze

Finding global optima in high-dimensional optimization problems is extremely challenging since the number of function evaluations required to sufficiently explore the search space increases exponentially with its dimensionality.…

Machine Learning · Computer Science 2022-11-04 Julian F. Schumann , Alejandro M. Aragón

Learning with complete or partial supervision is powerful but relies on ever-growing human annotation efforts. As a way to mitigate this serious problem, as well as to serve specific applications, unsupervised learning has emerged as an…

Computer Vision and Pattern Recognition · Computer Science 2019-04-08 Huy V. Vo , Francis Bach , Minsu Cho , Kai Han , Yann LeCun , Patrick Perez , Jean Ponce

In this paper we introduce and analyze the learning scenario of \emph{coupled nonlinear dimensionality reduction}, which combines two major steps of machine learning pipeline: projection onto a manifold and subsequent supervised learning.…

Machine Learning · Statistics 2015-11-26 Mehryar Mohri , Afshin Rostamizadeh , Dmitry Storcheus

In this paper, we present new optimization models for Support Vector Machine (SVM), with the aim of separating data points in two or more classes. The classification task is handled by means of nonlinear classifiers induced by kernel…

Optimization and Control · Mathematics 2025-07-15 Francesca Maggioni , Andrea Spinelli

This paper presents a novel kernel-based generative classifier which is defined in a distortion subspace using polynomial series expansion, named Kernel-Distortion (KD) classifier. An iterative kernel selection algorithm is developed to…

Machine Learning · Statistics 2016-06-22 Bo Tang , Paul M. Baggenstoss , Haibo He

Modeling the dynamic behavior of deformable objects is crucial for creating realistic digital worlds. While conventional simulations produce high-quality motions, their computational costs are often prohibitive. Subspace simulation…