English
Related papers

Related papers: An ADMM Solver for the MKL-$L_{0/1}$-SVM

200 papers

This paper proposes a multiblock alternating direction method of multipliers for solving a class of multiblock nonsmooth nonconvex optimization problem with nonlinear coupling constraints. We employ a majorization minimization procedure in…

Optimization and Control · Mathematics 2023-12-05 Le Thi Khanh Hien , Dimitri Papadimitriou

It is a challenging problem that solving the \textit{multivariate linear model} (MLM) $\mathbf{A}\mathbf{x}=\mathbf{b}$ with the $\ell_1 $-norm approximation method such that $||\mathbf{A}\mathbf{x}-\mathbf{b}||_1$, the $\ell_1$-norm of the…

Optimization and Control · Mathematics 2025-05-21 Zhi-Qiang Feng , Hong-Yan Zhanga , Ji Ma , Daniel Delahaye , Ruo-Shi Yang , Man Liang

The support vector machine (SVM) algorithm is well known to the computer learning community for its very good practical results. The goal of the present paper is to study this algorithm from a statistical perspective, using tools of…

Statistics Theory · Mathematics 2008-12-18 Gilles Blanchard , Olivier Bousquet , Pascal Massart

Several supermodular losses have been shown to improve the perceptual quality of image segmentation in a discriminative framework such as a structured output support vector machine (SVM). These loss functions do not necessarily have the…

Computer Vision and Pattern Recognition · Computer Science 2017-02-14 Jiaqian Yu , Matthew B. Blaschko

We consider the problem of metric learning for multi-view data and present a novel method for learning within-view as well as between-view metrics in vector-valued kernel spaces, as a way to capture multi-modal structure of the data. We…

Machine Learning · Computer Science 2018-03-22 Riikka Huusari , Hachem Kadri , Cécile Capponi

We present an Alternating Direction Method of Multipliers (ADMM) algorithm for solving optimization problems with an l_1 regularized least-squares cost function subject to recursive equality constraints. The considered optimization problem…

Systems and Control · Computer Science 2012-03-20 Mariette Annergren , Anders Hansson , Bo Wahlberg

Positive definite operator-valued kernels generalize the well-known notion of reproducing kernels, and are naturally adapted to multi-output learning situations. This paper addresses the problem of learning a finite linear combination of…

Machine Learning · Statistics 2012-06-15 Hachem Kadri , Alain Rakotomamonjy , Francis Bach , Philippe Preux

Recently, a number of learning-based optimization methods that combine data-driven architectures with the classical optimization algorithms have been proposed and explored, showing superior empirical performance in solving various ill-posed…

Machine Learning · Computer Science 2019-05-16 Xingyu Xie , Jianlong Wu , Zhisheng Zhong , Guangcan Liu , Zhouchen Lin

In many applications, input data are sampled functions taking their values in infinite dimensional spaces rather than standard vectors. This fact has complex consequences on data analysis algorithms that motivate modifications of them. In…

Statistics Theory · Mathematics 2007-05-23 Fabrice Rossi , Nathalie Villa

The classical hinge-loss support vector machines (SVMs) model is sensitive to outlier observations due to the unboundedness of its loss function. To circumvent this issue, recent studies have focused on non-convex loss functions, such as…

Machine Learning · Computer Science 2022-07-19 Ítalo Santana , Breno Serrano , Maximilian Schiffer , Thibaut Vidal

A wide variety of machine learning algorithms such as support vector machine (SVM), minimax probability machine (MPM), and Fisher discriminant analysis (FDA), exist for binary classification. The purpose of this paper is to provide a…

Machine Learning · Computer Science 2012-06-22 Akiko Takeda , Hiroyuki Mitsugi , Takafumi Kanamori

We propose a novel integrated formulation for multiclass and multilabel support vector machines (SVMs). A number of approaches have been proposed to extend the original binary SVM to an all-in-one multiclass SVM. However, its direct…

Machine Learning · Computer Science 2020-03-26 Hoda Shajari , Anand Rangarajan

Any applied mathematical model contains parameters. The paper proposes to use kernel learning for the parametric analysis of the model. The approach consists in setting a distribution on the parameter space, obtaining a finite training…

Optimization and Control · Mathematics 2025-01-27 Vladimir Norkin , Alois Pichler

An increasing amount of collected data are high-dimensional multi-way arrays (tensors), and it is crucial for efficient learning algorithms to exploit this tensorial structure as much as possible. The ever-present curse of dimensionality…

Machine Learning · Computer Science 2021-08-04 Kirandeep Kour , Sergey Dolgov , Martin Stoll , Peter Benner

This paper addresses the problem of nonconvex nonsmooth decentralised optimisation in multi-agent networks with undirected connected communication graphs. Our contribution lies in introducing an algorithmic framework designed for the…

Optimization and Control · Mathematics 2023-12-08 Behnam Mafakheri , Jonathan H. Manton , Iman Shames

Considering the classification problem, we summarize the nonparallel support vector machines with the nonparallel hyperplanes to two types of frameworks. The first type constructs the hyperplanes separately. It solves a series of small…

Machine Learning · Computer Science 2021-06-28 Chun-Na Li , Yuan-Hai Shao , Huajun Wang , Yu-Ting Zhao , Ling-Wei Huang , Naihua Xiu , Nai-Yang Deng

Adversarial attacks by generating examples which are almost indistinguishable from natural examples, pose a serious threat to learning models. Defending against adversarial attacks is a critical element for a reliable learning system.…

Machine Learning · Computer Science 2021-07-22 Huimin Wu , Zhengmian Hu , Bin Gu

The advancement of Multimodal Large Language Models (MLLMs) has driven significant progress in Visual Question Answering (VQA), evolving from Single to Multi Image VQA (MVQA). However, the increased number of images in MVQA inevitably…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Kang Zeng , Guojin Zhong , Jintao Cheng , Jin Yuan , Zhiyong Li

Multi-view learning (MVL) is an emerging field in machine learning that focuses on improving generalization performance by leveraging complementary information from multiple perspectives or views. Various multi-view support vector machine…

Machine Learning · Computer Science 2025-12-19 A. Quadir , M. Sajid , Mushir Akhtar , M. Tanveer

Multi-view learning is a learning problem that utilizes the various representations of an object to mine valuable knowledge and improve the performance of learning algorithm, and one of the significant directions of multi-view learning is…

Machine Learning · Computer Science 2022-01-11 Run-kun Lu , Jian-wei Liu , Yuan-fang Wang , Hao-jie Xie , Xin Zuo