English
Related papers

Related papers: An Exact Solver for the Weston-Watkins SVM Subprob…

200 papers

The weighted low-rank approximation problem is a fundamental numerical linear algebra problem and has many applications in machine learning. Given a $n \times n$ weight matrix $W$ and a $n \times n$ matrix $A$, the goal is to find two…

Computational Complexity · Computer Science 2025-02-25 Chenyang Li , Yingyu Liang , Zhenmei Shi , Zhao Song

Multi-class classification is mandatory for real world problems and one of promising techniques for multi-class classification is Error Correcting Output Code. We propose a method for constructing the Error Correcting Output Code to obtain…

Machine Learning · Computer Science 2013-12-30 Patoomsiri Songsiri , Thimaporn Phetkaew , Ryutaro Ichise , Boonserm Kijsirikul

We consider robust submodular maximization problems (RSMs), where given a set of $m$ monotone submodular objective functions, the robustness is with respect to the worst-case (scaled) objective function. The model we consider generalizes…

Optimization and Control · Mathematics 2023-06-12 Hsin-Yi Huang , Hao-Hsiang Wu , Simge Kucukyavuz

We present weight normalization: a reparameterization of the weight vectors in a neural network that decouples the length of those weight vectors from their direction. By reparameterizing the weights in this way we improve the conditioning…

Machine Learning · Computer Science 2016-06-07 Tim Salimans , Diederik P. Kingma

Weighted low rank approximation is a fundamental problem in numerical linear algebra, and it has many applications in machine learning. Given a matrix $M \in \mathbb{R}^{n \times n}$, a non-negative weight matrix $W \in \mathbb{R}_{\geq…

Machine Learning · Computer Science 2025-02-18 Zhao Song , Mingquan Ye , Junze Yin , Lichen Zhang

For a variety of regularized optimization problems in machine learning, algorithms computing the entire solution path have been developed recently. Most of these methods are quadratic programs that are parameterized by a single parameter,…

Machine Learning · Computer Science 2012-10-31 Bernd Gärtner , Martin Jaggi , Clément Maria

This article introduces a weak Galerkin (WG) finite element method for quad-curl problems in three dimensions. It is proved that the proposed WG method is stable and accurate in an optimal order of error estimates for the exact solution in…

Numerical Analysis · Mathematics 2022-11-01 Chunmei Wang , Junping Wang , Shangyou Zhang

Weakly supervised semantic segmentation (WSSS), a fundamental computer vision task, which aims to segment out the object within only class-level labels. The traditional methods adopt the CNN-based network and utilize the class activation…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Jingliang Deng , Zonghan Li

The support vector machines (SVM) is one of the most widely used and practical optimization based classification models in machine learning because of its interpretability and flexibility to produce high quality results. However, the big…

Machine Learning · Computer Science 2020-11-06 Ehsan Sadrfaridpour , Korey Palmer , Ilya Safro

The support vector machine (SVM) is a widely used method for classification. Although many efforts have been devoted to develop efficient solvers, it remains challenging to apply SVM to large-scale problems. A nice property of SVM is that…

Machine Learning · Computer Science 2013-10-29 Jie Wang , Peter Wonka , Jieping Ye

In this paper, we develop a new decomposition technique for solving bi-objective linear programming problems. The proposed methodology combines the bi-objective simplex algorithm with Benders decomposition and can be used to obtain a…

Optimization and Control · Mathematics 2024-09-02 Andrea Raith , Richard Lusby , Ali Akbar Sohrabi Yousefkhan

We study a weighted generalization of the fractional cut-covering problem, which we relate to the maximum cut problem via antiblocker and gauge duality. This relationship allows us to introduce a semidefinite programming (SDP) relaxation…

Optimization and Control · Mathematics 2025-02-26 Nathan Benedetto Proença , Marcel K. de Carli Silva , Cristiane M. Sato , Levent Tunçel

Support vector machine (SVM) is a popular classifier known for accuracy, flexibility, and robustness. However, its intensive computation has hindered its application to large-scale datasets. In this paper, we propose a new optimal leverage…

Methodology · Statistics 2023-08-25 Yixin Han , Jun Yu , Nan Zhang , Cheng Meng , Ping Ma , Wenxuan Zhong , Changliang Zou

Subgradient algorithms for training support vector machines have been quite successful for solving large-scale and online learning problems. However, they have been restricted to linear kernels and strongly convex formulations. This paper…

Machine Learning · Computer Science 2011-11-04 Sangkyun Lee , Stephen J. Wright

We show that any submodular minimization (SM) problem defined on a linear constraint set with constraints having up to two variables per inequality, are 2-approximable in polynomial time. If the constraints are monotone (the two variables…

Discrete Mathematics · Computer Science 2017-05-01 Dorit S. Hochbaum

In this paper we promote the use of Support Vector Machines (SVM) as a machine learning tool for searches in high-energy physics. As an example for a new- physics search we discuss the popular case of Supersymmetry at the Large Hadron…

High Energy Physics - Experiment · Physics 2022-11-16 Mehmet Özgür Sahin , Dirk Krücker , Isabell-Alissandra Melzer-Pellmann

Recent advancements in quantum computing and quantum-inspired algorithms have sparked renewed interest in binary optimization. These hardware and software innovations promise to revolutionize solution times for complex problems. In this…

The training of Support Vector Machines may be a very difficult task when dealing with very large datasets. The memory requirement and the time consumption of the SVMs algorithms grow rapidly with the increase of the data. To overcome these…

Optimization and Control · Mathematics 2015-11-04 Andrea Manno , Laura Palagi , Simone Sagratella

In recent years, feature selection has become a challenging problem in several machine learning fields, such as classification problems. Support Vector Machine (SVM) is a well-known technique applied in classification tasks. Various…

Machine Learning · Computer Science 2021-01-18 Asunción Jiménez-Cordero , Juan Miguel Morales , Salvador Pineda

In conventional prediction tasks, a machine learning algorithm outputs a single best model that globally optimizes its objective function, which typically is accuracy. Therefore, users cannot access the other models explicitly. In contrast…

Machine Learning · Computer Science 2019-06-06 Kentaro Kanamori , Satoshi Hara , Masakazu Ishihata , Hiroki Arimura