English
Related papers

Related papers: Learning a powerful SVM using piece-wise linear lo…

200 papers

We consider some supervised binary classification tasks and a regression task, whereas SVM and Deep Learning, at present, exhibit the best generalization performances. We extend the work [3] on a generalized quadratic loss for learning…

Machine Learning · Computer Science 2021-02-16 Filippo Portera

The paper is devoted to a comprehensive second-order study of a remarkable class of convex extended-real-valued functions that is highly important in many aspects of nonlinear and variational analysis, specifically those related to…

Optimization and Control · Mathematics 2015-07-21 Boris S. Mordukhovich , M. Ebrahim Sarabi

Control invariant set is critical for guaranteeing safe control and the problem of computing control invariant set for linear discrete-time system is revisited in this paper by using a data-driven approach. Specifically, sample points on…

Optimization and Control · Mathematics 2022-11-24 Jun Xu , Fanglin Chen

Modeling the temporal behavior of data is of primordial importance in many scientific and engineering fields. Baseline methods assume that both the dynamic and observation equations follow linear-Gaussian models. However, there are many…

Machine Learning · Computer Science 2020-11-03 Xavier Alameda-Pineda , Vincent Drouard , Radu Horaud

A mean field variational Bayes approach to support vector machines (SVMs) using the latent variable representation on Polson & Scott (2012) is presented. This representation allows circumvention of many of the shortcomings associated with…

Methodology · Statistics 2013-05-14 Jan Luts , John T. Ormerod

Training a Support Vector Machine (SVM) requires the solution of a quadratic programming problem (QP) whose computational complexity becomes prohibitively expensive for large scale datasets. Traditional optimization methods cannot be…

Machine Learning · Computer Science 2014-01-29 Emanuele Frandi , Ricardo Nanculef , Maria Grazia Gasparo , Stefano Lodi , Claudio Sartori

The Gaussian process latent variable model (GPLVM) is a popular probabilistic method used for nonlinear dimension reduction, matrix factorization, and state-space modeling. Inference for GPLVMs is computationally tractable only when the…

Machine Learning · Statistics 2023-06-16 Michael Minyi Zhang , Gregory W. Gundersen , Barbara E. Engelhardt

In this paper an identification method for state-space LPV models is presented. The method is based on a particular parameterization that can be written in linear regression form and enables model estimation to be handled using…

Optimization and Control · Mathematics 2018-03-28 R. A. Romano , P. Lopes dos Santos , Felipe Pait , T-P Perdicoúlis , José A. Ramos

In this paper, we use support vector machines (SVM) to develop a machine learning framework to discover phase space structures that distinguish between distinct reaction pathways. The SVM model is trained using data from trajectories of…

Chemical Physics · Physics 2022-01-06 Vladimír Krajňák , Shibabrat Naik , Stephen Wiggins

Time-series forecasting has gained significant attention in machine learning due to its crucial role in various domains. However, most existing forecasting models rely heavily on point-wise loss functions like Mean Square Error, which treat…

Machine Learning · Computer Science 2025-07-16 Dilfira Kudrat , Zongxia Xie , Yanru Sun , Tianyu Jia , Qinghua Hu

Support vector machines (SVMs) are an important tool in modern data analysis. Traditionally, support vector machines have been fitted via quadratic programming, either using purpose-built or off-the-shelf algorithms. We present an…

Computation · Statistics 2017-05-15 Hien D. Nguyen , Geoffrey J. McLachlan

Quantum computing leverages quantum effects to build algorithms that are faster then their classical variants. In machine learning, for a given model architecture, the speed of training the model is typically determined by the size of the…

Machine Learning · Computer Science 2022-04-25 Seyran Saeedi , Aliakbar Panahi , Tom Arodz

Kernel-based machine learning algorithms are based on mapping data from the original input feature space to a kernel feature space of higher dimensionality to solve a linear problem in that space. Over the last decade, kernel based…

Computer Vision and Pattern Recognition · Computer Science 2011-01-18 Mahesh Pal

We introduce an efficient method for training the linear ranking support vector machine. The method combines cutting plane optimization with red-black tree based approach to subgradient calculations, and has O(m*s+m*log(m)) time complexity,…

Machine Learning · Statistics 2022-02-07 Antti Airola , Tapio Pahikkala , Tapio Salakoski

We investigate statistical properties for a broad class of modern kernel-based regression (KBR) methods. These kernel methods were developed during the last decade and are inspired by convex risk minimization in infinite-dimensional Hilbert…

Statistics Theory · Mathematics 2009-09-29 Andreas Christmann , Ingo Steinwart

This paper proposes a regularized pairwise difference approach for estimating the linear component coefficient in a partially linear model, with consistency and exact rates of convergence obtained in high dimensions under mild scaling…

Statistics Theory · Mathematics 2018-01-15 Fang Han , Zhao Ren , Yuxin Zhu

The generalization error bound of support vector machine (SVM) depends on the ratio of radius and margin, while standard SVM only considers the maximization of the margin but ignores the minimization of the radius. Several approaches have…

Machine Learning · Computer Science 2015-04-21 Xiaohe Wu , Wangmeng Zuo , Yuanyuan Zhu , Liang Lin

In this paper we propose a multi-task linear classifier learning problem called D-SVM (Dictionary SVM). D-SVM uses a dictionary of parameter covariance shared by all tasks to do multi-task knowledge transfer among different tasks. We…

Machine Learning · Computer Science 2013-10-22 Fanyi Xiao , Ruikun Luo , Zhiding Yu

Pair-wise loss is an approach to metric learning that learns a semantic embedding by optimizing a loss function that encourages images from the same semantic class to be mapped closer than images from different classes. The literature…

Computer Vision and Pattern Recognition · Computer Science 2022-01-28 Hong Xuan , Robert Pless

The threat of malware is a serious concern for computer networks and systems, highlighting the need for accurate classification techniques. In this research, we experiment with multimodal machine learning approaches for malware…

Cryptography and Security · Computer Science 2025-01-22 Jonathan Jiang , Mark Stamp