English
Related papers

Related papers: Primal Estimated Subgradient Solver for SVM for Im…

200 papers

This work is motivated by the needs of predictive analytics on healthcare data as represented by Electronic Medical Records. Such data is invariably problematic: noisy, with missing entries, with imbalance in classes of interests, leading…

Machine Learning · Statistics 2016-09-28 Talayeh Razzaghi , Oleg Roderick , Ilya Safro , Nicholas Marko

In this paper, we consider the problem of partitioning a small data sample of size $n$ drawn from a mixture of 2 sub-gaussian distributions in $\R^p$. We consider semidefinite programming relaxations of an integer quadratic program that is…

Machine Learning · Statistics 2025-03-19 Shuheng Zhou

In this paper, we study randomized and cyclic coordinate descent for convex unconstrained optimization problems. We improve the known convergence rates in some cases by using the numerical semidefinite programming performance estimation…

Optimization and Control · Mathematics 2022-12-26 Hadi Abbaszadehpeivasti , Etienne de Klerk , Moslem Zamani

The increasing number of applications requiring the solution of large scale singular value problems have rekindled interest in iterative methods for the SVD. Some promising recent ad- vances in large scale iterative methods are still…

Mathematical Software · Computer Science 2017-01-25 Lingfei Wu , Eloy Romero , Andreas Stathopoulos

In this paper we propose a novel data-level algorithm for handling data imbalance in the classification task, Synthetic Majority Undersampling Technique (SMUTE). SMUTE leverages the concept of interpolation of nearby instances, previously…

Machine Learning · Computer Science 2021-04-20 Michał Koziarski

We present a sparse linear system solver that is based on a multifrontal variant of Gaussian elimination, and exploits low-rank approximation of the resulting dense frontal matrices. We use hierarchically semiseparable (HSS) matrices, which…

Mathematical Software · Computer Science 2015-02-27 Pieter Ghysels , Xiaoye S. Li , Francois-Henry Rouet , Samuel Williams , Artem Napov

In traditional boosting algorithms, the focus on misclassified training samples emphasizes their importance based on difficulty during the learning process. While using a standard Support Vector Machine (SVM) as a weak learner in an…

Machine Learning · Computer Science 2024-10-10 Junbo Jacob Lian

Low-rank matrix estimation is a canonical problem that finds numerous applications in signal processing, machine learning and imaging science. A popular approach in practice is to factorize the matrix into two compact low-rank factors, and…

Machine Learning · Computer Science 2021-06-16 Tian Tong , Cong Ma , Yuejie Chi

Conditional stochastic optimization covers a variety of applications ranging from invariant learning and causal inference to meta-learning. However, constructing unbiased gradient estimators for such problems is challenging due to the…

Optimization and Control · Mathematics 2024-06-04 Yifan Hu , Siqi Zhang , Xin Chen , Niao He

This paper presents the performance of a classifier built using the stackingC algorithm in nine different data sets. Each data set is generated using a sampling technique applied on the original imbalanced data set. Five new sampling…

Machine Learning · Computer Science 2016-01-20 Maureen Lyndel C. Lauron , Jaderick P. Pabico

Staggered adoption of policies by different units at different times creates promising opportunities for observational causal inference. Estimation remains challenging, however, and common regression methods can give misleading results. A…

Methodology · Statistics 2021-01-19 Eli Ben-Michael , Avi Feller , Jesse Rothstein

A Support Vector Method for multivariate performance measures was recently introduced by Joachims (2005). The underlying optimization problem is currently solved using cutting plane methods such as SVM-Perf and BMRM. One can show that these…

Machine Learning · Computer Science 2012-02-20 Xinhua Zhang , Ankan Saha , S. V. N. Vishwanatan

As deep neural networks include a high number of parameters and operations, it can be a challenge to implement these models on devices with limited computational resources. Despite the development of novel pruning methods toward…

Computer Vision and Pattern Recognition · Computer Science 2023-06-27 Morteza Homayounfar , Mohamad Koohi-Moghadam , Reza Rawassizadeh , Varut Vardhanabhuti

When modeling class-imbalanced data, it is crucial to address the imbalance, as models trained on such data tend to be biased towards the majority classes. This problem is amplified under partial supervision, where pseudo-labels for…

Machine Learning · Statistics 2026-05-08 Heegeon Yoon , Heeyoung Kim

Biomedical data are widely accepted in developing prediction models for identifying a specific tumor, drug discovery and classification of human cancers. However, previous studies usually focused on different classifiers, and overlook the…

Quantitative Methods · Quantitative Biology 2019-11-05 Shigang Liu , Jun Zhang , Yang Xiang , Wanlei Zhou , Dongxi Xiang

This paper deals with an extension of the Support Vector Machine (SVM) for classification problems where, in addition to maximize the margin, i.e., the width of strip defined by the two supporting hyperplanes, the minimum of the ordered…

Optimization and Control · Mathematics 2021-07-15 Alfredo Marín , Luisa I. Martínez-Merino , Justo Puerto , Antonio M. Rodríguez-Chía

Anomaly detection is defined as the problem of finding data points that do not follow the patterns of the majority. Among the various proposed methods for solving this problem, classification-based methods, including one-class Support…

Optimization and Control · Mathematics 2023-12-05 Amir Hossein Noormohammadia , Seyed Ali MirHassania , Farnaz Hooshmand Khaligh

Semantic segmentation datasets often exhibit two types of imbalance: \textit{class imbalance}, where some classes appear more frequently than others and \textit{size imbalance}, where some objects occupy more pixels than others. This causes…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Zifu Wang , Maxim Berman , Amal Rannen-Triki , Philip H. S. Torr , Devis Tuia , Tinne Tuytelaars , Luc Van Gool , Jiaqian Yu , Matthew B. Blaschko

Data imbalance, that is the disproportion between the number of training observations coming from different classes, remains one of the most significant challenges affecting contemporary machine learning. The negative impact of data…

Machine Learning · Computer Science 2021-11-30 Michał Koziarski

Partial Bayesian neural networks (pBNNs) have been shown to perform competitively with fully Bayesian neural networks while only having a subset of the parameters be stochastic. Using sequential Monte Carlo (SMC) samplers as the inference…

Machine Learning · Computer Science 2026-01-30 Andrew Millard , Joshua Murphy , Simon Maskell , Zheng Zhao