English
Related papers

Related papers: Consistent Structured Prediction with Max-Min Marg…

200 papers

This paper studies a Markov network model for unbalanced data, aiming to solve the problems of classification bias and insufficient minority class recognition ability of traditional machine learning models in environments with uneven class…

Machine Learning · Computer Science 2025-02-06 Junliang Du , Shiyu Dou , Bohuan Yang , Jiacheng Hu , Tai An

The ultimate goal of a supervised learning algorithm is to produce models constructed on the training data that can generalize well to new examples. In classification, functional margin maximization -- correctly classifying as many training…

Machine Learning · Computer Science 2020-01-29 Nikolaos Nikolaou , Henry Reeve , Gavin Brown

Logistic models are commonly used for binary classification tasks. The success of such models has often been attributed to their connection to maximum-likelihood estimators. It has been shown that gradient descent algorithm, when applied on…

Machine Learning · Statistics 2020-10-30 Fariborz Salehi , Ehsan Abbasi , Babak Hassibi

Algorithm designers typically assume that the input data is correct, and then proceed to find "optimal" or "sub-optimal" solutions using this input data. However this assumption of correct data does not always hold in practice, especially…

Machine Learning · Computer Science 2015-10-13 Hal Daumé , Samir Khuller , Manish Purohit , Gregory Sanders

Optimal margin Distribution Machine (ODM) is a newly proposed statistical learning framework rooting in the novel margin theory, which demonstrates better generalization performance than the traditional large margin based counterparts.…

Machine Learning · Computer Science 2023-06-13 Yilin Wang , Nan Cao , Teng Zhang , Xuanhua Shi , Hai Jin

Estimation of Markov Random Field and covariance models from high-dimensional data represents a canonical problem that has received a lot of attention in the literature. A key assumption, widely employed, is that of {\em sparsity} of the…

Optimization and Control · Mathematics 2018-05-16 Davoud Ataee Tarzanagh , George Michailidis

Recently there is a large amount of work devoted to the study of Markov chain stochastic gradient methods (MC-SGMs) which mainly focus on their convergence analysis for solving minimization problems. In this paper, we provide a…

Machine Learning · Statistics 2022-09-19 Puyu Wang , Yunwen Lei , Yiming Ying , Ding-Xuan Zhou

Structural support vector machines (SSVMs) are amongst the best performing models for structured computer vision tasks, such as semantic image segmentation or human pose estimation. Training SSVMs, however, is computationally costly,…

Machine Learning · Computer Science 2014-11-19 Neel Shah , Vladimir Kolmogorov , Christoph H. Lampert

Tackling pattern recognition problems in areas such as computer vision, bioinformatics, speech or text recognition is often done best by taking into account task-specific statistical relations between output variables. In structured…

Machine Learning · Statistics 2016-03-14 Rein Houthooft , Filip De Turck

In structured output learning, obtaining labelled data for real-world applications is usually costly, while unlabelled examples are available in abundance. Semi-supervised structured classification has been developed to handle large amounts…

Machine Learning · Computer Science 2013-11-12 P. Balamurugan , Shirish Shevade , Sundararajan Sellamanickam

Localized support vector machines solve SVMs on many spatially defined small chunks and one of their main characteristics besides the computational benefit compared to global SVMs is the freedom of choosing arbitrary kernel and…

Statistics Theory · Mathematics 2019-09-27 Ingrid Blaschzyk , Ingo Steinwart

Markov networks are popular models for discrete multivariate systems where the dependence structure of the variables is specified by an undirected graph. To allow for more expressive dependence structures, several generalizations of Markov…

Methodology · Statistics 2021-03-30 Johan Pensar , Henrik Nyman , Jukka Corander

In this paper, we propose a new max-margin based discriminative feature learning method. Specifically, we aim at learning a low-dimensional feature representation, so as to maximize the global margin of the data and make the samples from…

Machine Learning · Computer Science 2017-04-04 Changsheng Li , Qingshan Liu , Weishan Dong , Xin Zhang , Lin Yang

We propose a novel criterion for support vector machine learning: maximizing the margin in the input space, not in the feature (Hilbert) space. This criterion is a discriminative version of the principal curve proposed by Hastie et al. The…

Artificial Intelligence · Computer Science 2007-05-23 Shotaro Akaho

Many machine learning applications such as in vision, biology and social networking deal with data in high dimensions. Feature selection is typically employed to select a subset of features which im- proves generalization accuracy as well…

Machine Learning · Computer Science 2016-06-15 Yamuna Prasad , Dinesh Khandelwal , K. K. Biswas

We consider an online strategic classification problem where each arriving agent can manipulate their true feature vector to obtain a positive predicted label, while incurring a cost that depends on the amount of manipulation. The learner…

Machine Learning · Computer Science 2024-03-28 Lingqing Shen , Nam Ho-Nguyen , Khanh-Hung Giang-Tran , Fatma Kılınç-Karzan

The rank aggregation problem has received significant recent attention within the computer science community. Its applications today range far beyond the original aim of building metasearch engines to problems in machine learning,…

Discrete Mathematics · Computer Science 2015-10-06 Daniel Freund , David P. Williamson

The problem of online learning and optimization of unknown Markov jump affine models is considered. An online learning policy, referred to as Markovian simultaneous perturbations stochastic approximation (MSPSA), is proposed for two…

Information Theory · Computer Science 2016-05-10 Sevi Baltaoglu , Lang Tong , Qing Zhao

Structured prediction can be considered as a generalization of many standard supervised learning tasks, and is usually thought as a simultaneous prediction of multiple labels. One standard approach is to maximize a score function on the…

Machine Learning · Computer Science 2021-02-19 Kevin Bello , Asish Ghoshal , Jean Honorio

This work proposes a semantic segmentation network that produces high-quality uncertainty estimates in a single forward pass. We exploit general representations from foundation models and unlabelled datasets through a Masked Image Modeling…

Computer Vision and Pattern Recognition · Computer Science 2024-02-28 David S. W. Williams , Matthew Gadd , Paul Newman , Daniele De Martini