English
Related papers

Related papers: Monotone Classification with Relative Approximatio…

200 papers

We consider the basic problem of learning Single-Index Models with respect to the square loss under the Gaussian distribution in the presence of adversarial label noise. Our main contribution is the first computationally efficient algorithm…

Machine Learning · Computer Science 2025-08-07 Puqian Wang , Nikos Zarifis , Ilias Diakonikolas , Jelena Diakonikolas

The selection of the best classification algorithm for a given dataset is a very widespread problem. It is also a complex one, in the sense it requires to make several important methodological choices. Among them, in this work we focus on…

Machine Learning · Computer Science 2012-07-18 Vincent Labatut , Hocine Cherifi

Monotonicity is a simple yet significant qualitative characteristic. We consider the problem of segmenting an array in up to K segments. We want segments to be as monotonic as possible and to alternate signs. We propose a quality metric for…

Data Structures and Algorithms · Computer Science 2007-05-23 Daniel Lemire , Martin Brooks , Yuhong Yan

The performance of a machine learning system is usually evaluated by using i.i.d.\ observations with true labels. However, acquiring ground truth labels is expensive, while obtaining unlabeled samples may be cheaper. Stratified sampling can…

Machine Learning · Computer Science 2019-07-29 Tiancheng Yu , Xiyu Zhai , Suvrit Sra

Financial institutions face a trade-off between predictive accuracy and interpretability when deploying machine learning models for credit risk. Monotonicity constraints align model behavior with domain knowledge, but their performance cost…

Machine Learning · Computer Science 2026-03-17 Petr Koklev

We consider the problem of learning a non-negative linear classifier with a $1$-norm of at most $k$, and a fixed threshold, under the hinge-loss. This problem generalizes the problem of learning a $k$-monotone disjunction. We prove that we…

Machine Learning · Statistics 2016-04-19 Sivan Sabato , Shai Shalev-Shwartz , Nathan Srebro , Daniel Hsu , Tong Zhang

We study functions $f : [0, 1]^d \rightarrow [0, 1]^d$ that are both monotone and contracting, and we consider the problem of finding an $\varepsilon$-approximate fixed point of $f$. We show that the problem lies in the complexity class…

Computational Complexity · Computer Science 2025-03-28 Eleni Batziou , John Fearnley , Spencer Gordon , Ruta Mehta , Rahul Savani

Compared with multi-class classification, multi-label classification that contains more than one class is more suitable in real life scenarios. Obtaining fully labeled high-quality datasets for multi-label classification problems, however,…

Computer Vision and Pattern Recognition · Computer Science 2022-10-26 Xin Zhang , Rabab Abdelfattah , Yuqi Song , Xiaofeng Wang

Estimating a constrained relation is a fundamental problem in machine learning. Special cases are classification (the problem of estimating a map from a set of to-be-classified elements to a set of labels), clustering (the problem of…

Machine Learning · Computer Science 2014-08-06 Lizhen Qu , Bjoern Andres

Monotonicity is a simple yet significant qualitative characteristic. We consider the problem of segmenting a sequence in up to K segments. We want segments to be as monotonic as possible and to alternate signs. We propose a quality metric…

Databases · Computer Science 2009-09-01 Daniel Lemire , Martin Brooks , Yuhong Yan

In this article, we develop methods for estimating a low rank tensor from noisy observations on a subset of its entries to achieve both statistical and computational efficiencies. There have been a lot of recent interests in this problem of…

Machine Learning · Statistics 2018-03-21 Dong Xia , Ming Yuan , Cun-Hui Zhang

This work demonstrates a methodology for using deep learning to discover simple, practical criteria for classifying matrices based on abstract algebraic properties. By combining a high-performance neural network with explainable AI (XAI)…

Machine Learning · Computer Science 2025-07-31 Leandro Farina , Sergey Korotov

Estimating the linear dimensionality of a data set in the presence of noise is a common problem. However, data may also be corrupted by monotone nonlinear distortion that preserves the ordering of matrix entries but causes linear methods…

Combinatorics · Mathematics 2024-01-01 Caitlin Lienkaemper

We consider a large family of problems in which an ordering (or, more precisely, a chain of subsets) of a finite set must be chosen to minimize some weighted sum of costs. This family includes variations of Min Sum Set Cover (MSSC), several…

Data Structures and Algorithms · Computer Science 2021-06-28 Felix Happach , Lisa Hellerstein , Thomas Lidbetter

In this paper, we address the top-$K$ ranking problem with a monotone adversary. We consider the scenario where a comparison graph is randomly generated and the adversary is allowed to add arbitrary edges. The statistician's goal is then to…

Machine Learning · Statistics 2024-06-21 Yuepeng Yang , Antares Chen , Lorenzo Orecchia , Cong Ma

We consider the problem of clustering in the learning-augmented setting, where we are given a data set in $d$-dimensional Euclidean space, and a label for each data point given by an oracle indicating what subsets of points should be…

Machine Learning · Computer Science 2023-03-02 Thy Nguyen , Anamay Chaturvedi , Huy Lê Nguyen

Sequential testing problems involve a complex system with several components, each of which is "working" with some independent probability. The outcome of each component can be determined by performing a test, which incurs some cost. The…

Data Structures and Algorithms · Computer Science 2023-08-22 Rohan Ghuge , Anupam Gupta , Viswanath Nagarajan

The top-k error is a common measure of performance in machine learning and computer vision. In practice, top-k classification is typically performed with deep neural networks trained with the cross-entropy loss. Theoretical results indeed…

Machine Learning · Computer Science 2018-02-22 Leonard Berrada , Andrew Zisserman , M. Pawan Kumar

Let $E = L_p, \; 1<p\leq 2,$ and $A : E \to E^*$ be a bounded monotone map such that $0 \in R(A)$. In this paper, we introduce and study an algorithm for approximating zeros of $A$. Furthermore, we study the application of this algorithm to…

Functional Analysis · Mathematics 2022-08-18 Abdulmalik U. Bello , Markjoe O. Uba , Michael T. Omojola , Maria A. Onyido , Cyril I. Udeani

The cost functions considered are $c(x,y)=h(x-y)$, where $h\in C^2(\mathbb{R}^n)$, homogeneous of degree $p\geq 2$, with a positive definite Hessian in the unit sphere. We study multivalued monotone maps with respect to that cost and…

Analysis of PDEs · Mathematics 2024-06-04 Cristian E. Gutierrez , Annamaria Montanari