English
Related papers

Related papers: Regularization-Based Methods for Ordinal Quantific…

200 papers

This paper provides both an introduction to and a detailed overview of the principles and practice of classifier calibration. A well-calibrated classifier correctly quantifies the level of uncertainty or confidence associated with its…

Machine Learning · Computer Science 2023-06-16 Telmo Silva Filho , Hao Song , Miquel Perello-Nieto , Raul Santos-Rodriguez , Meelis Kull , Peter Flach

There is a mismatch between the standard theoretical analyses of statistical machine learning and how learning is used in practice. The foundational assumption supporting the theory is that we can represent features and models using…

Machine Learning · Computer Science 2019-05-29 Annie Cherkaev , Waiming Tai , Jeff Phillips , Vivek Srikumar

Much as replacing hand-designed features with learned functions has revolutionized how we solve perceptual tasks, we believe learned algorithms will transform how we train models. In this work we focus on general-purpose learned optimizers…

Machine Learning · Computer Science 2020-09-24 Luke Metz , Niru Maheswaranathan , C. Daniel Freeman , Ben Poole , Jascha Sohl-Dickstein

This paper explores the process of optimal quantization for several types of discrete probability distributions. Quantization is a technique used to approximate a complex distribution with a smaller set of representative points, which is…

Probability · Mathematics 2025-07-16 Russel Cabasag , Samir Huq , Eric Mendoza , Mrinal Kanti Roychowdhury

Most classification methods provide either a prediction of class membership or an assessment of class membership probability. In the case of two-group classification the predicted probability can be described as "risk" of belonging to a…

Machine Learning · Statistics 2011-10-28 Yizhar Toren

As data volume grows extensively, data profiling helps to extract metadata of large-scale data. However, one kind of metadata, order statistics, is difficult to be computed because they are not mergeable or incremental. Thus, the limitation…

Data Structures and Algorithms · Computer Science 2020-06-29 Zhiwei Chen , Aoqian Zhang

Machine learning models suffer from overfitting, which is caused by a lack of labeled data. To tackle this problem, we proposed a framework of regularization methods, called density-fixing, that can be used commonly for supervised and…

Machine Learning · Computer Science 2020-09-08 Masanari Kimura , Ryohei Izawa

Quantification is a supervised learning task that consists in predicting, given a set of classes C and a set D of unlabelled items, the prevalence (or relative frequency) p(c|D) of each class c in C. Quantification can in principle be…

Machine Learning · Computer Science 2021-09-22 Andrea Esuli , Alejandro Moreo Fernández , Fabrizio Sebastiani

We propose and analyze a regularization approach for structured prediction problems. We characterize a large class of loss functions that allows to naturally embed structured outputs in a linear space. We exploit this fact to design…

Machine Learning · Computer Science 2017-07-31 Carlo Ciliberto , Alessandro Rudi , Lorenzo Rosasco

Network quantification (NQ) is the problem of estimating the proportions of nodes belonging to each class in subsets of unlabelled graph nodes. When prior probability shift is at play, this task cannot be effectively addressed by first…

Machine Learning · Computer Science 2025-11-14 Alessio Micheli , Alejandro Moreo , Marco Podda , Fabrizio Sebastiani , William Simoni , Domenico Tortorella

We consider training probabilistic classifiers in the case of a large number of classes. The number of classes is assumed too large to perform exact normalisation over all classes. To account for this we consider a simple approach that…

Machine Learning · Statistics 2016-07-08 David Barber , Aleksandar Botev

Parameter identification problems typically consist of a model equation, e.g. a (system of) ordinary or partial differential equation(s), and the observation equation. In the conventional reduced setting, the model equation is eliminated…

Numerical Analysis · Mathematics 2016-03-18 Barbara Kaltenbacher

The aim of ordinal classification is to predict the ordered labels of the output from a set of observed inputs. Interval-valued data refers to data in the form of intervals. For the first time, interval-valued data and interval-valued…

Methodology · Statistics 2023-11-06 Aleix Alcacer , Marina Martínez-Garcia , Irene Epifanio

The goal of regression and classification methods in supervised learning is to minimize the empirical risk, that is, the expectation of some loss function quantifying the prediction error under the empirical distribution. When facing scarce…

Optimization and Control · Mathematics 2019-07-15 Soroosh Shafieezadeh-Abadeh , Daniel Kuhn , Peyman Mohajerin Esfahani

To quantify single mode nonclassicality, we start from an operational approach. A positive semi-definite observable is introduced to describe a measurement setup. The quantification is based on the negativity of the normally ordered version…

Quantum Physics · Physics 2012-11-29 C. Gehrke , J. Sperling , W. Vogel

Many key problems in machine learning and data science are routinely modeled as optimization problems and solved via optimization algorithms. With the increase of the volume of data and the size and complexity of the statistical models used…

Optimization and Control · Mathematics 2020-08-28 Filip Hanzely

When the distribution of the data used to train a classifier differs from that of the test data, i.e., under dataset shift, well-established routines for calibrating the decision scores of the classifier, estimating the proportion of…

Machine Learning · Computer Science 2025-05-19 Alejandro Moreo

Causal discovery for purely observational, categorical data is a long-standing challenging problem. Unlike continuous data, the vast majority of existing methods for categorical data focus on inferring the Markov equivalence class only,…

Methodology · Statistics 2022-12-20 Yang Ni , Bani Mallick

This thesis makes considerable contributions to the realm of machine learning, specifically in the context of open-world scenarios where systems face previously unseen data and contexts. Traditional machine learning models are usually…

Machine Learning · Computer Science 2023-10-11 Yiyou Sun

Ordinal regression is aimed at predicting an ordinal class label. In this paper, we consider its semi-supervised formulation, in which we have unlabeled data along with ordinal-labeled data to train an ordinal regressor. There are several…

Machine Learning · Computer Science 2021-06-11 Taira Tsuchiya , Nontawat Charoenphakdee , Issei Sato , Masashi Sugiyama