English
Related papers

Related papers: Ordering as privileged information

200 papers

We propose a method for variable selection and basis learning for high-dimensional classification with ordinal responses. The proposed method extends sparse multiclass linear discriminant analysis, with the aim of identifying not only the…

Methodology · Statistics 2025-02-17 Minwoo Kim , Sangil Han , Jeongyoun Ahn , Sungkyu Jung

Classical supervised learning via empirical risk (or negative log-likelihood) minimization hinges upon the assumption that the testing distribution coincides with the training distribution. This assumption can be challenged in modern…

Optimization and Control · Mathematics 2020-10-02 Yassine Laguel , Jérôme Malick , Zaid Harchaoui

Most work on supervised learning research has focused on marginal predictions. In decision problems, joint predictive distributions are essential for good performance. Previous work has developed methods for assessing low-order predictive…

Machine Learning · Statistics 2022-03-01 Ian Osband , Zheng Wen , Seyed Mohammad Asghari , Vikranth Dwaracherla , Xiuyuan Lu , Benjamin Van Roy

Reward design in reinforcement learning and optimal control is challenging. Preference-based alignment addresses this by enabling agents to learn rewards from ranked trajectory pairs provided by humans. However, existing methods often…

Machine Learning · Computer Science 2025-05-29 Zhixian Xie , Haode Zhang , Yizhe Feng , Wanxin Jin

Learning of interpretable classification models has been attracting much attention for the last few years. Discovery of succinct and contrasting patterns that can highlight the differences between the two classes is very important. Such…

Databases · Computer Science 2020-04-20 Hiroaki Iwashita , Takuya Takagi , Hirofumi Suzuki , Keisuke Goto , Kotaro Ohori , Hiroki Arimura

The Matrix-based Renyi's entropy enables us to directly measure information quantities from given data without the costly probability density estimation of underlying distributions, thus has been widely adopted in numerous statistical…

Machine Learning · Statistics 2022-05-17 Yuxin Dong , Tieliang Gong , Shujian Yu , Chen Li

Learning from Label Proportions (LLP) is a weakly supervised problem in which the training data comprise bags, that is, groups of instances, each annotated only with bag-level class label proportions, and the objective is to learn a…

Machine Learning · Computer Science 2026-03-24 Tianhao Ma , Ximing Li , Changchun Li , Renchu Guan

Minimization of the $L_\infty$ norm, which can be viewed as approximately solving the non-convex least median estimation problem, is a powerful method for outlier removal and hence robust regression. However, current techniques for solving…

Computer Vision and Pattern Recognition · Computer Science 2013-04-05 Fumin Shen , Chunhua Shen , Rhys Hill , Anton van den Hengel , Zhenmin Tang

Selecting appropriate regularization coefficients is critical to performance with respect to regularized empirical risk minimization problems. Existing theoretical approaches attempt to determine the coefficients in order for regularized…

Machine Learning · Computer Science 2019-09-05 Akihiro Yabe , Takanori Maehara

Optimization in engineering requires appropriate models. In this article, a regression method for enhancing the predictive power of a model by exploiting expert knowledge in the form of shape constraints, or more specifically, monotonicity…

Learning an ordering of items based on pairwise comparisons is useful when items are difficult to rate consistently on an absolute scale, for example, when annotators have to make subjective assessments. When exhaustive comparison is…

Machine Learning · Computer Science 2024-10-29 Herman Bergström , Emil Carlsson , Devdatt Dubhashi , Fredrik D. Johansson

We develop a method to generate prediction sets with a guaranteed coverage rate that is robust to corruptions in the training data, such as missing or noisy variables. Our approach builds on conformal prediction, a powerful framework to…

Machine Learning · Computer Science 2025-01-10 Shai Feldman , Yaniv Romano

We generalize standard credal set models for imprecise probabilities to include higher order credal sets -- confidences about confidences. In doing so, we specify how an agent's higher order confidences (credal sets) update upon observing…

Statistics Theory · Mathematics 2021-07-20 Justus Hibshman , Tim Weninger

In the absence of prior knowledge, ordinal embedding methods obtain new representation for items in a low-dimensional Euclidean space via a set of quadruple-wise comparisons. These ordinal comparisons often come from human annotators, and…

Machine Learning · Computer Science 2018-12-06 Ke Ma , Qianqian Xu , Zhiyong Yang , Xiaochun Cao

Research on the distribution of prime numbers has revealed a dual character: deterministic in definition yet exhibiting statistical behavior reminiscent of random processes. In this paper we show that it is possible to use an image-focused…

Many of the affect modelling tasks present an asymmetric distribution of information between training and test time; additional information is given about the training data, which is not available at test time. Learning under this setting…

Machine Learning · Computer Science 2021-08-13 Konstantinos Makantasis

Estimating consumer preferences is central to many problems in economics and marketing. This paper develops a flexible framework for learning individual preferences from partial ranking information by interpreting observed rankings as…

Machine Learning · Statistics 2026-02-19 Yu-Chang Chen , Chen Chian Fuh , Shang En Tsai

Weakly supervised text classification methods typically train a deep neural classifier based on pseudo-labels. The quality of pseudo-labels is crucial to final performance but they are inevitably noisy due to their heuristic nature, so…

Computation and Language · Computer Science 2022-10-26 Dheeraj Mekala , Chengyu Dong , Jingbo Shang

Preference orderings are orderings of a set of items according to the preferences (of judges). Such orderings arise in a variety of domains, including group decision making, consumer marketing, voting and machine learning. Measuring the…

Artificial Intelligence · Computer Science 2016-10-17 Zhiwei Lin , Hui Wang , Cees H. Elzinga

This article is devoted to the problem of predicting the value taken by a random permutation $\Sigma$, describing the preferences of an individual over a set of numbered items $\{1,\; \ldots,\; n\}$ say, based on the observation of an…

Statistics Theory · Mathematics 2017-12-20 Stephan Clémençon , Anna Korba , Eric Sibony