English
Related papers

Related papers: Cardinality-Aware Set Prediction and Top-$k$ Class…

200 papers

Aligning the decision-making process of machine learning algorithms with that of experienced radiologists is crucial for reliable diagnosis. While existing methods have attempted to align their diagnosis behaviors to those of radiologists…

Machine Learning · Computer Science 2025-02-10 Mingzhou Liu , Ching-Wen Lee , Xinwei Sun , Yu Qiao , Yizhou Wang

We consider the problem of training probabilistic conditional random fields (CRFs) in the context of a task where performance is measured using a specific loss function. While maximum likelihood is the most common approach to training CRFs,…

Machine Learning · Statistics 2015-03-19 Maksims N. Volkovs , Hugo Larochelle , Richard S. Zemel

Most algorithms in classical and contemporary machine learning focus on correlation-based dependence between features to drive performance. Although success has been observed in many relevant problems, these algorithms fail when the…

Machine Learning · Computer Science 2021-10-26 Moritz Willig , Matej Zečević , Devendra Singh Dhami , Kristian Kersting

Cardinality estimation has long been grounded in statistical tools for density estimation. To capture the rich multivariate distributions of relational tables, we propose the use of a new type of high-capacity statistical model: deep…

Academic performance prediction aims to leverage student-related information to predict their future academic outcomes, which is beneficial to numerous educational applications, such as personalized teaching and academic early warning. In…

Machine Learning · Computer Science 2021-07-23 Chaoran Cui , Jian Zong , Yuling Ma , Xinhua Wang , Lei Guo , Meng Chen , Yilong Yin

We study the problem of multiset prediction. The goal of multiset prediction is to train a predictor that maps an input to a multiset consisting of multiple items. Unlike existing problems in supervised learning, such as classification,…

Machine Learning · Computer Science 2018-10-29 Sean Welleck , Zixin Yao , Yu Gai , Jialin Mao , Zheng Zhang , Kyunghyun Cho

In this paper, we focus on developing efficient sensitivity analysis methods for a computationally expensive objective function $f(x)$ in the case that the minimization of it has just been performed. Here "computationally expensive" means…

Machine Learning · Statistics 2015-02-24 Yilun Wang , Christine A. Shoemaker

Credal sets are sets of probability distributions that are considered as candidates for an imprecisely known ground-truth distribution. In machine learning, they have recently attracted attention as an appealing formalism for uncertainty…

Machine Learning · Statistics 2024-02-19 Alireza Javanmardi , David Stutz , Eyke Hüllermeier

Though black-box predictors are state-of-the-art for many complex tasks, they often fail to properly quantify predictive uncertainty and may provide inappropriate predictions for unfamiliar data. Instead, we can learn more reliable models…

Machine Learning · Statistics 2021-12-14 Jean Feng , Arjun Sondhi , Jessica Perry , Noah Simon

Conformal prediction is a learning framework controlling prediction coverage of prediction sets, which can be built on any learning algorithm for point prediction. This work proposes a learning framework named conformal loss-controlling…

Machine Learning · Computer Science 2024-01-24 Di Wang , Ping Wang , Zhong Ji , Xiaojun Yang , Hongyue Li

We propose the Linearly Adaptive Cross Entropy Loss function. This is a novel measure derived from the information theory. In comparison to the standard cross entropy loss function, the proposed one has an additional term that depends on…

Machine Learning · Computer Science 2025-07-16 Jae Wan Shim

We define a new class of set functions that in addition to being monotone and subadditive, also admit a very limited form of submodularity defined over a permutation of the ground set. We refer to this permutation as a submodular order.…

Optimization and Control · Mathematics 2024-03-01 Rajan Udwani

Prediction sets capture uncertainty by predicting sets of labels rather than individual labels, enabling downstream decisions to conservatively account for all plausible outcomes. Conformal inference algorithms construct prediction sets…

Machine Learning · Statistics 2023-10-20 Wenwen Si , Sangdon Park , Insup Lee , Edgar Dobriban , Osbert Bastani

We introduce a "learning-based" algorithm for the low-rank decomposition problem: given an $n \times d$ matrix $A$, and a parameter $k$, compute a rank-$k$ matrix $A'$ that minimizes the approximation loss $\|A-A'\|_F$. The algorithm uses a…

Machine Learning · Computer Science 2019-10-31 Piotr Indyk , Ali Vakilian , Yang Yuan

Bayesian decision theory provides an elegant framework for acting optimally under uncertainty when tractable posterior distributions are available. Modern Bayesian models, however, typically involve intractable posteriors that are…

Machine Learning · Computer Science 2021-06-15 Meet P. Vadera , Soumya Ghosh , Kenney Ng , Benjamin M. Marlin

We consider neural network training, in applications in which there are many possible classes, but at test-time, the task is a binary classification task of determining whether the given example belongs to a specific class, where the class…

Machine Learning · Statistics 2018-09-18 Gil Keren , Sivan Sabato , Björn Schuller

We develop a novel approach to conformal prediction when the target task has limited data available for training. Conformal prediction identifies a small set of promising output candidates in place of a single prediction, with guarantees…

Machine Learning · Computer Science 2021-07-21 Adam Fisch , Tal Schuster , Tommi Jaakkola , Regina Barzilay

Evaluation metrics in machine learning are often hardly taken as loss functions, as they could be non-differentiable and non-decomposable, e.g., average precision and F1 score. This paper aims to address this problem by revisiting the…

Machine Learning · Computer Science 2022-03-01 Tao Huang , Zekang Li , Hua Lu , Yong Shan , Shusheng Yang , Yang Feng , Fei Wang , Shan You , Chang Xu

In this paper, we develop upon the topic of loss function learning, an emergent meta-learning paradigm that aims to learn loss functions that significantly improve the performance of the models trained under them. Specifically, we propose a…

Neural and Evolutionary Computing · Computer Science 2024-03-05 Christian Raymond , Qi Chen , Bing Xue , Mengjie Zhang

In this paper, we propose a new deep neural network classifier that simultaneously maximizes the inter-class separation and minimizes the intra-class variation by using the polyhedral conic classification function. The proposed method has…

Computer Vision and Pattern Recognition · Computer Science 2021-02-26 Hakan Cevikalp , Bedirhan Uzun , Okan Köpüklü , Gurkan Ozturk