中文
相关论文

相关论文: Online AUC Optimization Based on Second-order Surr…

200 篇论文

The Area Under the ROC Curve (AUC) is a widely used performance metric for binary classifiers. However, as a global ranking statistic, the AUC aggregates model behavior over the entire dataset, masking localized weaknesses in specific…

应用统计 · 统计学 2025-08-12 Agus Sudjianto , Alice J. Liu

Deep neural networks provide effective solutions to small-footprint keyword spotting (KWS). However, if training data is limited, it remains challenging to achieve robust and highly accurate KWS in real-world scenarios where unseen sounds…

音频与语音处理 · 电气工程与系统科学 2021-07-14 Menglong Xu , Shengqiang Li , Chengdong Liang , Xiao-Lei Zhang

Recent studies have empirically investigated different methods to train stochastic neural networks on a classification task by optimising a PAC-Bayesian bound via stochastic gradient descent. Most of these procedures need to replace the…

机器学习 · 计算机科学 2022-07-01 Eugenio Clerico , George Deligiannidis , Arnaud Doucet

Modern machine learning approaches to classification, including AdaBoost, support vector machines, and deep neural networks, utilize surrogate loss techniques to circumvent the computational complexity of minimizing empirical classification…

计量经济学 · 经济学 2023-07-26 Toru Kitagawa , Shosei Sakaguchi , Aleksey Tetenov

The area under the ROC curve (AUC) is one of the most widely used performance measures for classification models in machine learning. However, it summarizes the true positive rates (TPRs) over all false positive rates (FPRs) in the ROC…

机器学习 · 计算机科学 2022-10-28 Yao Yao , Qihang Lin , Tianbao Yang

Receiver operating characteristic (ROC) curve is an informative tool in binary classification and Area Under ROC Curve (AUC) is a popular metric for reporting performance of binary classifiers. In this paper, first we present a…

机器学习 · 计算机科学 2021-09-14 Khashayar Namdar , Masoom A. Haider , Farzad Khalvati

The predictive quality of machine learning models is typically measured in terms of their (approximate) expected prediction error or the so-called Area Under the Curve (AUC) for a particular data distribution. However, when the models are…

机器学习 · 计算机科学 2018-02-08 Hiva Ghanbari , Katya Scheinberg

Maximizing the area under the receiver operating characteristic curve (AUC) is a standard approach to imbalanced classification. So far, various supervised AUC optimization methods have been developed and they are also extended to…

机器学习 · 统计学 2022-04-12 Tomoya Sakai , Gang Niu , Masashi Sugiyama

Recently, several universal methods have been proposed for online convex optimization, and attain minimax rates for multiple types of convex functions simultaneously. However, they need to design and optimize one surrogate loss for each…

机器学习 · 计算机科学 2024-11-21 Lijun Zhang , Yibo Wang , Guanghui Wang , Jinfeng Yi , Tianbao Yang

In offline data-driven multi-objective optimization (MOO), optimization is performed using surrogate models trained only on an offline dataset. These surrogate models contain inherent errors and uncertainty. This epistemic uncertainty can…

神经与进化计算 · 计算机科学 2026-04-30 Huanbo Lyu , Miqing Li , Shiqiao Zhou , Daniel Herring , Jelena Ninic , Zheming Zuo , Lingfeng Wang , James Andrews , Fabian Spill , Shuo Wang

Active learning is a type of sequential design for supervised machine learning, in which the learning algorithm sequentially requests the labels of selected instances from a large pool of unlabeled data points. The objective is to produce a…

统计理论 · 数学 2019-11-14 Steve Hanneke , Liu Yang

We study online convex optimization in the random order model, recently proposed by \citet{garber2020online}, where the loss functions may be chosen by an adversary, but are then presented to the online algorithm in a uniformly random…

机器学习 · 计算机科学 2021-06-30 Uri Sherman , Tomer Koren , Yishay Mansour

Predicting model performance at larger scales enables the design of training strategies and architectures tailored to specific performance targets. Empirical scaling law research identifies functional forms to aid this prediction task.…

机器学习 · 计算机科学 2026-05-26 Viktoria Schram , Markus Hiller , Daniel Beck , Trevor Cohn

Learning to optimize the area under the receiver operating characteristics curve (AUC) performance for imbalanced data has attracted much attention in recent years. Although there have been several methods of AUC optimization, scaling up…

机器学习 · 计算机科学 2024-10-28 Chao Wang , Kai Wu , Jing Liu

The area under the receiver operating characteristic curve (AUC) is often used to evaluate the performance of clinical prediction models. Recently, a more refined strategy has been proposed to examine a partial area under the curve (pAUC),…

应用统计 · 统计学 2016-06-22 Travis Gerke , Svitlana Tyekucheva , Lorelei Mucci , Giovanni Parmigiani

Pairwise learning, an important domain within machine learning, addresses loss functions defined on pairs of training examples, including those in metric learning and AUC maximization. Acknowledging the quadratic growth in computation…

机器学习 · 计算机科学 2024-02-05 Hilal AlQuabeh , William de Vazelhes , Bin Gu

We study the inventory placement problem of splitting $Q$ units of a single item across warehouses in advance of a downstream online matching problem that represents the dynamic fulfillment decisions of an e-commerce retailer. This is a…

数据结构与算法 · 计算机科学 2025-05-06 Boris Epstein , Will Ma

Solving optimization problems with unknown parameters often requires learning a predictive model to predict the values of the unknown parameters and then solving the problem using these values. Recent work has shown that including the…

机器学习 · 计算机科学 2020-10-23 Kai Wang , Bryan Wilder , Andrew Perrault , Milind Tambe

The pairwise objective paradigms are an important and essential aspect of machine learning. Examples of machine learning approaches that use pairwise objective functions include differential network in face recognition, metric learning,…

机器学习 · 计算机科学 2022-10-04 Hilal AlQuabeh , Aliakbar Abdurahimov

In this paper, we propose systematic and efficient gradient-based methods for both one-way and two-way partial AUC (pAUC) maximization that are applicable to deep learning. We propose new formulations of pAUC surrogate objectives by using…

机器学习 · 计算机科学 2023-09-19 Dixian Zhu , Gang Li , Bokun Wang , Xiaodong Wu , Tianbao Yang