中文
相关论文

相关论文: Label Distributionally Robust Losses for Multi-cla…

200 篇论文

Many machine learning tasks involve subpopulation shift where the testing data distribution is a subpopulation of the training distribution. For such settings, a line of recent work has proposed the use of a variant of empirical risk…

机器学习 · 计算机科学 2021-06-14 Runtian Zhai , Chen Dan , J. Zico Kolter , Pradeep Ravikumar

We propose a framework for learning calibrated uncertainties under domain shifts, where the source (training) distribution differs from the target (test) distribution. We detect such domain shifts via a differentiable density ratio…

机器学习 · 计算机科学 2024-02-07 Haoxuan Wang , Zhiding Yu , Yisong Yue , Anima Anandkumar , Anqi Liu , Junchi Yan

Label Distribution Learning (LDL) is a novel machine learning paradigm that addresses the problem of label ambiguity and has found widespread applications. Obtaining complete label distributions in real-world scenarios is challenging, which…

机器学习 · 计算机科学 2024-10-18 Zhiqiang Kou , Haoyuan Xuan , Jing Wang , Yuheng Jia , Xin Geng

What is the role of unlabeled data in an inference problem, when the presumed underlying distribution is adversarially perturbed? To provide a concrete answer to this question, this paper unifies two major learning frameworks:…

机器学习 · 统计学 2019-05-31 Amir Najafi , Shin-ichi Maeda , Masanori Koyama , Takeru Miyato

Using unlabeled wild data containing both in-distribution (ID) and out-of-distribution (OOD) data to improve the safety and reliability of models has recently received increasing attention. Existing methods either design customized losses…

机器学习 · 计算机科学 2025-05-20 Chuanxing Geng , Qifei Li , Xinrui Wang , Dong Liang , Songcan Chen , Pong C. Yuen

Recently, (Blanchet, Kang, and Murhy 2016, and Blanchet, and Kang 2017) showed that several machine learning algorithms, such as square-root Lasso, Support Vector Machines, and regularized logistic regression, among many others, can be…

机器学习 · 统计学 2020-02-25 Jose Blanchet , Yang Kang , Fan Zhang , Karthyek Murthy

Task-free continual learning (CL) aims to learn a non-stationary data stream without explicit task definitions and not forget previous knowledge. The widely adopted memory replay approach could gradually become less effective for long data…

机器学习 · 计算机科学 2022-08-23 Zhenyi Wang , Li Shen , Le Fang , Qiuling Suo , Tiehang Duan , Mingchen Gao

We develop Distributionally Robust Optimization (DRO) formulations for Multivariate Linear Regression (MLR) and Multiclass Logistic Regression (MLG) when both the covariates and responses/labels may be contaminated by outliers. The DRO…

机器学习 · 统计学 2020-06-12 Ruidi Chen , Ioannis Ch. Paschalidis

Off-policy evaluation and learning (OPE/L) use offline observational data to make better decisions, which is crucial in applications where online experimentation is limited. However, depending entirely on logged data, OPE/L is sensitive to…

机器学习 · 计算机科学 2022-07-19 Nathan Kallus , Xiaojie Mao , Kaiwen Wang , Zhengyuan Zhou

Semantic overlap among land-cover categories, highly imbalanced label distributions, and complex inter-class co-occurrence patterns constitute significant challenges for multi-label remote-sensing image retrieval. In this article,…

计算机视觉与模式识别 · 计算机科学 2026-04-07 Amna Amir , Erchan Aptoula

Distance metric learning (DML) approaches learn a transformation to a representation space where distance is in correspondence with a predefined notion of similarity. While such models offer a number of compelling benefits, it has been…

机器学习 · 统计学 2016-03-03 Oren Rippel , Manohar Paluri , Piotr Dollar , Lubomir Bourdev

Deep neural networks are highly susceptible to overfitting noisy labels, which leads to degraded performance. Existing methods address this issue by employing manually defined criteria, aiming to achieve optimal partitioning in each…

计算机视觉与模式识别 · 计算机科学 2025-02-04 Wenzhen Zhang , Debo Cheng , Guangquan Lu , Bo Zhou , Jiaye Li , Shichao Zhang

We introduce a novel loss function for training deep learning architectures to perform classification. It consists in minimizing the smoothness of label signals on similarity graphs built at the output of the architecture. Equivalently, it…

机器学习 · 计算机科学 2019-05-02 Myriam Bontonou , Carlos Lassance , Ghouthi Boukli Hacene , Vincent Gripon , Jian Tang , Antonio Ortega

Despite the great success of deep learning in stereo matching, recovering accurate disparity maps is still challenging. Currently, L1 and cross-entropy are the two most widely used losses for stereo network training. Compared with the…

计算机视觉与模式识别 · 计算机科学 2024-03-18 Peng Xu , Zhiyu Xiang , Chenyu Qiao , Jingyun Fu , Tianyu Pu

Our goal is to improve reliability of Machine Learning (ML) systems deployed in the wild. ML models perform exceedingly well when test examples are similar to train examples. However, real-world applications are required to perform on any…

机器学习 · 计算机科学 2023-03-07 Vihari Piratla

Data-driven Distributionally Robust Optimization (DD-DRO) via optimal transport has been shown to encompass a wide range of popular machine learning algorithms. The distributional uncertainty size is often shown to correspond to the…

机器学习 · 统计学 2021-05-12 Jose Blanchet , Yang Kang , Fan Zhang , Fei He , Zhangyi Hu

The acquisition of high-quality labeled synthetic aperture radar (SAR) data is challenging due to the demanding requirement for expert knowledge. Consequently, the presence of unreliable noisy labels is unavoidable, which results in…

计算机视觉与模式识别 · 计算机科学 2025-08-12 Yimin Fu , Zhunga Liu , Dongxiu Guo , Longfei Wang

In standard adversarial training, models are optimized to fit one-hot labels within allowable adversarial perturbation budgets. However, the ignorance of underlying distribution shifts brought by perturbations causes the problem of robust…

机器学习 · 计算机科学 2024-04-16 Yu-Yu Wu , Hung-Jui Wang , Shang-Tse Chen

(Partial) ranking loss is a commonly used evaluation measure for multi-label classification, which is usually optimized with convex surrogates for computational efficiency. Prior theoretical work on multi-label ranking mainly focuses on…

机器学习 · 计算机科学 2021-05-12 Guoqiang Wu , Chongxuan Li , Kun Xu , Jun Zhu

Loss functions play a pivotal role in optimizing recommendation models. Among various loss functions, Softmax Loss (SL) and Cosine Contrastive Loss (CCL) are particularly effective. Their theoretical connections and differences warrant…

信息检索 · 计算机科学 2025-06-19 Shengjia Zhang , Jiawei Chen , Changdong Li , Sheng Zhou , Qihao Shi , Yan Feng , Chun Chen , Can Wang