English
Related papers

Related papers: ZClassifier: Temperature Tuning and Manifold Appro…

200 papers

Multi-label classification (MLC) requires predicting multiple labels per sample, often under heavy class imbalance and noisy conditions. Traditional approaches apply fixed thresholds or treat labels independently, overlooking context and…

Machine Learning · Computer Science 2025-05-07 Dmytro Shamatrin

In this paper, we propose a simple yet effective contrastive knowledge distillation framework that achieves sample-wise logit alignment while preserving semantic consistency. Conventional knowledge distillation approaches exhibit…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Wencheng Zhu , Xin Zhou , Pengfei Zhu , Yu Wang , Qinghua Hu

The alignment of large language models (LLMs) with human values increasingly relies on using other LLMs as automated judges, or ``autoraters''. However, their reliability is limited by a foundational issue: they are trained on discrete…

Obtaining well-calibrated photometric redshift probability densities for galaxies without a spectroscopic measurement remains a challenge. Deep learning discriminative models, typically fed with multi-band galaxy images, can produce outputs…

Instrumentation and Methods for Astrophysics · Physics 2024-11-27 Qiufan Lin , Hengxin Ruan , Dominique Fouchez , Shupei Chen , Rui Li , Paulo Montero-Camacho , Nicola R. Napolitano , Yuan-Sen Ting , Wei Zhang

The stable operation of autonomous off-grid photovoltaic systems requires solar forecasting algorithms that respect atmospheric thermodynamics. Contemporary deep learning models consistently exhibit critical anomalies, primarily severe…

Machine Learning · Computer Science 2026-04-21 Mohammed Ezzaldin Babiker Abdullah

The confidence calibration of deep learning-based perception models plays a crucial role in their reliability. Especially in the context of autonomous driving, downstream tasks like prediction and planning depend on accurate confidence…

Computer Vision and Pattern Recognition · Computer Science 2023-08-07 Mariella Dreissig , Florian Piewak , Joschka Boedecker

LiDAR is playing a more and more essential role in autonomous driving vehicles for objection detection, self localization and mapping. A single LiDAR frequently suffers from hardware failure (e.g., temporary loss of connection) due to the…

Robotics · Computer Science 2020-07-06 Jiarong Lin , Xiyuan Liu , Fu Zhang

Diffusion models are a new class of generative models that revolve around the estimation of the score function associated with a stochastic differential equation. Subsequent to its acquisition, the approximated score function is then…

Statistics Theory · Mathematics 2024-09-13 Giovanni Conforti , Alain Durmus , Marta Gentiloni Silveri

Label smoothing (LS) adopts smoothed targets in classification tasks. For example, in binary classification, instead of the one-hot target $(1,0)^\top$ used in conventional logistic regression (LR), LR with LS (LSLR) uses the smoothed…

Machine Learning · Statistics 2023-05-16 Ryoya Yamasaki , Toshiyuki Tanaka

Generalized zero-shot learning (GZSL) aims at training a model that can generalize to unseen class data by only using auxiliary information. One of the main challenges in GZSL is a biased model prediction toward seen classes caused by…

Machine Learning · Computer Science 2022-03-09 Gukyeong Kwon , Ghassan AlRegib

Learning of low dimensional structure in multidimensional data is a canonical problem in machine learning. One common approach is to suppose that the observed data are close to a lower-dimensional smooth manifold. There are a rich variety…

Machine Learning · Statistics 2015-06-12 Ye Wang , David B. Dunson

Ensuring that classifiers are well-calibrated, i.e., their predictions align with observed frequencies, is a minimal and fundamental requirement for classifiers to be viewed as trustworthy. Existing methods for assessing multiclass…

Machine Learning · Computer Science 2025-10-30 Mahmoud Hegazy , Michael I. Jordan , Aymeric Dieuleveut

Classifiers trained with class-imbalanced data are known to perform poorly on test data of the "minor" classes, of which we have insufficient training data. In this paper, we investigate learning a ConvNet classifier under such a scenario.…

Machine Learning · Computer Science 2022-07-12 Han-Jia Ye , Hong-You Chen , De-Chuan Zhan , Wei-Lun Chao

In recent years, developing compact and efficient large language models (LLMs) has emerged as a thriving area of research. Traditional Supervised Fine-Tuning (SFT), which relies on singular ground truth labels, often fails to capture…

Machine Learning · Computer Science 2025-06-12 Jingyao Li , Senqiao Yang , Sitong Wu , Han Shi , Chuanyang Zheng , Hong Xu , Jiaya Jia

The long-tail distribution of the visual world poses great challenges for deep learning based classification models on how to handle the class imbalance problem. Existing solutions usually involve class-balancing strategies, e.g., by loss…

Computer Vision and Pattern Recognition · Computer Science 2020-02-20 Bingyi Kang , Saining Xie , Marcus Rohrbach , Zhicheng Yan , Albert Gordo , Jiashi Feng , Yannis Kalantidis

The Cosmic Linear Anisotropy Solving System (CLASS) is a new accurate Boltzmann code, designed to offer a more user-friendly and flexible coding environment to cosmologists. CLASS is very structured, easy to modify, and offers a rigorous…

Instrumentation and Methods for Astrophysics · Physics 2011-05-17 Julien Lesgourgues

In the domains of dataset construction and crowdsourcing, a notable challenge is to aggregate labels from a heterogeneous set of labelers, each of whom is potentially an expert in some subset of tasks (and less reliable in others). To…

Machine Learning · Computer Science 2021-01-07 Surin Ahn , Ayfer Ozgur , Mert Pilanci

With recent progress in large-scale map maintenance and long-term map learning, the task of change detection on a large-scale map from a visual image captured by a mobile robot has become a problem of increasing criticality. Previous…

Computer Vision and Pattern Recognition · Computer Science 2017-09-19 Tanaka Kanji

High-dimensional generative modeling is fundamentally a manifold-learning problem: real data concentrate near a low-dimensional structure embedded in the ambient space. Effective generators must therefore balance support fidelity -- placing…

Machine Learning · Statistics 2026-02-24 Xinyu Tian , Xiaotong Shen

Few-shot classification aims to adapt classifiers to novel classes with a few training samples. However, the insufficiency of training data may cause a biased estimation of feature distribution in a certain class. To alleviate this problem,…

Computer Vision and Pattern Recognition · Computer Science 2021-12-15 Jing Xu , Xinglin Pan , Xu Luo , Wenjie Pei , Zenglin Xu