English
Related papers

Related papers: Quality at the Tail of Machine Learning Inference

200 papers

Model efficiency is a critical aspect of developing and deploying machine learning models. Inference time and latency directly affect the user experience, and some applications have hard requirements. In addition to inference costs, model…

Machine Learning · Computer Science 2022-03-17 Mostafa Dehghani , Anurag Arnab , Lucas Beyer , Ashish Vaswani , Yi Tay

A typical trajectory planner of autonomous driving commonly relies on predicting the future behavior of surrounding obstacles. Recently, deep learning technology has been widely adopted to design prediction models due to their impressive…

Artificial Intelligence · Computer Science 2022-07-29 Weitao Zhou , Zhong Cao , Yunkang Xu , Nanshan Deng , Xiaoyu Liu , Kun Jiang , Diange Yang

The widespread integration of Machine Learning systems in daily life, particularly in high-stakes domains, has raised concerns about the fairness implications. While prior works have investigated static fairness measures, recent studies…

Machine Learning · Computer Science 2025-07-30 Usman Gohar , Zeyu Tang , Jialu Wang , Kun Zhang , Peter L. Spirtes , Yang Liu , Lu Cheng

We introduce a method to estimate simultaneously the tail and the threshold parameters of an extreme value regression model. This standard model finds its use in finance to assess the effect of market variables on extreme loss distributions…

Methodology · Statistics 2023-04-17 Julien Hambuckers , Marie Kratz , Antoine Usseglio-Carleve

Classification on long-tailed distributed data is a challenging problem, which suffers from serious class-imbalance and hence poor performance on tail classes with only a few samples. Owing to this paucity of samples, learning on the tail…

Computation and Language · Computer Science 2022-07-25 Taha ValizadehAslani , Yiwen Shi , Jing Wang , Ping Ren , Yi Zhang , Meng Hu , Liang Zhao , Hualou Liang

The world is long-tailed. What does this mean for computer vision and visual recognition? The main two implications are (1) the number of categories we need to consider in applications can be very large, and (2) the number of training…

Computer Vision and Pattern Recognition · Computer Science 2017-09-06 Grant Van Horn , Pietro Perona

Machine Translation Quality Estimation is a notoriously difficult task, which lessens its usefulness in real-world translation environments. Such scenarios can be improved if quality predictions are accompanied by a measure of uncertainty.…

Computation and Language · Computer Science 2016-07-01 Daniel Beck , Lucia Specia , Trevor Cohn

Machine learning classifiers often produce probabilistic predictions that are critical for accurate and interpretable decision-making in various domains. The quality of these predictions is generally evaluated with proper losses, such as…

Machine Learning · Computer Science 2025-06-26 Eugène Berta , David Holzmüller , Michael I. Jordan , Francis Bach

In the automotive industry, the full cycle of managing in-use vehicle quality issues can take weeks to investigate. The process involves isolating root causes, defining and implementing appropriate treatments, and refining treatments if…

Artificial Intelligence · Computer Science 2023-04-12 Qian Wang , Huanyi Shui , Thi Tu Trinh Tran , Milad Zafar Nezhad , Devesh Upadhyay , Kamran Paynabar , Anqi He

Long-tailed recognition is ubiquitous and challenging in deep learning and even in the downstream finetuning of foundation models, since the skew class distribution generally prevents the model generalization to the tail classes. Despite…

Machine Learning · Computer Science 2025-10-10 Jiaan Luo , Feng Hong , Qiang Hu , Xiaofeng Cao , Feng Liu , Jiangchao Yao

Convolutional neural networks have achieved great improvement on face recognition in recent years because of its extraordinary ability in learning discriminative features of people with different identities. To train such a well-designed…

Computer Vision and Pattern Recognition · Computer Science 2016-11-29 Xiao Zhang , Zhiyuan Fang , Yandong Wen , Zhifeng Li , Yu Qiao

For ordinary matrix models, the eigenvalue probability density decays rapidly as one goes to infinity, in other words, has "short tails". This ensures that all the multiple trace correlators (multipoint moments) are convergent and…

High Energy Physics - Theory · Physics 2021-12-15 A. Mironov , A. Morozov , A. Popolitov

Deep long-tailed learning, one of the most challenging problems in visual recognition, aims to train well-performing deep models from a large number of images that follow a long-tailed class distribution. In the last decade, deep learning…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Yifan Zhang , Bingyi Kang , Bryan Hooi , Shuicheng Yan , Jiashi Feng

In the past decade, Artificial Intelligence (AI) has become a part of our daily lives due to major advances in Machine Learning (ML) techniques. In spite of an explosive growth in the raw AI technology and in consumer facing applications on…

Software Engineering · Computer Science 2020-06-18 P. Santhanam

Deep learning enables impressive performance in image recognition using large-scale artificially-balanced datasets. However, real-world datasets exhibit highly class-imbalanced distributions, yielding two main challenges: relative imbalance…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Saurabh Sharma , Ning Yu , Mario Fritz , Bernt Schiele

Machine learning is making substantial progress in diverse applications. The success is mostly due to advances in deep learning. However, deep learning can make mistakes and its generalization abilities to new tasks are questionable. We ask…

Many random phenomena, including life-testing and environmental data, show positive values and excess zeros, which pose modeling challenges. In life testing, immediate failures result in zero lifetimes, often due to defects or poor quality,…

Methodology · Statistics 2026-02-06 Shivshankar Nila , Ishapathik Das , N. Balakrishna

Variational inference with {\alpha}-divergences has been widely used in modern probabilistic machine learning. Compared to Kullback-Leibler (KL) divergence, a major advantage of using {\alpha}-divergences (with positive {\alpha} values) is…

Machine Learning · Computer Science 2019-09-10 Dilin Wang , Hao Liu , Qiang Liu

Poor data quality limits the advantageous power of Machine Learning (ML) and weakens high-performing ML software systems. Nowadays, data are more prone to the risk of poor quality due to their increasing volume and complexity. Therefore,…

Machine Learning · Computer Science 2025-02-20 Manal Rahal , Bestoun S. Ahmed , Gergely Szabados , Torgny Fornstedt , Jorgen Samuelsson

Real-world data is laden with outlying values. The challenge for machine learning is that the learner typically has no prior knowledge of whether the feedback it receives (losses, gradients, etc.) will be heavy-tailed or not. In this work,…

Machine Learning · Statistics 2020-12-16 Matthew J. Holland