English
Related papers

Related papers: Z-Error Loss for Training Neural Networks

200 papers

Linear regression is ubiquitous in statistical analysis. It is well understood that conflicting sources of information may contaminate the inference when the classical normality of errors is assumed. The contamination caused by the light…

Methodology · Statistics 2019-06-13 Philippe Gagnon , Alain Desgagné , Mylène Bédard

In the context of classification problems, Deep Learning (DL) approaches represent state of art. Many DL approaches are based on variations of standard multi-layer feed-forward neural networks. These are also referred to as deep networks.…

Machine Learning · Computer Science 2023-11-21 Andrea Apicella , Francesco Isgrò , Roberto Prevete

Given data with label noise (i.e., incorrect data), deep neural networks would gradually memorize the label noise and impair model performance. To relieve this issue, curriculum learning is proposed to improve model performance and…

Machine Learning · Computer Science 2022-08-23 Tingting Wu , Xiao Ding , Hao Zhang , Jinglong Gao , Li Du , Bing Qin , Ting Liu

A new technique for the detection of outliers in contingency tables is introduced. Outliers thereby are unexpected cell counts with respect to classical loglinear Poisson models. Subsets of cell counts called minimal patterns are defined,…

Computation · Statistics 2012-11-15 Sonja Kuhnt , Fabio Rapallo , André Rehage

Uncertainty estimation for machine learning models is of high importance in many scenarios such as constructing the confidence intervals for model predictions and detection of out-of-distribution or adversarially generated points. In this…

Machine Learning · Computer Science 2022-05-06 Kirill Fedyanin , Evgenii Tsymbalov , Maxim Panov

This study explores the impact of class outliers on the effectiveness of example-based explainability methods for black-box machine learning models. We reformulate existing explainability evaluation metrics, such as correctness and…

Machine Learning · Computer Science 2024-08-02 Ikhtiyor Nematov , Dimitris Sacharidis , Tomer Sagi , Katja Hose

Deep neural networks suffer from the overconfidence issue in the open world, meaning that classifiers could yield confident, incorrect predictions for out-of-distribution (OOD) samples. Thus, it is an urgent and challenging task to detect…

Computer Vision and Pattern Recognition · Computer Science 2022-04-12 Qiuyu Zhu , Guohui Zheng , Yingying Yan

With the sweeping digitalization of societal, medical, industrial, and scientific processes, sensing technologies are being deployed that produce increasing volumes of time series data, thus fueling a plethora of new or improved…

Machine Learning · Computer Science 2024-04-23 David Campos , Tung Kieu , Chenjuan Guo , Feiteng Huang , Kai Zheng , Bin Yang , Christian S. Jensen

Recent studies on catastrophic forgetting during sequential learning typically focus on fixing the accuracy of the predictions for a previously learned task. In this paper we argue that the outputs of neural networks are subject to rapid…

Machine Learning · Computer Science 2020-02-14 Yuwen Xiong , Mengye Ren , Raquel Urtasun

Outlier detection is a fundamental task in data mining and has many applications including detecting errors in databases. While there has been extensive prior work on methods for outlier detection, modern datasets often have sizes that are…

Machine Learning · Computer Science 2019-08-01 Laure Berti-Equille , Ji Meng Loh , Saravanan Thirumuruganathan

Assisted by the availability of data and high performance computing, deep learning techniques have achieved breakthroughs and surpassed human performance empirically in difficult tasks, including object recognition, speech recognition, and…

Machine Learning · Computer Science 2019-01-23 Shaeke Salman , Xiuwen Liu

Out-of-scope intent detection is of practical importance in task-oriented dialogue systems. Since the distribution of outlier utterances is arbitrary and unknown in the training stage, existing methods commonly rely on strong assumptions on…

Computation and Language · Computer Science 2021-06-18 Li-Ming Zhan , Haowen Liang , Bo Liu , Lu Fan , Xiao-Ming Wu , Albert Y. S. Lam

Humans can often quickly and efficiently solve complex new learning tasks given only a small set of examples. In contrast, modern artificially intelligent systems often require thousands or millions of observations in order to solve even…

Machine Learning · Computer Science 2025-05-08 Christian Raymond

Given an unsupervised outlier detection (OD) task on a new dataset, how can we automatically select a good outlier detection method and its hyperparameter(s) (collectively called a model)? Thus far, model selection for OD has been a "black…

Machine Learning · Computer Science 2021-03-18 Yue Zhao , Ryan A. Rossi , Leman Akoglu

This paper examines the effectiveness of combining active learning and transfer learning for anomaly detection in cross-domain time-series data. Our results indicate that there is an interaction between clustering and active learning and in…

Machine Learning · Computer Science 2025-08-07 John D. Kelleher , Matthew Nicholson , Rahul Agrahari , Clare Conran

In recent years, active learning has been successfully applied to an array of NLP tasks. However, prior work often assumes that training and test data are drawn from the same distribution. This is problematic, as in real-life settings data…

Computation and Language · Computer Science 2023-02-15 Ard Snijders , Douwe Kiela , Katerina Margatina

Machine unlearning aims to remove the influence of specific training data from a learned model without full retraining. While recent work has begun to explore unlearning in quantum machine learning, existing approaches largely rely on…

Machine Learning · Computer Science 2026-02-10 Nausherwan Malik , Zubair Khalid , Muhammad Faryad

Machine unlearning algorithms aim to remove the influence of specific training samples, ideally recovering the model that would have resulted from training on the remaining data alone. We study unlearning in the overparameterized setting,…

Machine Learning · Computer Science 2025-10-24 Jacob L. Block , Aryan Mokhtari , Sanjay Shakkottai

Outlier exposure (OE) is powerful in out-of-distribution (OOD) detection, enhancing detection capability via model fine-tuning with surrogate OOD data. However, surrogate data typically deviate from test OOD data. Thus, the performance of…

Machine Learning · Computer Science 2023-03-10 Qizhou Wang , Junjie Ye , Feng Liu , Quanyu Dai , Marcus Kalander , Tongliang Liu , Jianye Hao , Bo Han

Often the challenge associated with tasks like fraud and spam detection is the lack of all likely patterns needed to train suitable supervised learning models. This problem accentuates when the fraudulent patterns are not only scarce, they…

Machine Learning · Computer Science 2019-05-08 Utkarsh Porwal , Smruthi Mukund