English
Related papers

Related papers: Do Ensembling and Meta-Learning Improve Outlier De…

200 papers

Deep learning has become very popular for tasks such as predictive modeling and pattern recognition in handling big data. Deep learning is a powerful machine learning method that extracts lower level features and feeds them forward for the…

Machine Learning · Computer Science 2018-03-07 Steven Young , Tamer Abdou , Ayse Bener

Deep ensemble methods often improve predictive performance, yet they suffer from three practical limitations: redundancy among base models that inflates computational cost and degrades conditioning, unstable weighting under…

Machine Learning · Computer Science 2026-04-27 Noor Islam S. Mohammad , Md Muntaqim Meherab

Sepsis, a critical condition from the body's response to infection, poses a major global health crisis affecting all age groups. Timely detection and intervention are crucial for reducing healthcare expenses and improving patient outcomes.…

Machine Learning · Computer Science 2024-07-12 MohammadAmin Ansari Khoushabar , Parviz Ghafariasl

Anomaly detection is to recognize samples that differ in some respect from the training observations. These samples which do not conform to the distribution of normal data are called outliers or anomalies. In real-world anomaly detection…

Computer Vision and Pattern Recognition · Computer Science 2022-07-05 Vahid Reza Khazaie , Anthony Wong , Yalda Mohsenzadeh

Deep active learning in the presence of outlier examples poses a realistic yet challenging scenario. Acquiring unlabeled data for annotation requires a delicate balance between avoiding outliers to conserve the annotation budget and…

Computer Vision and Pattern Recognition · Computer Science 2023-07-10 Vladan Stojnić , Zakaria Laskar , Giorgos Tolias

In modern statistics, interests shift from pursuing the uniformly minimum variance unbiased estimator to reducing mean squared error (MSE) or residual squared error. Shrinkage based estimation and regression methods offer better prediction…

Methodology · Statistics 2025-02-25 Tianyu Zhan , Haoda Fu , Jian Kang

Mixture of Experts (MoE) are successful models for modeling heterogeneous data in many statistical learning problems including regression, clustering and classification. Generally fitted by maximum likelihood estimation via the well-known…

Machine Learning · Statistics 2018-10-30 Faicel Chamroukhi , Bao-Tuyen Huynh

Data imbalance is ubiquitous when applying machine learning to real-world problems, particularly regression problems. If training data are imbalanced, the learning is dominated by the densely covered regions of the target distribution and…

Machine Learning · Computer Science 2024-10-29 Yuchang Jiang , Vivien Sainte Fare Garnot , Konrad Schindler , Jan Dirk Wegner

learning algorithms. In this paper, we review the classification algorithms used in the health care system (chronic diseases) and present the neural network-based Ensemble learning method. We briefly describe the commonly used algorithms…

Machine Learning · Computer Science 2021-03-16 Jafar Abdollahi , Babak Nouri-Moghaddam , Mehdi Ghazanfari

Imbalanced data distribution remains a critical challenge in sequential learning, leading models to easily recognize frequent categories while failing to detect minority classes adequately. The Mixture-of-Experts model offers a scalable…

Machine Learning · Computer Science 2026-03-18 Ye Wang , Zixuan Wu , Lifeng Shen , Jiang Xie , Xiaoling Wang , Hong Yu , Guoyin Wang

Machine learning models encounter Out-of-Distribution (OoD) errors when the data seen at test time are generated from a different stochastic generator than the one used to generate the training data. One proposal to scale OoD detection to…

Machine Learning · Statistics 2019-05-27 Hyunsun Choi , Eric Jang , Alexander A. Alemi

There is often a mixture of very frequent labels and very infrequent labels in multi-label datatsets. This variation in label frequency, a type class imbalance, creates a significant challenge for building efficient multi-label…

Machine Learning · Computer Science 2021-09-28 Payel Sadhukhan , Arjun Pakrashi , Sarbani Palit , Brian Mac Namee

Various technologies, including computer vision models, are employed for the automatic monitoring of manual assembly processes in production. These models detect and classify events such as the presence of components in an assembly area or…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Anton Sergeev , Victor Minchenkov , Aleksei Soldatov , Vasiliy Kakurin , Yaroslav Mazikov

Anomaly detection is an important problem in many application areas, such as network security. Many deep learning methods for unsupervised anomaly detection produce good empirical performance but lack theoretical guarantees. By casting…

Machine Learning · Statistics 2024-09-16 Tian-Yi Zhou , Matthew Lau , Jizhou Chen , Wenke Lee , Xiaoming Huo

Mixed effects (ME) models inform a vast array of problems in the physical and social sciences, and are pervasive in meta-analysis. We consider ME models where the random effects component is linear. We then develop an efficient approach for…

Recent work has shown that models trained to the same objective, and which achieve similar measures of accuracy on consistent test data, may nonetheless behave very differently on individual predictions. This inconsistency is undesirable in…

Machine Learning · Computer Science 2021-11-17 Emily Black , Klas Leino , Matt Fredrikson

So-called unsupervised anomaly detection is better described as semi-supervised, as it assumes all training data are nominal. This assumption simplifies training but requires manual data curation, introducing bias and limiting adaptability.…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Muhammad Aqeel , Shakiba Sharifi , Marco Cristani , Francesco Setti

Deep neural networks are behind many of the recent successes in machine learning applications. However, these models can produce overconfident decisions while encountering out-of-distribution (OOD) examples or making a wrong prediction.…

Machine Learning · Computer Science 2021-06-24 Navid Kardan , Ankit Sharma , Kenneth O. Stanley

Clustering has many important applications in computer science, but real-world datasets often contain outliers. Moreover, the presence of outliers can make the clustering problems to be much more challenging. To reduce the complexities,…

Data Structures and Algorithms · Computer Science 2020-05-04 Hu Ding , Jiawei Huang , Haikuo Yu

The increased computerization in recent years has resulted in the production of a variety of different software, however measures need to be taken to ensure that the produced software isn't defective. Many researchers have worked in this…

Software Engineering · Computer Science 2023-04-06 Param Khakhar and , Rahul Kumar Dubey