English
Related papers

Related papers: Generalized Ambiguity Decomposition for Understand…

200 papers

Unsupervised anomaly detection (UAD) is a widely adopted approach in industry due to rare anomaly occurrences and data imbalance. A desirable characteristic of an UAD model is contained generalization ability which excels in the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 YeongHyeon Park , Sungho Kang , Myung Jin Kim , Hyeonho Jeong , Hyunkyu Park , Hyeong Seok Kim , Juneho Yi

It is common practice to combine deep neural networks into ensembles. These deep ensembles can benefit from the cancellation of errors effect: Errors by ensemble members may average out, leading to better generalization performance than…

Machine Learning · Computer Science 2025-01-07 Nick Hauptvogel , Christian Igel

Generalized Category Discovery (GCD) aims to classify unlabeled data containing both seen and novel categories. Although existing methods perform well on generic datasets, they struggle in fine-grained scenarios. We attribute this…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Enguang Wang , Zhimao Peng , Zhengyuan Xie , Haori Lu , Fei Yang , Xialei Liu

Obtaining meaningful quantitative descriptions of the statistical dependence within multivariate systems is a difficult open problem. Recently, the Partial Information Decomposition (PID) was proposed to decompose mutual information (MI)…

Information Theory · Computer Science 2017-02-21 Robin A. A. Ince

Ensembles improve prediction performance and allow uncertainty quantification by aggregating predictions from multiple models. In deep ensembling, the individual models are usually black box neural networks, or recently, partially…

Machine Learning · Statistics 2022-05-26 Lucas Kook , Andrea Götschi , Philipp FM Baumann , Torsten Hothorn , Beate Sick

Graph Neural Networks (GNNs) have become essential tools for learning on relational data, yet the performance of a single GNN is often limited by the heterogeneity present in real-world graphs. Recent advances in Mixture-of-Experts (MoE)…

Machine Learning · Computer Science 2025-10-22 Gangda Deng , Yuxin Yang , Ömer Faruk Akgül , Hanqing Zeng , Yinglong Xia , Rajgopal Kannan , Viktor Prasanna

Generalized estimating equation (GEE) is widely adopted for regression modeling for longitudinal data, taking account of potential correlations within the same subjects. Although the standard GEE assumes common regression coefficients among…

Methodology · Statistics 2022-07-11 Tsubasa Ito , Shonosuke Sugasawa

Ensemble learning has been a focal point of machine learning research due to its potential to improve predictive performance. This study revisits the foundational work on ensemble error decomposition, historically confined to…

Machine Learning · Computer Science 2024-02-13 João Mendes-Moreira , Tiago Mendes-Neves

Generalized Category Discovery (GCD) tackles the challenging problem of categorizing unlabeled images into both known and novel classes within a partially labeled dataset, without prior knowledge of the number of unknown categories.…

Computer Vision and Pattern Recognition · Computer Science 2025-07-03 Mingfu Yan , Jiancheng Huang , Yifan Liu , Shifeng Chen

Decoding the human brain from electroencephalography (EEG) signals holds promise for understanding neurological activities. However, EEG data exhibit heterogeneity across subjects and sessions, limiting the generalization of existing…

Computational Engineering, Finance, and Science · Computer Science 2026-02-03 Zhi Zhang , Yan Liu , Zhejing Hu , Gong Chen , Jiannong Cao , Shenghua Zhong , Sean Fontaine , Changhong Jing , Shuqiang Wang

A central challenge in analyzing multivariate interactions within complex systems is to decompose how multiple inputs jointly determine an output. Existing approaches generally operate on observed probability distributions and can conflate…

Information Theory · Computer Science 2026-03-19 Clifford Bohm , Vincent R. Ragusa , Arend Hintze , Charles Ofria , Emily Dolson , Christoph Adami

Mutual learning, in which multiple networks learn by sharing their knowledge, improves the performance of each network. However, the performance of ensembles of networks that have undergone mutual learning does not improve significantly…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Naoki Okamoto , Soma Minami , Tsubasa Hirakawa , Takayoshi Yamashita , Hironobu Fujiyoshi

Image classification with neural networks (NNs) is widely used in industrial processes, situations where the model likely encounters unknown objects during deployment, i.e., out-of-distribution (OOD) data. Worryingly, NNs tend to make…

Machine Learning · Computer Science 2025-01-14 Arthur Thuy , Dries F. Benoit

Integrated IPD-AD analysis, which combines individual participant data (IPD) with aggregate data (AD), is increasingly recognized as an effective strategy for generating more reliable and generalizable inferences from heterogeneous studies.…

Methodology · Statistics 2026-03-03 Ming-Yueh Huang , Jing Qin , Chiung-Yu Huang

Unsupervised Anomaly Detection (UAD) plays a crucial role in identifying abnormal patterns within data without labeled examples, holding significant practical implications across various domains. Although the individual contributions of…

Machine Learning · Computer Science 2024-06-04 Zeyu Fang , Ming Gu , Sheng Zhou , Jiawei Chen , Qiaoyu Tan , Haishuai Wang , Jiajun Bu

Multimodal fake news detection often involves modelling heterogeneous data sources, such as vision and language. Existing detection methods typically rely on fusion effectiveness and cross-modal consistency to model the content,…

Machine Learning · Computer Science 2025-03-04 Lingzhi Shen , Yunfei Long , Xiaohao Cai , Imran Razzak , Guanming Chen , Kang Liu , Shoaib Jameel

Gradient-based learning algorithms have an implicit simplicity bias which in effect can limit the diversity of predictors being sampled by the learning procedure. This behavior can hinder the transferability of trained models by (i)…

Machine Learning · Computer Science 2022-11-24 Matteo Pagliardini , Martin Jaggi , François Fleuret , Sai Praneeth Karimireddy

Confusing classes that are ubiquitous in real world often degrade performance for many vision related applications like object detection, classification, and segmentation. The confusion errors are not only caused by similar visual patterns…

Computer Vision and Pattern Recognition · Computer Science 2018-08-02 Qichuan Geng , Xinyu Huang , Zhong Zhou , Ruigang Yang

Anomaly detection (AD) has attracted considerable attention in both academia and industry. Due to the lack of anomalous data in many practical cases, AD is usually solved by first modeling the normal data pattern and then determining if…

Machine Learning · Computer Science 2022-11-17 Jingxuan Pang , Chunguang Li

Generative diffusion models trained on large-scale datasets have achieved remarkable progress in image synthesis. In favor of their ability to supplement missing details and generate aesthetically pleasing contents, recent works have…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Junhao Cheng , Wei-Ting Chen , Xi Lu , Ming-Hsuan Yang