English
Related papers

Related papers: Evaluated CMI Bounds for Meta Learning: Tightness …

200 papers

Today, image classification is a common way for systems to process visual content. Although neural network approaches to classification have seen great progress in reducing error rates, it is not clear what this means for a cognitive system…

Artificial Intelligence · Computer Science 2020-02-11 Lee Martie , Mohammad Arif Ul Alam , Gaoyuan Zhang , Ryan R. Anderson

We propose a new framework for reasoning about information in complex systems. Our foundation is based on a variational extension of Shannon's information theory that takes into account the modeling power and computational constraints of…

Machine Learning · Computer Science 2020-02-26 Yilun Xu , Shengjia Zhao , Jiaming Song , Russell Stewart , Stefano Ermon

We present consistent algorithms for multiclass learning with complex performance metrics and constraints, where the objective and constraints are defined by arbitrary functions of the confusion matrix. This setting includes many common…

Machine learning models have traditionally been developed under the assumption that the training and test distributions match exactly. However, recent success in few-shot learning and related problems are encouraging signs that these models…

Machine Learning · Statistics 2020-10-15 James Lucas , Mengye Ren , Irene Kameni , Toniann Pitassi , Richard Zemel

Algorithmic interpretability is necessary to build trust, ensure fairness, and track accountability. However, there is no existing formal measurement method for algorithmic interpretability. In this work, we build upon programming language…

Artificial Intelligence · Computer Science 2022-05-23 John P. Lalor , Hong Guo

While large language models (LLMs) have exhibited impressive instruction-following capabilities, it is still unclear whether and to what extent they can respond to explicit constraints that might be entailed in various instructions. As a…

Computation and Language · Computer Science 2024-01-02 Yihan Chen , Benfeng Xu , Quan Wang , Yi Liu , Zhendong Mao

Uncertainty quantification is essential in safety-critical settings--from autonomous driving to aviation, finance, and health--where decisions must rely on conservative bounds rather than point estimates. Predictor-level intervals (e.g.,…

Machine Learning · Computer Science 2026-05-18 Ruirui Liu , Xuejie Hou , Yiping Jiang , Hui Ren

The difficulty of extracting deep features from EEG data and effectively integrating information from multiple views presents significant challenges for developing a generalizable pretraining framework for EEG representation learning.…

Machine Learning · Computer Science 2025-06-23 Puchun Liu , C. L. Philip Chen , Yubin He , Tong Zhang

Emotion recognition in conversation (ERC) aims to detect the emotion label for each utterance. Motivated by recent studies which have proven that feeding training examples in a meaningful order rather than considering them randomly can…

Computation and Language · Computer Science 2022-04-22 Lin Yang , Yi Shen , Yue Mao , Longjun Cai

The ability of Large Language Models (LLMs) to use external tools unlocks powerful real-world interactions, making rigorous evaluation essential. However, current benchmarks primarily report final accuracy, revealing what models can do but…

Computation and Language · Computer Science 2026-01-29 Qihao Wang , Yue Hu , Mingzhe Lu , Jiayue Wu , Yanbing Liu , Yuanmin Tang

In safety-critical classification, the cost of failure is often asymmetric, yet Bayesian deep learning summarises epistemic uncertainty with a single scalar, mutual information (MI), that cannot distinguish whether a model's ignorance…

Machine Learning · Statistics 2026-02-27 Mame Diarra Toure , David A. Stephens

Mutual information (MI) is an information-theoretic measure of dependency between two random variables. Several methods to estimate MI, from samples of two random variables with unknown underlying probability distributions have been…

Machine Learning · Computer Science 2020-11-18 P Aditya Sreekar , Ujjwal Tiwari , Anoop Namboodiri

Along with the rapid development of deep learning in practice, the theoretical explanations for its success become urgent. Generalization and expressivity are two widely used measurements to quantify theoretical behaviors of deep learning.…

Machine Learning · Computer Science 2018-03-26 Shao-Bo Lin

Transformer channel decoders, such as the Error Correction Code Transformer (ECCT), have shown strong empirical performance in channel decoding, yet their generalization behavior remains theoretically unclear. This paper studies the…

Information Theory · Computer Science 2026-01-13 Qinshan Zhang , Bin Chen , Yong Jiang , Shu-Tao Xia

Recent years have witnessed an abundance of new publications and approaches on meta-learning. This community-wide enthusiasm has sparked great insights but has also created a plethora of seemingly different frameworks, which can be hard to…

Machine Learning · Computer Science 2020-02-04 Wei-Lun Chao , Han-Jia Ye , De-Chuan Zhan , Mark Campbell , Kilian Q. Weinberger

This paper explores the intricate relationship between interpretability and robustness in deep learning models. Despite their remarkable performance across various tasks, deep learning models often exhibit critical vulnerabilities,…

Machine Learning · Computer Science 2024-12-30 Navid Nayyem , Abdullah Rakin , Longwei Wang

Compositionality in knowledge and language--the ability to represent complex concepts as a combination of simpler ones--is a hallmark of human cognition and communication. Despite recent advances, deep neural networks still struggle to…

Machine Learning · Computer Science 2025-12-01 Rafael Elberg , Felipe del Rio , Mircea Petrache , Denis Parra

Fairness-aware classification is receiving increasing attention in the machine learning fields. Recently research proposes to formulate the fairness-aware classification as constrained optimization problems. However, several limitations…

Machine Learning · Computer Science 2018-09-14 Yongkai Wu , Lu Zhang , Xintao Wu

Classic supervised learning involves algorithms trained on $n$ labeled examples to produce a hypothesis $h \in \mathcal{H}$ aimed at performing well on unseen examples. Meta-learning extends this by training across $n$ tasks, with $m$…

Machine Learning · Statistics 2024-11-28 Yannay Alon , Steve Hanneke , Shay Moran , Uri Shalit

We analyze the generalization ability of joint-training meta learning algorithms via the Gibbs algorithm. Our exact characterization of the expected meta generalization error for the meta Gibbs algorithm is based on symmetrized KL…

Machine Learning · Computer Science 2023-04-28 Yuheng Bu , Harsha Vardhan Tetali , Gholamali Aminian , Miguel Rodrigues , Gregory Wornell