English
Related papers

Related papers: Understanding Generalization via Set Theory

200 papers

The generalization mystery in deep learning is the following: Why do over-parameterized neural networks trained with gradient descent (GD) generalize well on real datasets even though they are capable of fitting random datasets of…

Machine Learning · Computer Science 2022-06-07 Satrajit Chatterjee , Piotr Zielinski

Diffusion probabilistic models have been successfully used to generate data from noise. However, most diffusion models are computationally expensive and difficult to interpret with a lack of theoretical justification. Random feature models…

Machine Learning · Statistics 2025-08-11 Esha Saha , Giang Tran

The purpose of this paper is to look into how central notions in statistical learning theory, such as realisability, generalise under the assumption that train and test distribution are issued from the same credal set, i.e., a convex set of…

Machine Learning · Computer Science 2024-02-23 Fabio Cuzzolin

Understanding the generalization behaviour of deep neural networks is a topic of recent interest that has driven the production of many studies, notably the development and evaluation of generalization "explainability" measures that…

Machine Learning · Computer Science 2021-10-26 Jonathan Jaegerman , Khalil Damouni , Mahdi S. Hosseini , Konstantinos N. Plataniotis

Systematic generalization aims to evaluate reasoning about novel combinations from known components, an intrinsic property of human cognition. In this work, we study systematic generalization of NNs in forecasting future time series of…

Machine Learning · Computer Science 2021-03-09 Hritik Bansal , Gantavya Bhatt , Pankaj Malhotra , Prathosh A. P

Generalizing machine learning (ML) models for network traffic dynamics tends to be considered a lost cause. Hence for every new task, we design new models and train them on model-specific datasets closely mimicking the deployment…

Networking and Internet Architecture · Computer Science 2022-10-25 Alexander Dietmüller , Siddhant Ray , Romain Jacob , Laurent Vanbever

Despite the remarkable capabilities of modern large language models (LLMs), the mechanisms behind their problem-solving abilities remain elusive. In this work, we aim to better understand how the learning dynamics of LLM finetuning shapes…

Machine Learning · Computer Science 2024-11-19 Katie Kang , Amrith Setlur , Dibya Ghosh , Jacob Steinhardt , Claire Tomlin , Sergey Levine , Aviral Kumar

We are motivated by the problem of learning policies for robotic systems with rich sensory inputs (e.g., vision) in a manner that allows us to guarantee generalization to environments unseen during training. We provide a framework for…

Robotics · Computer Science 2022-07-25 Abhinav Agarwal , Sushant Veer , Allen Z. Ren , Anirudha Majumdar

Deep neural networks generalize well on unseen data though the number of parameters often far exceeds the number of training examples. Recently proposed complexity measures have provided insights to understanding the generalizability in…

Machine Learning · Computer Science 2020-05-12 Jingling Li , Yanchao Sun , Jiahao Su , Taiji Suzuki , Furong Huang

In the domain generalization literature, a common objective is to learn representations independent of the domain after conditioning on the class label. We show that this objective is not sufficient: there exist counter-examples where a…

Machine Learning · Computer Science 2021-06-30 Divyat Mahajan , Shruti Tople , Amit Sharma

Large-scale transformers achieve impressive results on program synthesis benchmarks, yet their true generalization capabilities remain obscured by data contamination and opaque training corpora. To rigorously assess whether models are truly…

Machine Learning · Computer Science 2026-05-01 Henrik Voigt , Michael Habeck , Joachim Giesen

In this paper, we take stock of the current state of summarization datasets and explore how different factors of datasets influence the generalization behaviour of neural extractive summarization models. Specifically, we first propose…

Computation and Language · Computer Science 2019-10-01 Ming Zhong , Danqing Wang , Pengfei Liu , Xipeng Qiu , Xuanjing Huang

This survey includes systematic generalization and a history of how machine learning addresses it. We aim to summarize and organize the related information of both conventional and recent improvements. We first look at the definition of…

Artificial Intelligence · Computer Science 2022-11-23 Yuanpeng Li

A crucial aspect in reliable machine learning is to design a deployable system in generalizing new related but unobserved environments. Domain generalization aims to alleviate such a prediction gap between the observed and unseen…

Machine Learning · Computer Science 2021-06-01 Changjian Shui , Boyu Wang , Christian Gagné

Domain shift refers to the well known problem that a model trained in one source domain performs poorly when applied to a target domain with different statistics. {Domain Generalization} (DG) techniques attempt to alleviate this issue by…

Machine Learning · Computer Science 2017-10-11 Da Li , Yongxin Yang , Yi-Zhe Song , Timothy M. Hospedales

Humans can systematically generalize to novel compositions of existing concepts. Recent studies argue that neural networks appear inherently ineffective in such cognitive capacity, leading to a pessimistic view and a lack of attention to…

Computation and Language · Computer Science 2022-10-19 Ning Shi , Boxin Wang , Wei Wang , Xiangyu Liu , Zhouhan Lin

In the problem of domain generalization (DG), there are labeled training data sets from several related prediction problems, and the goal is to make accurate predictions on future unlabeled data sets that are not known to the learner. This…

Machine Learning · Statistics 2021-01-08 Gilles Blanchard , Aniket Anand Deshmukh , Urun Dogan , Gyemin Lee , Clayton Scott

Neural networks often learn simple explanations that fit the majority of the data while memorizing exceptions that deviate from these explanations.This behavior leads to poor generalization when the learned explanations rely on spurious…

Machine Learning · Computer Science 2024-12-11 Reza Bayat , Mohammad Pezeshki , Elvis Dohmatob , David Lopez-Paz , Pascal Vincent

Debiased machine learning is a meta algorithm based on bias correction and sample splitting to calculate confidence intervals for functionals, i.e. scalar summaries, of machine learning algorithms. For example, an analyst may desire the…

Machine Learning · Statistics 2022-10-25 Victor Chernozhukov , Whitney K. Newey , Rahul Singh

We take a geometrical viewpoint and present a unifying view on supervised deep learning with the Bregman divergence loss function - this entails frequent classification and prediction tasks. Motivated by simulations we suggest that there is…

Machine Learning · Computer Science 2021-07-07 Petr Taborsky , Lars Kai Hansen