Datasets for Studying Generalization from Easy to Hard Examples
Machine Learning
2021-09-28 v2 Artificial Intelligence
Authors:
Avi Schwarzschild
, Eitan Borgnia
, Arjun Gupta
, Arpit Bansal
, Zeyad Emam
, Furong Huang
, Micah Goldblum
, Tom Goldstein
Abstract
We describe new datasets for studying generalization from easy to hard examples.
Cite
@article{arxiv.2108.06011,
title = {Datasets for Studying Generalization from Easy to Hard Examples},
author = {Avi Schwarzschild and Eitan Borgnia and Arjun Gupta and Arpit Bansal and Zeyad Emam and Furong Huang and Micah Goldblum and Tom Goldstein},
journal= {arXiv preprint arXiv:2108.06011},
year = {2021}
}
Related papers
View all related →
Computation and Language · Computer Science
Data Factors for Better Compositional Generalization
Xiang Zhou, Yichen Jiang, Mohit Bansal
2023-11-09
Machine Learning · Computer Science
Understanding Generalization via Set Theory
Shiqi Liu
2023-11-14
Computation and Language · Computer Science
The Unreasonable Effectiveness of Easy Training Data for Hard Tasks
Peter Hase, Mohit Bansal, Peter Clark, Sarah Wiegreffe
2024-06-06
Computer Vision and Pattern Recognition · Computer Science
Empirical Study of Easy and Hard Examples in CNN Training
Ikki Kishida, Hideki Nakayama
2022-06-14
Machine Learning · Computer Science
Weak-to-Strong Generalization Through the Data-Centric Lens
Changho Shin, John Cooper, Frederic Sala
2025-03-05
Machine Learning · Computer Science
Easy Batch Normalization
Arip Asadulaev, Alexander Panfilov, Andrey Filchenkov
2022-07-20
Applications · Statistics
A General Class of New Continuous Mixture Distribution and Application
Brijesh P. Singh, Sandeep Singh, Utpal Dhar Das
2024-08-30
Computation and Language · Computer Science
Unobserved Local Structures Make Compositional Generalization Hard
Ben Bogin, Shivanshu Gupta, Jonathan Berant
2022-10-25
Machine Learning · Computer Science
Generalization in Neural Networks: A Broad Survey
Chris Rohlfs
2024-08-02
Machine Learning · Computer Science
One-shot Learning with Absolute Generalization
Hao Su
2021-05-31
Machine Learning · Computer Science
Improving Compositional Generalization in Classification Tasks via Structure Annotations
Juyong Kim, Pradeep Ravikumar, Joshua Ainslie, Santiago Ontañón
2021-06-22
Methodology · Statistics
Bayesian Estimation and Regularization Techniques in Categorical Data Analysis
Jan Kalina
2025-09-03
Machine Learning · Computer Science
Meta-Dataset: A Dataset of Datasets for Learning to Learn from Few Examples
Eleni Triantafillou, Tyler Zhu, Vincent Dumoulin, Pascal Lamblin +7
2020-04-09
Machine Learning · Computer Science
Fantastic Generalization Measures and Where to Find Them
Yiding Jiang, Behnam Neyshabur, Hossein Mobahi, Dilip Krishnan +1
2019-12-05
Machine Learning · Computer Science
Deep Learning Through the Lens of Example Difficulty
Robert J. N. Baldock, Hartmut Maennel, Behnam Neyshabur
2021-06-21
Computer Vision and Pattern Recognition · Computer Science
Understanding Bias in Large-Scale Visual Datasets
Boya Zeng, Yida Yin, Zhuang Liu
2024-12-04
Populations and Evolution · Quantitative Biology
Generalized Modeling: A survey and guide
Jana C. Massing, Thilo Gross
2021-12-17
Artificial Intelligence · Computer Science
Learning General Policies from Small Examples Without Supervision
Guillem Francès, Blai Bonet, Hector Geffner
2021-02-19
Computation and Language · Computer Science
Sample-efficient Linguistic Generalizations through Program Synthesis: Experiments with Phonology Problems
Saujas Vaduguru, Aalok Sathe, Monojit Choudhury, Dipti Misra Sharma
2021-06-15
Classical Analysis and ODEs · Mathematics
On mean-sets
Attila Losonczi
2018-08-22
Machine Learning · Computer Science
On information captured by neural networks: connections with memorization and generalization
Hrayr Harutyunyan
2023-06-29
Human-Computer Interaction · Computer Science
Datasets of Visualization for Machine Learning
Can Liu, Ruike Jiang, Shaocong Tan, Jiacheng Yu +3
2024-07-24
Methodology · Statistics
Methods for Quantifying Dataset Similarity: a Review, Taxonomy and Comparison
Marieke Stolte, Franziska Kappenberg, Jörg Rahnenführer, Andrea Bommert
2025-06-18
Machine Learning · Computer Science
On Transfer in Classification: How Well do Subsets of Classes Generalize?
Raphael Baena, Lucas Drumetz, Vincent Gripon
2024-03-07
Machine Learning · Computer Science
Exploring the Learning Difficulty of Data Theory and Measure
Weiyao Zhu, Ou Wu, Fengguang Su, Yingjun Deng
2022-09-20