English
Related papers

Related papers: Dataset Diversity Metrics and Impact on Classifica…

200 papers

Modern self-driving autonomy systems heavily rely on deep learning. As a consequence, their performance is influenced significantly by the quality and richness of the training data. Data collecting platforms can generate many hours of raw…

Machine Learning · Computer Science 2021-01-19 Abbas Sadat , Sean Segal , Sergio Casas , James Tu , Bin Yang , Raquel Urtasun , Ersin Yumer

Algorithmic fairness has emphasized the role of biased data in automated decision outcomes. Recently, there has been a shift in attention to sources of bias that implicate fairness in other stages in the ML pipeline. We contend that one…

Machine Learning · Computer Science 2021-09-09 Jessica Zosa Forde , A. Feder Cooper , Kweku Kwegyir-Aggrey , Chris De Sa , Michael Littman

Data scaling has driven remarkable success in foundation models for Natural Language Processing (NLP) and Computer Vision (CV), yet the principles of effective data scaling in robotic manipulation remain insufficiently understood. In this…

Robotics · Computer Science 2025-07-09 Modi Shi , Li Chen , Jin Chen , Yuxiang Lu , Chiming Liu , Guanghui Ren , Ping Luo , Di Huang , Maoqing Yao , Hongyang Li

In this article the authors develop an intrinsic measure for quantifying heterogeneity in training data for supervised learning. This measure is the variance of a random variable which factors through the influences of pairs of training…

Machine Learning · Computer Science 2026-03-10 Fenix W. Huang , Henning S. Mortveit , Christian M. Reidys

Language models are pretrained on sequences that blend statistical regularities (making text fluent) with factual associations between specific tokens (knowledge of facts). While recent work suggests that the variability of their…

Computation and Language · Computer Science 2025-10-21 Tina Behnia , Puneesh Deora , Christos Thrampoulidis

Camera images are ubiquitous in machine learning research. They also play a central role in the delivery of important services spanning medicine and environmental surveying. However, the application of machine learning models in these…

Deep learning models were frequently reported to learn from shortcuts like dataset biases. As deep learning is playing an increasingly important role in the modern healthcare system, it is of great need to combat shortcut learning in…

Image and Video Processing · Electrical Eng. & Systems 2022-08-05 Luyang Luo , Dunyuan Xu , Hao Chen , Tien-Tsin Wong , Pheng-Ann Heng

Deep Learning models have transformed various domains, including the healthcare sector, particularly biomedical image classification by learning intricate features and enabling accurate diagnostics pertaining to complex diseases. Recent…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Imran Ashraf , Mukhtar Ullah , Muhammad Faisal Nadeem , Muhammad Nouman Noor

Student diversity, like academic background, learning styles, career and life goals, ethnicity, age, social and emotional characteristics, course load and work schedule, offers unique opportunities in education, like learning new skills,…

Computers and Society · Computer Science 2022-05-02 Alex Doboli , Simona Doboli , Ryan Duke , Sangjin Hong , Wendy Tang

Although deep learning models have achieved state-of-the-art performance on a number of vision tasks, generalization over high dimensional multi-modal data, and reliable predictive uncertainty estimation are still active areas of research.…

Machine Learning · Computer Science 2020-12-10 Samarth Sinha , Homanga Bharadhwaj , Anirudh Goyal , Hugo Larochelle , Animesh Garg , Florian Shkurti

Understanding the interplay between intra-modality dependencies (the contribution of an individual modality to a target task) and inter-modality dependencies (the relationships between modalities and the target task) is fundamental to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Divyam Madaan , Varshan Muhunthan , Kyunghyun Cho , Sumit Chopra

To gain a better performance, many researchers put more computing resource into an application. However, in the AI area, there is still a lack of a successful large-scale machine learning training application: The scalability and…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-01-15 Daning Cheng , Hanping Zhang , Fen Xia , Shigang Li , Yunquan Zhang

Common designs of model evaluation typically focus on monolingual settings, where different models are compared according to their performance on a single data set that is assumed to be representative of all possible data for the task at…

Computation and Language · Computer Science 2022-04-12 Zoey Liu , Emily Prud'hommeaux

Data Science and Machine Learning have become fundamental assets for companies and research institutions alike. As one of its fields, supervised classification allows for class prediction of new samples, learning from given training data.…

Deep learning (DL)-based systems can exhibit unexpected behavior when exposed to out-of-distribution (OOD) scenarios, posing serious risks in safety-critical domains such as malware detection and autonomous driving. This underscores the…

Software Engineering · Computer Science 2026-04-28 Jingyu Zhang , Fan Wang , Jacky Keung , Yihan Liao , Yan Xiao , Lei Ma

Reliable uncertainty quantification is crucial for trustworthy decision-making and the deployment of AI models in medical imaging. While prior work has explored the ability of neural networks to quantify predictive, epistemic, and aleatoric…

Machine Learning · Statistics 2025-08-07 Simon Baur , Wojciech Samek , Jackie Ma

Deep-learning models can extract a rich assortment of features from data. Which features a model uses depends not only on \emph{predictivity} -- how reliably a feature indicates training-set labels -- but also on \emph{availability} -- how…

Machine Learning · Computer Science 2024-07-15 Katherine L. Hermann , Hossein Mobahi , Thomas Fel , Michael C. Mozer

Diversity has been gaining interest in the NLP community in recent years. At the same time, state-of-the-art transformer models such as ModernBERT use very large pre-training datasets, which are driven by size rather than by diversity. This…

Computation and Language · Computer Science 2026-02-26 Louis Estève , Christophe Servan , Thomas Lavergne , Agata Savary

Data selection is of great significance in pre-training large language models, given the variation in quality within the large-scale available training corpora. To achieve this, researchers are currently investigating the use of data…

Artificial Intelligence · Computer Science 2024-10-08 Chi Zhang , Huaping Zhong , Kuan Zhang , Chengliang Chai , Rui Wang , Xinlin Zhuang , Tianyi Bai , Jiantao Qiu , Lei Cao , Ju Fan , Ye Yuan , Guoren Wang , Conghui He

Ensembles depend on diversity for improved performance. Many ensemble training methods, therefore, attempt to optimize for diversity, which they almost always define in terms of differences in training set predictions. In this paper,…

Machine Learning · Computer Science 2020-02-10 Andrew Slavin Ross , Weiwei Pan , Leo Anthony Celi , Finale Doshi-Velez