English
Related papers

Related papers: Dataset Interfaces: Diagnosing Model Failures Usin…

200 papers

Diffusion-based models have gained significant popularity for text-to-image generation due to their exceptional image-generation capabilities. A risk with these models is the potential generation of inappropriate content, such as biased or…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Hang Li , Chengzhi Shen , Philip Torr , Volker Tresp , Jindong Gu

Learning from a large corpus of data, pre-trained models have achieved impressive progress nowadays. As popular generative pre-training, diffusion models capture both low-level visual knowledge and high-level semantic relations. In this…

Computer Vision and Pattern Recognition · Computer Science 2023-03-20 Chaofan Ma , Yuhuan Yang , Chen Ju , Fei Zhang , Jinxiang Liu , Yu Wang , Ya Zhang , Yanfeng Wang

Many few-shot learning approaches have been designed under the meta-learning framework, which learns from a variety of learning tasks and generalizes to new tasks. These meta-learning approaches achieve the expected performance in the…

Machine Learning · Computer Science 2022-01-05 Yongchun Zhu , Fuzhen Zhuang , Xiangliang Zhang , Zhiyuan Qi , Zhiping Shi , Juan Cao , Qing He

While previous distribution shift detection approaches can identify if a shift has occurred, these approaches cannot localize which specific features have caused a distribution shift -- a critical step in diagnosing or fixing any underlying…

Machine Learning · Computer Science 2021-07-16 Sean Kulinski , Saurabh Bagchi , David I. Inouye

We might hope that when faced with unexpected inputs, well-designed software systems would fire off warnings. Machine learning (ML) systems, however, which depend strongly on properties of their inputs (e.g. the i.i.d. assumption), tend to…

Machine Learning · Statistics 2019-10-29 Stephan Rabanser , Stephan Günnemann , Zachary C. Lipton

Systematic quantification of data quality is critical for consistent model performance. Prior works have focused on out-of-distribution data. Instead, we tackle an understudied yet equally important problem of characterizing incongruous…

Machine Learning · Computer Science 2022-06-14 Nabeel Seedat , Jonathan Crabbé , Mihaela van der Schaar

Standard supervised machine learning assumes that the distribution of the source samples used to train an algorithm is the same as the one of the target samples on which it is supposed to make predictions. However, as any data scientist…

Machine Learning · Computer Science 2020-02-12 Pirmin Lemberger , Ivan Panico

Practitioners often face the challenge of deploying prediction models in new environments with shifted distributions of covariates and responses. With observational data, such shifts are often driven by unobserved confounding, and can in…

Machine Learning · Computer Science 2026-04-02 Kulunu Dharmakeerthi , YoonHaeng Hur , Tengyuan Liang

We address the problem of integrating data from multiple, possibly biased, observational and interventional studies, to eventually compute counterfactuals in structural causal models. We start from the case of a single observational dataset…

Artificial Intelligence · Computer Science 2023-03-17 Marco Zaffalon , Alessandro Antonucci , David Huber , Rafael Cabañas

Communication scene recognition has been widely applied in practice, but using deep learning to address this problem faces challenges such as insufficient data and imbalanced data distribution. To address this, we designed a weighted loss…

Econometrics · Economics 2026-02-10 Jiasong Han , Yufei Feng , Xiaofeng Zhong

Machine learning models frequently experience performance drops under distribution shifts. The underlying cause of such shifts may be multiple simultaneous factors such as changes in data quality, differences in specific covariate…

Machine Learning · Computer Science 2023-06-07 Haoran Zhang , Harvineet Singh , Marzyeh Ghassemi , Shalmali Joshi

Identification of input data points relevant for the classifier (i.e. serve as the support vector) has recently spurred the interest of researchers for both interpretability as well as dataset debugging. This paper presents an in-depth…

Machine Learning · Computer Science 2020-09-30 Dominique Mercier , Shoaib Ahmed Siddiqui , Andreas Dengel , Sheraz Ahmed

Distribution shift is a common situation in machine learning tasks, where the data used for training a model is different from the data the model is applied to in the real world. This issue arises across multiple technical settings: from…

Machine Learning · Computer Science 2024-05-24 Nicolas Acevedo , Carmen Cortez , Chris Brooks , Rene Kizilcec , Renzhe Yu

Inversion methods, such as Textual Inversion, generate personalized images by incorporating concepts of interest provided by user images. However, existing methods often suffer from overfitting issues, where the dominant presence of…

Computer Vision and Pattern Recognition · Computer Science 2024-01-12 Xulu Zhang , Xiao-Yong Wei , Jinlin Wu , Tianyi Zhang , Zhaoxiang Zhang , Zhen Lei , Qing Li

Despite their remarkable performance on a wide range of visual tasks, machine learning technologies often succumb to data distribution shifts. Consequently, a range of recent work explores techniques for detecting these shifts.…

Machine Learning · Computer Science 2021-05-04 Maleakhi A. Wijaya , Dmitry Kazhdan , Botty Dimanov , Mateja Jamnik

Machine Learning (ML) has been a foundational topic in artificial intelligence (AI), providing both theoretical groundwork and practical tools for its exciting advancements. From ResNet for visual recognition to Transformer for…

Machine Learning · Computer Science 2025-12-30 Zhuo Huang

Due to the edge's position between the cloud and the users, and the recent surge of deep neural network (DNN) applications, edge computing brings about uncertainties that must be understood separately. Particularly, the edge users' locally…

Information Theory · Computer Science 2020-06-02 Sejin Seo , Sang Won Choi , Sujin Kook , Seong-Lyun Kim , Seung-Woo Ko

Diffusion models have recently shown strong progress in generative tasks, offering a more stable alternative to GAN-based approaches for makeup transfer. Existing methods often suffer from limited datasets, poor disentanglement between…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Qihe Pan , Yiming Wu , Xing Zhao , Liang Xie , Guodao Sun , Ronghua Liang

Machine learning models are often brittle on production data despite achieving high accuracy on benchmark datasets. Benchmark datasets have traditionally served dual purposes: first, benchmarks offer a standard on which machine learning…

Machine Learning · Computer Science 2022-09-26 Matthew Groh

A significant obstacle in the development of robust machine learning models is covariate shift, a form of distribution shift that occurs when the input distributions of the training and test sets differ while the conditional label…

Machine Learning · Statistics 2021-11-17 Nilesh Tripuraneni , Ben Adlam , Jeffrey Pennington