English
Related papers

Related papers: You Never Know: Quantization Induces Inconsistent …

200 papers

Vision Language Models (VLMs) are increasingly deployed across downstream tasks, yet their training data often encode social biases that surface in outputs. Unlike humans, who interpret images through contextual and social cues, VLMs…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Adit Desai , Sudipta Roy , Mohna Chakraborty

Causal approaches to fairness have seen substantial recent interest, both from the machine learning community and from wider parties interested in ethical prediction algorithms. In no small part, this has been due to the fact that causal…

Machine Learning · Computer Science 2019-08-17 Niki Kilbertus , Philip J. Ball , Matt J. Kusner , Adrian Weller , Ricardo Silva

Recent multi-modal contrastive learning models have demonstrated the ability to learn an embedding space suitable for building strong vision classifiers, by leveraging the rich information in large-scale image-caption datasets. Our work…

Machine Learning · Computer Science 2023-02-09 Yuhui Zhang , Jeff Z. HaoChen , Shih-Cheng Huang , Kuan-Chieh Wang , James Zou , Serena Yeung

Large vision-language models (VLMs) can jointly interpret images and text, but they are also prone to absorbing and reproducing harmful social stereotypes when visual cues such as age, gender, race, clothing, or occupation are present. To…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Aravind Narayanan , Vahid Reza Khazaie , Shaina Raza

Numerous multimodal misinformation benchmarks exhibit bias toward specific modalities, allowing detectors to make predictions based solely on one modality. While previous research has quantified bias at the dataset level or manually…

Artificial Intelligence · Computer Science 2025-11-11 Hehai Lin , Hui Liu , Shilei Cao , Jing Li , Haoliang Li , Wenya Wang

Chemical language models (CLMs) are increasingly used for molecular design and property prediction. Because these models learn from textual encodings of molecules, differences in how such encodings are generated may affect their behavior.…

Quantitative Methods · Quantitative Biology 2026-02-13 Yosuke Kikuchi , Yasuhiro Yoshikai , Shumpei Nemoto , Ayako Furuhama , Takashi Yamada , Hiroyuki Kusuhara , Tadahaya Mizuno

We study the effectiveness of data-balancing for mitigating biases in contrastive language-image pretraining (CLIP), identifying areas of strength and limitation. First, we reaffirm prior conclusions that CLIP models can inadvertently…

Machine Learning · Computer Science 2024-03-08 Ibrahim Alabdulmohsin , Xiao Wang , Andreas Steiner , Priya Goyal , Alexander D'Amour , Xiaohua Zhai

Over the past decades, computer-aided diagnosis tools for breast cancer have been developed to enhance screening procedures, yet their clinical adoption remains challenged by data variability and inherent biases. Although foundation models…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Elodie Germani , Ilayda Selin Türk , Fatima Zeineddine , Charbel Mourad , Shadi Albarqouni

While video compression algorithms effectively reduce bitrate, aggressive quantization often compromises temporal coherence, introducing artifacts such as flicker, motion inconsistency, and unstable textures. Although spatial quality…

Image and Video Processing · Electrical Eng. & Systems 2026-05-19 Peter Zsoldos

Learning algorithms that learn linear models often have high representation bias on real-world problems. In this paper, we show that this representation bias can be greatly reduced by discretization. Discretization is a common procedure in…

Machine Learning · Computer Science 2017-01-26 Nayyar A. Zaidi , Yang Du , Geoffrey I. Webb

Recent work has focused on compressing pre-trained language models (PLMs) like BERT where the major focus has been to improve the in-distribution performance for downstream tasks. However, very few of these studies have analyzed the impact…

Computation and Language · Computer Science 2023-02-28 Mengnan Du , Subhabrata Mukherjee , Yu Cheng , Milad Shokouhi , Xia Hu , Ahmed Hassan Awadallah

Prior work has shown that Visual Recognition datasets frequently underrepresent bias groups $B$ (\eg Female) within class labels $Y$ (\eg Programmers). This dataset bias can lead to models that learn spurious correlations between class…

Computer Vision and Pattern Recognition · Computer Science 2023-04-28 Maan Qraitem , Kate Saenko , Bryan A. Plummer

Multi-modal models, such as CLIP, have demonstrated strong performance in aligning visual and textual representations, excelling in tasks like image retrieval and zero-shot classification. Despite this success, the mechanisms by which these…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Wenhao Wang , Adam Dziedzic , Grace C. Kim , Michael Backes , Franziska Boenisch

Recent work to enhance data partitioning strategies for more realistic model evaluation face challenges in providing a clear optimal choice. This study addresses these challenges, focusing on morphological segmentation and synthesizing…

Computation and Language · Computer Science 2024-04-16 Zoey Liu , Bonnie J. Dorr

Quantizing images into discrete representations has been a fundamental problem in unified generative modeling. Predominant approaches learn the discrete representation either in a deterministic manner by selecting the best-matching token or…

Computer Vision and Pattern Recognition · Computer Science 2023-10-17 Jiahui Zhang , Fangneng Zhan , Christian Theobalt , Shijian Lu

Pretrained multilingual models exhibit the same social bias as models processing English texts. This systematic review analyzes emerging research that extends bias evaluation and mitigation approaches into multilingual and non-English…

Computation and Language · Computer Science 2025-09-08 Lance Calvin Lim Gamboa , Yue Feng , Mark Lee

The lack of reasoning capabilities in Vision-Language Models (VLMs) has remained at the forefront of research discourse. We posit that this behavior stems from a reporting bias in their training data. That is, how people communicate about…

Computation and Language · Computer Science 2026-02-27 Amita Kamath , Jack Hessel , Khyathi Chandu , Jena D. Hwang , Kai-Wei Chang , Ranjay Krishna

Predictive models that generalize well under distributional shift are often desirable and sometimes crucial to building robust and reliable machine learning applications. We focus on distributional shift that arises in causal inference from…

Machine Learning · Statistics 2018-02-27 Fredrik D. Johansson , Nathan Kallus , Uri Shalit , David Sontag

Pretrained machine learning models are known to perpetuate and even amplify existing biases in data, which can result in unfair outcomes that ultimately impact user experience. Therefore, it is crucial to understand the mechanisms behind…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Laura Cabello , Emanuele Bugliarello , Stephanie Brandl , Desmond Elliott

An increasing awareness of biased patterns in natural language processing resources, like BERT, has motivated many metrics to quantify `bias' and `fairness'. But comparing the results of different metrics and the works that evaluate with…

Computation and Language · Computer Science 2021-12-15 Pieter Delobelle , Ewoenam Kwaku Tokpo , Toon Calders , Bettina Berendt