English
Related papers

Related papers: A Unified Debiasing Approach for Vision-Language M…

200 papers

Few-shot semantic segmentation (FSS) aims to enable models to segment novel/unseen object classes using only a limited number of labeled examples. However, current FSS methods frequently struggle with generalization due to incomplete and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Amin Karimi , Charalambos Poullis

Singular Value Decomposition (SVD) has become an important technique for reducing the computational burden of Vision Language Models (VLMs), which play a central role in tasks such as image captioning and visual question answering. Although…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Haiyu Wang , Yutong Wang , Jack Jiang , Sai Qian Zhang

In vision-language pre-training (VLP), masked image modeling (MIM) has recently been introduced for fine-grained cross-modal alignment. However, in most existing methods, the reconstruction targets for MIM lack high-level semantics, and…

Computer Vision and Pattern Recognition · Computer Science 2024-03-04 Haowei Liu , Yaya Shi , Haiyang Xu , Chunfeng Yuan , Qinghao Ye , Chenliang Li , Ming Yan , Ji Zhang , Fei Huang , Bing Li , Weiming Hu

In recent times, Vision-Language Models (VLMs) have been trained under two predominant paradigms. Generative training has enabled Multimodal Large Language Models (MLLMs) to tackle various complex tasks, yet issues such as hallucinations…

Computer Vision and Pattern Recognition · Computer Science 2024-11-04 Wei Chow , Juncheng Li , Qifan Yu , Kaihang Pan , Hao Fei , Zhiqi Ge , Shuai Yang , Siliang Tang , Hanwang Zhang , Qianru Sun

Vision-language tasks, such as VQA, SNLI-VE, and VCR are challenging because they require the model's reasoning ability to understand the semantics of the visual world and natural language. Supervised methods working for vision-language…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Zhecan Wang , Rui Sun , Haoxuan You , Noel Codella , Kai-Wei Chang , Shih-Fu Chang

Federated Learning (FL) enables collaborative model training across decentralized clients without sharing private data. However, FL suffers from biased global models due to non-IID and long-tail data distributions. We propose…

Machine Learning · Computer Science 2026-01-08 Jingrui Zhang , Yimeng Xu , Shujie Li , Feng Liang , Haihan Duan , Yanjie Dong , Victor C. M. Leung , Xiping Hu

We propose general visual inspection model using Vision-Language Model~(VLM) with few-shot images of non-defective or defective products, along with explanatory texts that serve as inspection criteria. Although existing VLM exhibit high…

Computer Vision and Pattern Recognition · Computer Science 2025-02-14 Shiryu Ueno , Yoshikazu Hayashi , Shunsuke Nakatsuka , Yusei Yamada , Hiroaki Aizawa , Kunihito Kato

Recent studies have shown that Machine Learning (ML) models can exhibit bias in real-world scenarios, posing significant challenges in ethically sensitive domains such as healthcare. Such bias can negatively affect model fairness, model…

Machine Learning · Computer Science 2025-09-05 Junyu Yan , Feng Chen , Yuyang Xue , Yuning Du , Konstantinos Vilouras , Sotirios A. Tsaftaris , Steven McDonagh

Language models frequently inherit societal biases from their training data. Numerous techniques have been proposed to mitigate these biases during both the pre-training and fine-tuning stages. However, fine-tuning a pre-trained debiased…

Computation and Language · Computer Science 2024-10-03 Shahed Masoudian , Markus Frohmann , Navid Rekabsaz , Markus Schedl

Vision-language models (VLMs) extend the conventional large language models by integrating visual data, enabling richer multimodal reasoning and significantly broadens the practical applications of AI. However, including visual inputs also…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Daulet Toibazar , Kesen Wang , Sherif Mohamed , Abdulaziz Al-Badawi , Abdulrahman Alfulayt , Pedro J. Moreno

Vision-Language Models (VLMs) have achieved remarkable success on multimodal tasks such as image-text retrieval and zero-shot classification, yet they can exhibit demographic biases even when explicit protected attributes are absent during…

Computer Vision and Pattern Recognition · Computer Science 2025-08-13 Ahsan Habib Akash , Greg Murray , Annahita Amireskandari , Joel Palko , Carol Laxson , Binod Bhattarai , Prashnna Gyawali

Large Language Models (LLMs) are powerful tools with the potential to benefit society immensely, yet, they have demonstrated biases that perpetuate societal inequalities. Despite significant advancements in bias mitigation techniques using…

Computation and Language · Computer Science 2024-09-24 Deonna M. Owens , Ryan A. Rossi , Sungchul Kim , Tong Yu , Franck Dernoncourt , Xiang Chen , Ruiyi Zhang , Jiuxiang Gu , Hanieh Deilamsalehy , Nedim Lipka

Large language models (LLMs) have demonstrated impressive capabilities across a wide range of natural language processing tasks. However, their outputs often exhibit social biases, raising fairness concerns. Existing debiasing methods, such…

Computation and Language · Computer Science 2026-02-05 Yujie Lin , Kunquan Li , Yixuan Liao , Xiaoxin Chen , Jinsong Su

Few-Shot Anomaly Detection (FSAD) has emerged as a critical paradigm for identifying irregularities using scarce normal references. While recent methods have integrated textual semantics to complement visual data, they predominantly rely on…

Computer Vision and Pattern Recognition · Computer Science 2026-01-26 Yuxin Jiang , Yunkang Cao , Yuqi Cheng , Yiheng Zhang , Weiming Shen

Large pre-trained language models contain societal biases and carry along these biases to downstream tasks. Current in-processing bias mitigation approaches (like adversarial training) impose debiasing by updating a model's parameters,…

Computation and Language · Computer Science 2023-06-21 Deepak Kumar , Oleg Lesota , George Zerveas , Daniel Cohen , Carsten Eickhoff , Markus Schedl , Navid Rekabsaz

Continual learning in large language models (LLMs) is prone to catastrophic forgetting, where adapting to new tasks significantly degrades performance on previously learned ones. Existing methods typically rely on low-rank,…

The advent of foundation models, particularly Vision-Language Models (VLMs) and Multi-modal Large Language Models (MLLMs), has redefined the frontiers of artificial intelligence, enabling remarkable generalization across diverse tasks with…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Redwan Sony , Parisa Farmanifard , Hamzeh Alzwairy , Nitish Shukla , Arun Ross

Vision-Language Models (VLMs) and generative image models have achieved remarkable performance across multimodal tasks, yet their robustness and fairness under input transformations remain insufficiently explored. This work investigates…

Computer Vision and Pattern Recognition · Computer Science 2026-01-15 Tarannum Mithila

Deep learning models have achieved excellent recognition results on large-scale video benchmarks. However, they perform poorly when applied to videos with rare scenes or objects, primarily due to the bias of existing video datasets. We…

Computer Vision and Pattern Recognition · Computer Science 2022-09-21 Haodong Duan , Yue Zhao , Kai Chen , Yuanjun Xiong , Dahua Lin

Few-shot segmentation has garnered significant attention. Many recent approaches attempt to introduce the Segment Anything Model (SAM) to handle this task. With the strong generalization ability and rich object-specific extraction ability…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Jin Wang , Bingfeng Zhang , Jian Pang , Weifeng Liu , Baodi Liu , Honglong Chen