English
Related papers

Related papers: Contrast Sensitivity in Multimodal Large Language …

200 papers

Large Language Models are cognitively biased judges. Large Language Models (LLMs) have recently been shown to be effective as automatic evaluators with simple prompting and in-context learning. In this work, we assemble 15 LLMs of four…

Computation and Language · Computer Science 2024-09-26 Ryan Koo , Minhwa Lee , Vipul Raheja , Jong Inn Park , Zae Myung Kim , Dongyeop Kang

Multimodal large language models (MLLMs) achieve strong performance on vision-language tasks, yet their visual processing is opaque. Most black-box evaluations measure task accuracy, but reveal little about underlying mechanisms. Drawing on…

Computer Vision and Pattern Recognition · Computer Science 2025-10-23 John Burden , Jonathan Prunty , Ben Slater , Matthieu Tehenan , Greg Davis , Lucy Cheke

Cognitive psychology investigates perception, attention, memory, language, problem-solving, decision-making, and reasoning. Kahneman's dual-system theory elucidates the human decision-making process, distinguishing between the rapid,…

Computation and Language · Computer Science 2024-09-09 Yongxin Deng , Xihe Qiu , Xiaoyu Tan , Chao Qu , Jing Pan , Yuan Cheng , Yinghui Xu , Wei Chu

Multi-modal contrastive learning with language supervision has presented a paradigm shift in modern machine learning. By pre-training on a web-scale dataset, multi-modal contrastive learning can learn high-quality representations that…

Machine Learning · Computer Science 2024-11-06 Wei Huang , Andi Han , Yongqiang Chen , Yuan Cao , Zhiqiang Xu , Taiji Suzuki

While LLM-based TTS models exhibit zero-shot emotion and speaker cloning, their cloning fidelity and pronunciation clarity degrade on unseen domains. Fine-tuning is essential for adaptation, yet uniform approaches overlook specific…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-09 Tianrui Wang , Meng Ge , Cheng Gong , Chunyu Qiang , Haoyu Wang , Zikang Huang , Yu Jiang , Ye Ni , Yuheng Lu , Xiaobao Wang , Engsiong Chng , Xie Chen , Longbiao Wang , Jianwu Dang

This paper presents the first-ever study of adapting compressed image latents to suit the needs of downstream vision tasks that adopt Multimodal Large Language Models (MLLMs). MLLMs have extended the success of large language models to…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Chia-Hao Kao , Cheng Chien , Yu-Jen Tseng , Yi-Hsin Chen , Alessandro Gnutti , Shao-Yuan Lo , Wen-Hsiao Peng , Riccardo Leonardi

Multimodal Large Language Models (MLLMs) utilize multimodal contexts consisting of text, images, or videos to solve various multimodal tasks. However, we find that changing the order of multimodal input can cause the model's performance to…

Artificial Intelligence · Computer Science 2024-10-23 Zhijie Tan , Xu Chu , Weiping Li , Tong Mo

Large vision-language models (LVLMs) have been rapidly developed and widely used in various fields, but the (potential) stereotypical bias in the model is largely unexplored. In this study, we present a pioneering measurement framework,…

Cryptography and Security · Computer Science 2024-10-10 Yukun Jiang , Zheng Li , Xinyue Shen , Yugeng Liu , Michael Backes , Yang Zhang

Large language models (LLMs) have achieved remarkable performance on diverse benchmarks, yet existing evaluation practices largely rely on coarse summary metrics that obscure underlying reasoning abilities. In this work, we propose novel…

Methodology · Statistics 2026-03-17 Jia Liu , Zhiyu Xu , Yuqi Gu

Multimodal Large Language Models (MLLMs) are increasingly applied in Personalized Image Aesthetic Assessment (PIAA) as a scalable alternative to expert evaluations. However, their predictions may reflect subtle biases influenced by…

Computation and Language · Computer Science 2025-09-16 Kun Li , Lai-Man Po , Hongzheng Yang , Xuyuan Xu , Kangcheng Liu , Yuzhi Zhao

The reasoning abilities of Large Language Models (LLMs) are becoming a central focus of study in NLP. In this paper, we consider the case of syllogistic reasoning, an area of deductive reasoning studied extensively in logic and cognitive…

Computation and Language · Computer Science 2024-10-18 Leonardo Bertolazzi , Albert Gatt , Raffaella Bernardi

Weakly Supervised Semantic Segmentation (WSSS) with image-level labels has gained attention for its cost-effectiveness. Most existing methods emphasize inter-class separation, often neglecting the shared semantics among related categories…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Wangyu Wu , Zhenhong Chen , Xiaowen Ma , Wenqiao Zhang , Xianglin Qiu , Siqi Song , Xiaowei Huang , Fei Ma , Jimin Xiao

Human activity recognition serves as the foundation for various emerging applications. In recent years, researchers have used collaborative sensing of multi-source sensors to capture complex and dynamic human activities. However, multimodal…

Machine Learning · Computer Science 2026-04-28 Long Jing , Zhixiong Yang , Yajun Zhang , Xinlong Feng

Large language models have demonstrated exceptional performance across multiple crosslingual NLP tasks, including machine translation (MT). However, persistent challenges remain in addressing context-sensitive units (CSUs), such as…

Computation and Language · Computer Science 2025-05-30 Qiuyu Ding , Zhiqiang Cao , Hailong Cao , Tiejun Zhao

Warning: This paper contains examples of stereotypes and biases. Large Language Models (LLMs) exhibit considerable social biases, and various studies have tried to evaluate and mitigate these biases accurately. Previous studies use…

Computation and Language · Computer Science 2024-07-04 Rem Hida , Masahiro Kaneko , Naoaki Okazaki

Understanding how humans conceptualize and categorize natural objects offers critical insights into perception and cognition. With the advent of Large Language Models (LLMs), a key question arises: can these models develop human-like object…

Artificial Intelligence · Computer Science 2025-06-12 Changde Du , Kaicheng Fu , Bincheng Wen , Yi Sun , Jie Peng , Wei Wei , Ying Gao , Shengpei Wang , Chuncheng Zhang , Jinpeng Li , Shuang Qiu , Le Chang , Huiguang He

Large language models (LLMs) are trained for downstream tasks by updating their parameters (e.g., via RL). However, updating parameters forces them to absorb task-specific information, which can result in catastrophic forgetting and loss of…

An interesting behavior in large language models (LLMs) is prompt sensitivity. When provided with different but semantically equivalent versions of the same prompt, models may produce very different distributions of answers. This suggests…

Computation and Language · Computer Science 2025-10-21 Kyle Cox , Jiawei Xu , Yikun Han , Rong Xu , Tianhao Li , Chi-Yang Hsu , Tianlong Chen , Walter Gerych , Ying Ding

Current Large Vision-Language Models (LVLMs) have demonstrated remarkable capabilities in understanding multimodal data, but their potential remains underexplored for deepfake detection due to the misalignment of their knowledge and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Peipeng Yu , Jianwei Fei , Hui Gao , Xuan Feng , Zhihua Xia , Chip Hong Chang

Large Language Model (LLM)-based systems present new opportunities for autonomous health monitoring in sensor-rich industrial environments. This study explores the potential of LLMs to detect and classify faults directly from sensor data,…

Artificial Intelligence · Computer Science 2025-09-30 Xian Yeow Lee , Lasitha Vidyaratne , Ahmed Farahat , Chetan Gupta