中文
相关论文

相关论文: Contrast Sensitivity in Multimodal Large Language …

200 篇论文

Large Language Models are cognitively biased judges. Large Language Models (LLMs) have recently been shown to be effective as automatic evaluators with simple prompting and in-context learning. In this work, we assemble 15 LLMs of four…

计算与语言 · 计算机科学 2024-09-26 Ryan Koo , Minhwa Lee , Vipul Raheja , Jong Inn Park , Zae Myung Kim , Dongyeop Kang

Multimodal large language models (MLLMs) achieve strong performance on vision-language tasks, yet their visual processing is opaque. Most black-box evaluations measure task accuracy, but reveal little about underlying mechanisms. Drawing on…

计算机视觉与模式识别 · 计算机科学 2025-10-23 John Burden , Jonathan Prunty , Ben Slater , Matthieu Tehenan , Greg Davis , Lucy Cheke

Cognitive psychology investigates perception, attention, memory, language, problem-solving, decision-making, and reasoning. Kahneman's dual-system theory elucidates the human decision-making process, distinguishing between the rapid,…

计算与语言 · 计算机科学 2024-09-09 Yongxin Deng , Xihe Qiu , Xiaoyu Tan , Chao Qu , Jing Pan , Yuan Cheng , Yinghui Xu , Wei Chu

Multi-modal contrastive learning with language supervision has presented a paradigm shift in modern machine learning. By pre-training on a web-scale dataset, multi-modal contrastive learning can learn high-quality representations that…

机器学习 · 计算机科学 2024-11-06 Wei Huang , Andi Han , Yongqiang Chen , Yuan Cao , Zhiqiang Xu , Taiji Suzuki

While LLM-based TTS models exhibit zero-shot emotion and speaker cloning, their cloning fidelity and pronunciation clarity degrade on unseen domains. Fine-tuning is essential for adaptation, yet uniform approaches overlook specific…

音频与语音处理 · 电气工程与系统科学 2026-03-09 Tianrui Wang , Meng Ge , Cheng Gong , Chunyu Qiang , Haoyu Wang , Zikang Huang , Yu Jiang , Ye Ni , Yuheng Lu , Xiaobao Wang , Engsiong Chng , Xie Chen , Longbiao Wang , Jianwu Dang

This paper presents the first-ever study of adapting compressed image latents to suit the needs of downstream vision tasks that adopt Multimodal Large Language Models (MLLMs). MLLMs have extended the success of large language models to…

计算机视觉与模式识别 · 计算机科学 2025-02-18 Chia-Hao Kao , Cheng Chien , Yu-Jen Tseng , Yi-Hsin Chen , Alessandro Gnutti , Shao-Yuan Lo , Wen-Hsiao Peng , Riccardo Leonardi

Multimodal Large Language Models (MLLMs) utilize multimodal contexts consisting of text, images, or videos to solve various multimodal tasks. However, we find that changing the order of multimodal input can cause the model's performance to…

人工智能 · 计算机科学 2024-10-23 Zhijie Tan , Xu Chu , Weiping Li , Tong Mo

Large vision-language models (LVLMs) have been rapidly developed and widely used in various fields, but the (potential) stereotypical bias in the model is largely unexplored. In this study, we present a pioneering measurement framework,…

密码学与安全 · 计算机科学 2024-10-10 Yukun Jiang , Zheng Li , Xinyue Shen , Yugeng Liu , Michael Backes , Yang Zhang

Large language models (LLMs) have achieved remarkable performance on diverse benchmarks, yet existing evaluation practices largely rely on coarse summary metrics that obscure underlying reasoning abilities. In this work, we propose novel…

统计方法学 · 统计学 2026-03-17 Jia Liu , Zhiyu Xu , Yuqi Gu

Multimodal Large Language Models (MLLMs) are increasingly applied in Personalized Image Aesthetic Assessment (PIAA) as a scalable alternative to expert evaluations. However, their predictions may reflect subtle biases influenced by…

计算与语言 · 计算机科学 2025-09-16 Kun Li , Lai-Man Po , Hongzheng Yang , Xuyuan Xu , Kangcheng Liu , Yuzhi Zhao

The reasoning abilities of Large Language Models (LLMs) are becoming a central focus of study in NLP. In this paper, we consider the case of syllogistic reasoning, an area of deductive reasoning studied extensively in logic and cognitive…

计算与语言 · 计算机科学 2024-10-18 Leonardo Bertolazzi , Albert Gatt , Raffaella Bernardi

Weakly Supervised Semantic Segmentation (WSSS) with image-level labels has gained attention for its cost-effectiveness. Most existing methods emphasize inter-class separation, often neglecting the shared semantics among related categories…

计算机视觉与模式识别 · 计算机科学 2025-09-03 Wangyu Wu , Zhenhong Chen , Xiaowen Ma , Wenqiao Zhang , Xianglin Qiu , Siqi Song , Xiaowei Huang , Fei Ma , Jimin Xiao

Human activity recognition serves as the foundation for various emerging applications. In recent years, researchers have used collaborative sensing of multi-source sensors to capture complex and dynamic human activities. However, multimodal…

机器学习 · 计算机科学 2026-04-28 Long Jing , Zhixiong Yang , Yajun Zhang , Xinlong Feng

Large language models have demonstrated exceptional performance across multiple crosslingual NLP tasks, including machine translation (MT). However, persistent challenges remain in addressing context-sensitive units (CSUs), such as…

计算与语言 · 计算机科学 2025-05-30 Qiuyu Ding , Zhiqiang Cao , Hailong Cao , Tiejun Zhao

Warning: This paper contains examples of stereotypes and biases. Large Language Models (LLMs) exhibit considerable social biases, and various studies have tried to evaluate and mitigate these biases accurately. Previous studies use…

计算与语言 · 计算机科学 2024-07-04 Rem Hida , Masahiro Kaneko , Naoaki Okazaki

Understanding how humans conceptualize and categorize natural objects offers critical insights into perception and cognition. With the advent of Large Language Models (LLMs), a key question arises: can these models develop human-like object…

Large language models (LLMs) are trained for downstream tasks by updating their parameters (e.g., via RL). However, updating parameters forces them to absorb task-specific information, which can result in catastrophic forgetting and loss of…

An interesting behavior in large language models (LLMs) is prompt sensitivity. When provided with different but semantically equivalent versions of the same prompt, models may produce very different distributions of answers. This suggests…

计算与语言 · 计算机科学 2025-10-21 Kyle Cox , Jiawei Xu , Yikun Han , Rong Xu , Tianhao Li , Chi-Yang Hsu , Tianlong Chen , Walter Gerych , Ying Ding

Current Large Vision-Language Models (LVLMs) have demonstrated remarkable capabilities in understanding multimodal data, but their potential remains underexplored for deepfake detection due to the misalignment of their knowledge and…

计算机视觉与模式识别 · 计算机科学 2025-06-10 Peipeng Yu , Jianwei Fei , Hui Gao , Xuan Feng , Zhihua Xia , Chip Hong Chang

Large Language Model (LLM)-based systems present new opportunities for autonomous health monitoring in sensor-rich industrial environments. This study explores the potential of LLMs to detect and classify faults directly from sensor data,…

人工智能 · 计算机科学 2025-09-30 Xian Yeow Lee , Lasitha Vidyaratne , Ahmed Farahat , Chetan Gupta