English
Related papers

Related papers: Evaluating Multimodal Large Language Models on Cor…

200 papers

This study investigated whether multimodal large language models can achieve human-like sensory grounding by examining their ability to capture perceptual strength ratings across sensory modalities. We explored how model characteristics…

Computation and Language · Computer Science 2025-11-10 Jonghyun Lee , Dojun Park , Jiwoo Lee , Hoekeon Choi , Sung-Eun Lee

While task-specific demonstrations show early success in applying large language models (LLMs) to automate some astronomical research tasks, they only provide incomplete views of all necessary capabilities in solving astronomy problems,…

Instrumentation and Methods for Astrophysics · Physics 2025-10-08 Lucas Carrit Delgado Pinheiro , Ziru Chen , Bruno Caixeta Piazza , Ness Shroff , Yingbin Liang , Yuan-Sen Ting , Huan Sun

Prompting techniques have significantly enhanced the capabilities of Large Language Models (LLMs) across various complex tasks, including reasoning, planning, and solving math word problems. However, most research has predominantly focused…

Computation and Language · Computer Science 2024-05-24 Neisarg Dave , Daniel Kifer , C. Lee Giles , Ankur Mali

There has been a surge in LLM evaluation research to understand LLM capabilities and limitations. However, much of this research has been confined to English, leaving LLM building and evaluation for non-English languages relatively…

In this paper, we propose GaMMA, a state-of-the-art (SoTA) large multimodal model (LMM) designed to achieve comprehensive musical content understanding. GaMMA inherits the streamlined encoder-decoder design of LLaVA, enabling effective…

Sound · Computer Science 2026-05-04 Zuyao You , Zhesong Yu , Mingyu Liu , Bilei Zhu , Yuan Wan , Zuxuan Wu

Large language models (LLMs) are being increasingly adopted in the software engineering domain, yet the robustness of their grasp on core software design concepts remains unclear. We conduct an empirical study to systematically evaluate…

Software Engineering · Computer Science 2025-12-30 Mootez Saad , Boqi Chen , José Antonio Hernández López , Dániel Varró , Tushar Sharma

Large Language Models (LLMs) are being rapidly adopted in agricultural imaging applications, ranging from crop interpretation to synthetic field image generation. However, these models frequently exhibit hallucinations outputs that appear…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Partho Ghose , Al Bashir , Prem Raj , Azlan Zahid

The emergence of Small Language Models (SLMs) as privacy-preserving alternatives for sensitive applications raises a fundamental question about their inherent understanding capabilities compared to Large Language Models (LLMs). This paper…

Computation and Language · Computer Science 2025-07-15 Hong Jia , Shiya Fu , Feng Xia , Vassilis Kostakos , Ting Dang

Multimodal large language models (MLLMs) perform strongly on natural images, yet their ability to understand discrete visual symbols remains unclear. We present a multi-domain benchmark spanning language, culture, mathematics, physics and…

Recent advancements in Multimodal Large Language Models (MLLMs) pursue omni-perception capabilities, yet integrating robust sensory grounding with complex reasoning remains a challenge, particularly for underrepresented regions. In this…

With the rapid advancement of Artificial Intelligence (AI), Large Language Models (LLMs) have significantly impacted a wide array of domains, including healthcare, engineering, science, education, and mathematical reasoning. Among these,…

Machine Learning · Computer Science 2025-05-20 Afrar Jahin , Arif Hassan Zidan , Wei Zhang , Yu Bao , Tianming Liu

Recent advances in Multi-Modal Large Language Models (MLLMs) have enabled unified processing of language, vision, and structured inputs, opening the door to complex tasks such as logical deduction, spatial reasoning, and scientific…

Artificial Intelligence · Computer Science 2025-07-03 Guiyao Tie , Xueyang Zhou , Tianhe Gu , Ruihang Zhang , Chaoran Hu , Sizhe Zhang , Mengqu Sun , Yan Zhang , Pan Zhou , Lichao Sun

Large Multimodal Models (LMMs) such as GPT-4V and LLaVA have shown remarkable capabilities in visual reasoning with common image styles. However, their robustness against diverse style shifts, crucial for practical applications, remains…

Computer Vision and Pattern Recognition · Computer Science 2023-12-07 Rizhao Cai , Zirui Song , Dayan Guan , Zhenhao Chen , Xing Luo , Chenyu Yi , Alex Kot

Speech quality assessment typically requires evaluating audio from multiple aspects, such as mean opinion score (MOS) and speaker similarity (SIM) \etc., which can be challenging to cover using one small model designed for a single task. In…

Audio and Speech Processing · Electrical Eng. & Systems 2025-04-02 Siyin Wang , Wenyi Yu , Yudong Yang , Changli Tang , Yixuan Li , Jimin Zhuang , Xianzhao Chen , Xiaohai Tian , Jun Zhang , Guangzhi Sun , Lu Lu , Yuxuan Wang , Chao Zhang

Large vision-language models (LVLMs) have recently achieved rapid progress, sparking numerous studies to evaluate their multi-modal capabilities. However, we dig into current evaluation works and identify two primary issues: 1) Visual…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Lin Chen , Jinsong Li , Xiaoyi Dong , Pan Zhang , Yuhang Zang , Zehui Chen , Haodong Duan , Jiaqi Wang , Yu Qiao , Dahua Lin , Feng Zhao

In this paper, we test whether Multimodal Large Language Models (MLLMs) can match human-subject performance in tasks involving the perception of properties in network layouts. Specifically, we replicate a human-subject experiment about…

Human-Computer Interaction · Computer Science 2026-04-10 Jacob Miller , Markus Wallinger , Ludwig Felder , Timo Brand , Henry Förster , Johannes Zink , Chunyang Chen , Stephen Kobourov

Deepfake detection remains a critical challenge in the era of advanced generative models, particularly as synthetic media becomes more sophisticated. In this study, we explore the potential of state of the art multi-modal (reasoning) large…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Simiao Ren , Yao Yao , Kidus Zewde , Zisheng Liang , Tsang , Ng , Ning-Yau Cheng , Xiaoou Zhan , Qinzhe Liu , Yifei Chen , Hengwei Xu

This study addresses the gap in the literature concerning the comparative performance of LLMs in interpreting different types of figurative language across multiple languages. By evaluating LLMs using two multilingual datasets on simile and…

Computation and Language · Computer Science 2025-03-11 Paria Khoshtab , Danial Namazifard , Mostafa Masoudi , Ali Akhgary , Samin Mahdizadeh Sani , Yadollah Yaghoobzadeh

Recent large language models (LLMs) have advanced table understanding capabilities but rely on converting tables into text sequences. While multimodal large language models (MLLMs) enable direct visual processing, they face limitations in…

Computation and Language · Computer Science 2025-02-26 Bohao Yang , Yingji Zhang , Dong Liu , André Freitas , Chenghua Lin

Despite rapid advances in large language models (LLMs), their linguistic abilities in low-resource and morphologically rich languages are still not well understood due to limited annotated resources and the absence of standardized…

Computation and Language · Computer Science 2026-04-01 Hailay Kidu Teklehaymanot , Gebrearegawi Gebremariam , Wolfgang Nejdl