English
Related papers

Related papers: Exploring the Capabilities of Large Multimodal Mod…

200 papers

Medical images and radiology reports are crucial for diagnosing medical conditions, highlighting the importance of quantitative analysis for clinical decision-making. However, the diversity and cross-source heterogeneity of these data…

Image and Video Processing · Electrical Eng. & Systems 2024-07-09 Yutong Zhang , Yi Pan , Tianyang Zhong , Peixin Dong , Kangni Xie , Yuxiao Liu , Hanqi Jiang , Zhengliang Liu , Shijie Zhao , Tuo Zhang , Xi Jiang , Dinggang Shen , Tianming Liu , Xin Zhang

With the rapid development of large language models (LLMs) and their integration into large multimodal models (LMMs), there has been impressive progress in zero-shot completion of user-oriented vision-language tasks. However, a gap remains…

Computation and Language · Computer Science 2024-04-16 Fuxiao Liu , Xiaoyang Wang , Wenlin Yao , Jianshu Chen , Kaiqiang Song , Sangwoo Cho , Yaser Yacoob , Dong Yu

Large Language Models (LLMs) represent a class of deep learning models adept at understanding natural language and generating coherent responses to various prompts or queries. These models far exceed the complexity of conventional neural…

Machine Learning · Computer Science 2024-12-05 Minghao Shao , Abdul Basit , Ramesh Karri , Muhammad Shafique

Large vision-language models (VLMs) such as GPT-4 have achieved unprecedented performance in response generation, especially with visual inputs, enabling more creative and adaptable interaction than large language models such as ChatGPT.…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Yunqing Zhao , Tianyu Pang , Chao Du , Xiao Yang , Chongxuan Li , Ngai-Man Cheung , Min Lin

This paper presents an in-depth study of multimodal machine translation (MMT), examining the prevailing understanding that MMT systems exhibit decreased sensitivity to visual information when text inputs are complete. Instead, we attribute…

Computation and Language · Computer Science 2023-10-27 Yuxin Zuo , Bei Li , Chuanhao Lv , Tong Zheng , Tong Xiao , Jingbo Zhu

Nowadays, DeepSeek, ChatGPT, and Google Gemini are the most trending and exciting Large Language Model (LLM) technologies for reasoning, multimodal capabilities, and general linguistic performance worldwide. DeepSeek employs a…

Large Multimodal Model (LMM) is a hot research topic in the computer vision area and has also demonstrated remarkable potential across multiple disciplinary fields. A recent trend is to further extend and enhance the perception capabilities…

Computer Vision and Pattern Recognition · Computer Science 2024-05-29 Yang Jiao , Shaoxiang Chen , Zequn Jie , Jingjing Chen , Lin Ma , Yu-Gang Jiang

In this survey, we systematically analyze techniques used to adapt large multimodal models (LMMs) for low-resource (LR) languages, examining approaches ranging from visual enhancement and data creation to cross-modal transfer and fusion…

Computation and Language · Computer Science 2026-02-03 Marian Lupascu , Ana-Cristina Rogoz , Mihai Sorin Stupariu , Radu Tudor Ionescu

This paper investigates Large Language Models (LLMs) ability to assess the economic soundness and theoretical consistency of empirical findings in spatial econometrics. We created original and deliberately altered "counterfactual" summaries…

Computers and Society · Computer Science 2025-06-10 Giuseppe Arbia , Luca Morandini , Vincenzo Nardelli

Large language models (LLMs) have demonstrated impressive reasoning capabilities, particularly in textual mathematical problem-solving. However, existing open-source image instruction fine-tuning datasets, containing limited question-answer…

Computation and Language · Computer Science 2024-10-10 Wenhao Shi , Zhiqiang Hu , Yi Bin , Junhua Liu , Yang Yang , See-Kiong Ng , Lidong Bing , Roy Ka-Wei Lee

Recently, large language models (LLMs) have notably positioned them as capable tools for addressing complex optimization challenges. Despite this recognition, a predominant limitation of existing LLM-based optimization methods is their…

Artificial Intelligence · Computer Science 2024-03-05 Yuxiao Huang , Wenjie Zhang , Liang Feng , Xingyu Wu , Kay Chen Tan

This systematic literature review examines the role of large language models (LLMs) in UI/UX design, synthesizing findings from 38 peer-reviewed studies published between 2022 and 2025. We identify key LLMs in use, including GPT-4, Gemini,…

Human-Computer Interaction · Computer Science 2025-07-21 Ammar Ahmed , Ali Shariq Imran

Multimodal large language models (MLLMs) have achieved remarkable success across a broad range of vision tasks. However, constrained by the capacity of their internal world knowledge, prior work has proposed augmenting MLLMs by…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Wenxuan Huang , Yu Zeng , Qiuchen Wang , Zhen Fang , Shaosheng Cao , Zheng Chu , Qingyu Yin , Shuang Chen , Zhenfei Yin , Lin Chen , Zehui Chen , Xu Tang , Yao Hu , Shaohui Lin , Philip Torr , Feng Zhao , Wanli Ouyang

As a prominent direction of Artificial General Intelligence (AGI), Multimodal Large Language Models (MLLMs) have garnered increased attention from both industry and academia. Building upon pre-trained LLMs, this family of models further…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Chaoyou Fu , Yi-Fan Zhang , Shukang Yin , Bo Li , Xinyu Fang , Sirui Zhao , Haodong Duan , Xing Sun , Ziwei Liu , Liang Wang , Caifeng Shan , Ran He

The recent swift development of LLMs like GPT-4, Gemini, and GPT-3.5 offers a transformative opportunity in medicine and healthcare, especially in digital diagnostics. This study evaluates each model diagnostic abilities by interpreting a…

Computation and Language · Computer Science 2024-05-14 Gaurav Kumar Gupta , Aditi Singh , Sijo Valayakkad Manikandan , Abul Ehtesham

The advancement of Large Language Models (LLMs), including GPT-4, provides exciting new opportunities for generative design. We investigate the application of this tool across the entire design and manufacturing workflow. Specifically, we…

With the advent of multi-modal large language models (MLLMs), datasets used for visual question answering (VQA) and referring expression comprehension have seen a resurgence. However, the most popular datasets used to evaluate MLLMs are…

Artificial Intelligence · Computer Science 2024-08-13 Jian Lu , Shikhar Srivastava , Junyu Chen , Robik Shrestha , Manoj Acharya , Kushal Kafle , Christopher Kanan

Advancements in deep learning have generated a large-scale interest in the development of foundational deep learning models. The development of Large Language Models (LLM) has evolved as a transformative paradigm in conversational tasks,…

Computation and Language · Computer Science 2024-08-01 Nikil Sharan Prabahar Balasubramanian , Sagnik Dakshit

This paper presents a comprehensive evaluation of cost-efficient Large Language Models (LLMs) for diverse biomedical tasks spanning both text and image modalities. We evaluated a range of closed-source and open-source LLMs on tasks such as…

Computation and Language · Computer Science 2025-07-21 Israt Jahan , Md Tahmid Rahman Laskar , Chun Peng , Jimmy Huang

Large language models (LLMs) such as ChatGPT can produce coherent, cohesive, relevant, and fluent answers for various natural language processing (NLP) tasks. Taking document-level machine translation (MT) as a testbed, this paper provides…

Computation and Language · Computer Science 2023-10-25 Longyue Wang , Chenyang Lyu , Tianbo Ji , Zhirui Zhang , Dian Yu , Shuming Shi , Zhaopeng Tu