English
Related papers

Related papers: FTibSuite: A Comprehensive Resource Suite for Tibe…

200 papers

Recent advancements in multimodal techniques open exciting possibilities for models excelling in diverse tasks involving text, audio, and image processing. Models like GPT-4V, blending computer vision and language modeling, excel in complex…

Computation and Language · Computer Science 2023-10-20 Xiang Zhang , Senyu Li , Zijun Wu , Ning Shi

In recent years, multimodal large language models (MLLMs) such as GPT-4V have demonstrated remarkable advancements, excelling in a variety of vision-language tasks. Despite their prowess, the closed-source nature and computational demands…

Computer Vision and Pattern Recognition · Computer Science 2024-06-24 Zhengqing Yuan , Zhaoxu Li , Weiran Huang , Yanfang Ye , Lichao Sun

Large language models (LLMs) have increased interest in vision language models (VLMs), which process image-text pairs as input. Studies investigating the visual understanding ability of VLMs have been proposed, but such studies are still…

Computation and Language · Computer Science 2024-06-25 Jesse Atuhurra , Iqra Ali , Tatsuya Hiraoka , Hidetaka Kamigaito , Tomoya Iwakura , Taro Watanabe

We open-source MiMo-VL-7B-SFT and MiMo-VL-7B-RL, two powerful vision-language models delivering state-of-the-art performance in both general visual understanding and multimodal reasoning. MiMo-VL-7B-RL outperforms Qwen2.5-VL-7B on 35 out of…

The rapid development of multimodal large language models (MLLMs) raises the question of how they compare to human performance. While existing datasets often feature synthetic or overly simplistic tasks, some models have already surpassed…

Computation and Language · Computer Science 2025-10-16 Zichen Zhu , Yang Xu , Lu Chen , Jingkai Yang , Yichuan Ma , Yiming Sun , Hailin Wen , Jiaqi Liu , Jinyu Cai , Yingzi Ma , Situo Zhang , Zihan Zhao , Liangtai Sun , Kai Yu

Recent advancements in large language models (LLMs) have driven interest in billion-scale retrieval models with strong generalization across retrieval tasks and languages. Additionally, progress in large vision-language models has created…

Information Retrieval · Computer Science 2025-05-06 Xueguang Ma , Luyu Gao , Shengyao Zhuang , Jiaqi Samantha Zhan , Jamie Callan , Jimmy Lin

Vision language models (VLMs) have seen growing adoption in recent years, but many still struggle with basic spatial reasoning errors. We hypothesize that this is due to VLMs adopting pre-trained vision backbones, specifically vision…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Ian Covert , Tony Sun , James Zou , Tatsunori Hashimoto

Modular vision-language models (Vision-LLMs) align pretrained image encoders with (frozen) large language models (LLMs) and post-hoc condition LLMs to `understand' the image input. With the abundance of readily available high-quality…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Gregor Geigle , Abhay Jain , Radu Timofte , Goran Glavaš

We introduce Qwen3-VL, the most capable vision-language model in the Qwen series to date, achieving superior performance across a broad range of multimodal benchmarks. It natively supports interleaved contexts of up to 256K tokens,…

In this report, we introduce the Qwen3-VL-Embedding and Qwen3-VL-Reranker model series, the latest extensions of the Qwen family built on the Qwen3-VL foundation model. Together, they provide an end-to-end pipeline for high-precision…

Computation and Language · Computer Science 2026-01-21 Mingxin Li , Yanzhao Zhang , Dingkun Long , Keqin Chen , Sibo Song , Shuai Bai , Zhibo Yang , Pengjun Xie , An Yang , Dayiheng Liu , Jingren Zhou , Junyang Lin

Recent advances in Speech Large Language Models (Speech-LLMs) have made significant progress, greatly enhancing multimodal interaction capabilities.However, their application in low-resource and dialect-diverse environments still faces…

Sound · Computer Science 2026-04-29 Jialing Wang , Yue Zhao , Yuhao Zhang , Jing Yu , Shaosai Li , Zhanchen Dai , Benyou Wang , Haizhou Li

Evaluating the alignment capabilities of large Vision-Language Models (VLMs) is essential for determining their effectiveness as helpful assistants. However, existing benchmarks primarily focus on basic abilities using nonverbal methods,…

Computation and Language · Computer Science 2025-06-05 Yuhang Wu , Wenmeng Yu , Yean Cheng , Yan Wang , Xiaohan Zhang , Jiazheng Xu , Ming Ding , Yuxiao Dong

Large Vision-Language Models (LVLMs) have achieved remarkable success, yet their significant computational demands hinder practical deployment. While efforts to improve LVLM efficiency are growing, existing methods lack comprehensive…

Computation and Language · Computer Science 2025-06-03 Zekun Wang , Minghua Ma , Zexin Wang , Rongchuan Mu , Liping Shan , Ming Liu , Bing Qin

We present the Qwen2-VL Series, an advanced upgrade of the previous Qwen-VL models that redefines the conventional predetermined-resolution approach in visual processing. Qwen2-VL introduces the Naive Dynamic Resolution mechanism, which…

Computer Vision and Pattern Recognition · Computer Science 2024-10-04 Peng Wang , Shuai Bai , Sinan Tan , Shijie Wang , Zhihao Fan , Jinze Bai , Keqin Chen , Xuejing Liu , Jialin Wang , Wenbin Ge , Yang Fan , Kai Dang , Mengfei Du , Xuancheng Ren , Rui Men , Dayiheng Liu , Chang Zhou , Jingren Zhou , Junyang Lin

Large Language Models (LLMs) have introduced a new era of proficiency in comprehending complex healthcare and biomedical topics. However, there is a noticeable lack of models in languages other than English and models that can interpret…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Junling Liu , Ziming Wang , Qichen Ye , Dading Chong , Peilin Zhou , Yining Hua

Integrating image and text data through multi-modal learning has emerged as a new approach in medical imaging research, following its successful deployment in computer vision. While considerable efforts have been dedicated to establishing…

Computer Vision and Pattern Recognition · Computer Science 2024-09-09 Fereshteh Shakeri , Yunshi Huang , Julio Silva-Rodríguez , Houda Bahig , An Tang , Jose Dolz , Ismail Ben Ayed

Recent advances in large language models (LLMs) and vision-language models (LVLMs) have shown promise across many tasks, yet their scientific reasoning capabilities remain untested, particularly in multimodal settings. We present…

Machine Learning · Computer Science 2025-06-03 Xinwu Ye , Chengfan Li , Siming Chen , Wei Wei , Xiangru Tang

Large language models (LLMs) have demonstrated prowess in a wide range of tasks. However, many LLMs exhibit significant performance discrepancies between high- and low-resource languages. To mitigate this challenge, we present FuxiTranyu,…

Computation and Language · Computer Science 2024-10-29 Haoran Sun , Renren Jin , Shaoyang Xu , Leiyu Pan , Supryadi , Menglong Cui , Jiangcun Du , Yikun Lei , Lei Yang , Ling Shi , Juesi Xiao , Shaolin Zhu , Deyi Xiong

Recent advances in multimodal large language models (MLLMs) have enabled impressive progress in vision-language understanding, yet their high computational cost limits deployment in resource-constrained scenarios such as personal…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Quoc-Huy Trinh , Mustapha Abdullahi , Bo Zhao , Debesh Jha

Multimodal large language models (MLLMs) have achieved remarkable success across a broad range of vision tasks. However, constrained by the capacity of their internal world knowledge, prior work has proposed augmenting MLLMs by…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Wenxuan Huang , Yu Zeng , Qiuchen Wang , Zhen Fang , Shaosheng Cao , Zheng Chu , Qingyu Yin , Shuang Chen , Zhenfei Yin , Lin Chen , Zehui Chen , Xu Tang , Yao Hu , Shaohui Lin , Philip Torr , Feng Zhao , Wanli Ouyang