English
Related papers

Related papers: InternVL-U: Democratizing Unified Multimodal Model…

200 papers

With the rapid growth of video generative models (VGMs), it is essential to develop reliable and comprehensive automatic metrics for AI-generated videos (AIGVs). Existing methods either use off-the-shelf models optimized for other tasks or…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Yuanxin Liu , Rui Zhu , Shuhuai Ren , Jiacong Wang , Haoyuan Guo , Xu Sun , Lu Jiang

Language models (LMs) and their extension, vision-language models (VLMs), have achieved remarkable performance across various tasks. However, they still struggle with complex reasoning tasks that require multimodal or multilingual…

Machine Learning · Computer Science 2025-07-09 Wenyi Wu , Zixuan Song , Kun Zhou , Yifei Shao , Zhiting Hu , Biwei Huang

Despite the impressive progress on understanding and generating images shown by the recent unified architectures, the integration of 3D tasks remains challenging and largely unexplored. In this paper, we introduce UniUGG, the first unified…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Yueming Xu , Jiahui Zhang , Ze Huang , Yurui Chen , Yanpeng Zhou , Zhenyu Chen , Yu-Jie Yuan , Pengxiang Xia , Guowei Huang , Xinyue Cai , Zhongang Qi , Xingyue Quan , Jianye Hao , Hang Xu , Li Zhang

We present GLM-4.1V-Thinking, GLM-4.5V, and GLM-4.6V, a family of vision-language models (VLMs) designed to advance general-purpose multimodal understanding and reasoning. In this report, we share our key findings in the development of the…

Recent time series modeling faces a sharp divide between numerical generation and semantic understanding, with research showing that generation models often rely on superficial pattern matching, while understanding-oriented models struggle…

Machine Learning · Computer Science 2026-02-20 Tong Guan , Sheng Pan , Johan Barthelemy , Zhao Li , Yujun Cai , Cesare Alippi , Ming Jin , Shirui Pan

Multimodal Large Language Models (MLLMs) have emerged to tackle the challenges of Visual Question Answering (VQA), sparking a new research focus on conducting objective evaluations of these models. Existing evaluation methods face…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Qihui Zhang , Munan Ning , Zheyuan Liu , Yanbo Wang , Jiayi Ye , Yue Huang , Shuo Yang , Xiao Chen , Yibing Song , Li Yuan

While recent advancements in multimodal language models have enabled image generation from expressive multi-image instructions, existing methods struggle to maintain performance under complex interleaved instructions. This limitation stems…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Yabo Zhang , Kunchang Li , Dewei Zhou , Xinyu Huang , Xun Wang

Despite the significant advancements represented by Vision-Language Models (VLMs), current architectures often exhibit limitations in retaining fine-grained visual information, leading to coarse-grained multimodal comprehension. We…

Although Large Vision Language Models (LVLMs) have demonstrated impressive multimodal reasoning capabilities, their scalability and deployment are constrained by massive computational requirements. In particular, the massive amount of…

Machine Learning · Computer Science 2026-04-14 Surendra Pathak , Bo Han

Recent breakthroughs in large multimodal models (LMMs) have significantly advanced both text-to-image (T2I) generation and image-to-text (I2T) interpretation. However, many generated images still suffer from issues related to perceptual…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Jiarui Wang , Huiyu Duan , Yu Zhao , Juntong Wang , Guangtao Zhai , Xiongkuo Min

Latent diffusion models (LDM) have revolutionized text-to-image generation, leading to the proliferation of various advanced models and diverse downstream applications. However, despite these significant advancements, current diffusion…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Jiacheng Zhang , Jie Wu , Yuxi Ren , Xin Xia , Huafeng Kuang , Pan Xie , Jiashi Li , Xuefeng Xiao , Weilin Huang , Shilei Wen , Lean Fu , Guanbin Li

Existing Large Vision-Language Models (LVLMs) excel at matching concepts across multi-modal inputs but struggle with compositional concepts and high-level relationships between entities. This paper introduces Progressive multi-granular…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Quang-Hung Le , Long Hoang Dang , Ngan Le , Truyen Tran , Thao Minh Le

Prevalent Vision-Language-Action (VLA) models are typically built upon Multimodal Large Language Models (MLLMs) and demonstrate exceptional proficiency in semantic understanding, but they inherently lack the capability to deduce physical…

Recent advancements in Unified Multimodal Models (UMMs) have enabled remarkable image understanding and generation capabilities. However, while models like Gemini-2.5-Flash-Image show emerging abilities to reason over multiple related…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Mingrui Wu , Hang Liu , Jiayi Ji , Xiaoshuai Sun , Rongrong Ji

Recent developments in Multimodal Large Language Models (MLLMs) have shown rapid progress, moving towards the goal of creating versatile MLLMs that understand inputs from various modalities. However, existing methods typically rely on joint…

Computer Vision and Pattern Recognition · Computer Science 2024-07-29 Chi Chen , Yiyang Du , Zheng Fang , Ziyue Wang , Fuwen Luo , Peng Li , Ming Yan , Ji Zhang , Fei Huang , Maosong Sun , Yang Liu

Recent Large Vision Language Models (LVLMs) demonstrate promising capabilities in unifying visual understanding and generative modeling, enabling both accurate content understanding and flexible editing. However, current approaches treat…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Fan Yang , Yousong Zhu , Xin Li , Yufei Zhan , Hongyin Zhao , Shurong Zheng , Yaowei Wang , Ming Tang , Jinqiao Wang

The advent of Unified Multimodal Models (UMMs) signals a paradigm shift in artificial intelligence, moving from passive perception to active, cross-modal generation. Despite their unprecedented ability to synthesize information, a critical…

Artificial Intelligence · Computer Science 2026-01-15 Jingxuan Wei , Caijun Jia , Xi Bai , Xinglong Xu , Siyuan Li , Linzhuang Sun , Bihui Yu , Conghui He , Lijun Wu , Cheng Tan

Vision Large Language Models (VLLMs) usually take input as a concatenation of image token embeddings and text token embeddings and conduct causal modeling. However, their internal behaviors remain underexplored, raising the question of…

Computation and Language · Computer Science 2025-05-16 Houjing Wei , Yuting Shi , Naoya Inoue

Unified multimodal models significantly improve visual generation by combining vision-language models (VLMs) with diffusion models. However, existing methods struggle to fully balance sufficient interaction and flexible implementation due…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Jiangtong Tan , Lin Liu , Jie Huanng , Xiaopeng Zhang , Qi Tian , Feng Zhao

Interleaved image-text generation has emerged as a crucial multimodal task, aiming at creating sequences of interleaved visual and textual content given a query. Despite notable advancements in recent multimodal large language models…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Wei Chen , Lin Li , Yongqi Yang , Bin Wen , Fan Yang , Tingting Gao , Yu Wu , Long Chen