English
Related papers

Related papers: InternVL-U: Democratizing Unified Multimodal Model…

200 papers

Large Language Models (LLMs) are increasingly utilised in software engineering, yet their ability to generate structured artefacts such as UML diagrams remains underexplored. In this work we present NOMAD, a cognitively inspired, modular…

Software Engineering · Computer Science 2026-05-04 Polydoros Giannouris , Sophia Ananiadou

Image-text matching (ITM) aims to address the fundamental challenge of aligning visual and textual modalities, which inherently differ in their representations, continuous, high-dimensional image features vs. discrete, structured text. We…

Multimedia · Computer Science 2025-07-14 Junyu Chen , Yihua Gao , Mingyong Li

In complex embodied long-horizon manipulation tasks, effective task decomposition and execution require synergistic integration of textual logical reasoning and visual-spatial imagination to ensure efficient and accurate operation. Current…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Xinyan Cai , Shiguang Wu , Dafeng Chi , Yuzheng Zhuang , Xingyue Quan , Jianye Hao , Qiang Guan

We present Thinking with Generated Images, a novel paradigm that fundamentally transforms how large multimodal models (LMMs) engage with visual reasoning by enabling them to natively think across text and vision modalities through…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Ethan Chern , Zhulin Hu , Steffi Chern , Siqi Kou , Jiadi Su , Yan Ma , Zhijie Deng , Pengfei Liu

Multi-modal large language models (MLLMs) have shown incredible capabilities in a variety of 2D vision and language tasks. We extend MLLMs' perceptual capabilities to ground and reason about images in 3-dimensional space. To that end, we…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Jang Hyun Cho , Boris Ivanovic , Yulong Cao , Edward Schmerling , Yue Wang , Xinshuo Weng , Boyi Li , Yurong You , Philipp Krähenbühl , Yan Wang , Marco Pavone

Multimodal large language models (MLLMs) extend the success of language models to visual understanding, and recent efforts have sought to build unified MLLMs that support both understanding and generation. However, constructing such models…

Computer Vision and Pattern Recognition · Computer Science 2025-10-03 Hanyu Wang , Jiaming Han , Ziyan Yang , Qi Zhao , Shanchuan Lin , Xiangyu Yue , Abhinav Shrivastava , Zhenheng Yang , Hao Chen

Unifying multimodal understanding and generation has shown impressive capabilities in cutting-edge proprietary systems. In this work, we introduce BAGEL, an open-source foundational model that natively supports multimodal understanding and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Chaorui Deng , Deyao Zhu , Kunchang Li , Chenhui Gou , Feng Li , Zeyu Wang , Shu Zhong , Weihao Yu , Xiaonan Nie , Ziang Song , Guang Shi , Haoqi Fan

Recent advances in unified multimodal models (UMMs) have led to a proliferation of architectures capable of understanding, generating, and editing across visual and textual modalities. However, developing a unified framework for UMMs…

Artificial Intelligence · Computer Science 2026-05-21 Yinyi Luo , Wenwen Wang , Hayes Bai , Hongyu Zhu , Hao Chen , Pan He , Marios Savvides , Sharon Li , Jindong Wang

We introduce VisualPRM, an advanced multimodal Process Reward Model (PRM) with 8B parameters, which improves the reasoning abilities of existing Multimodal Large Language Models (MLLMs) across different model scales and families with…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Weiyun Wang , Zhangwei Gao , Lianjie Chen , Zhe Chen , Jinguo Zhu , Xiangyu Zhao , Yangzhou Liu , Yue Cao , Shenglong Ye , Xizhou Zhu , Lewei Lu , Haodong Duan , Yu Qiao , Jifeng Dai , Wenhai Wang

We introduce Youtu-LLM, a lightweight yet powerful language model that harmonizes high computational efficiency with native agentic intelligence. Unlike typical small models that rely on distillation, Youtu-LLM (1.96B) is pre-trained from…

Recent progress in medical vision-language models (VLMs) has achieved strong performance on image-level text-centric tasks such as report generation and visual question answering (VQA). However, achieving fine-grained visual grounding and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Yang Xing , Jiong Wu , Savas Ozdemir , Ying Zhang , Yang Yang , Wei Shao , Kuang Gong

We propose LLM-Interleaved (LLM-I), a flexible and dynamic framework that reframes interleaved image-text generation as a tool-use problem. LLM-I is designed to overcome the "one-tool" bottleneck of current unified models, which are limited…

Machine Learning · Computer Science 2025-09-18 Zirun Guo , Feng Zhang , Kai Jia , Tao Jin

Verification presents a major bottleneck in Integrated Circuit (IC) development, consuming nearly 70% of total effort. While the Universal Verification Methodology (UVM) improves reuse through structured verification environments,…

Hardware Architecture · Computer Science 2026-05-08 Junhao Ye , Dingrong Pan , Hanyuan Liu , Yuchen Hu , Jie Zhou , Ke Xu , Xinwei Fang , Xi Wang , Nan Guan , Zhe Jiang

Large Language Models (LLMs) have achieved remarkable reliability and advanced capabilities through extended test-time reasoning. However, extending these capabilities to Multi-modal Large Language Models (MLLMs) remains a significant…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Yuhao Dong , Zuyan Liu , Shulin Tian , Yongming Rao , Ziwei Liu

Large language models (LLMs) have proven their remarkable versatility in handling a comprehensive range of language-centric applications. To expand LLMs' capabilities to a broader spectrum of modal inputs, multimodal large language models…

Computer Vision and Pattern Recognition · Computer Science 2023-12-07 Qiang Zhou , Zhibin Wang , Wei Chu , Yinghui Xu , Hao Li , Yuan Qi

Multimodal large language models (MLLMs) have gained significant attention due to their strong multimodal understanding capability. However, existing works rely heavily on modality-specific encoders, which usually differ in architecture and…

Computer Vision and Pattern Recognition · Computer Science 2025-01-10 Jiaming Han , Kaixiong Gong , Yiyuan Zhang , Jiaqi Wang , Kaipeng Zhang , Dahua Lin , Yu Qiao , Peng Gao , Xiangyu Yue

The Unified Modeling Language is a standardized visual language widely used for modeling and documenting the design of software systems. Although many tools generate UML diagrams from UML code, generating executable UML code from…

Software Engineering · Computer Science 2025-05-16 Averi Bates , Ryan Vavricka , Shane Carleton , Ruosi Shao , Chongle Pan

In discrete generative modeling, two dominant paradigms demonstrate divergent capabilities: Masked Diffusion Language Models (MDLM) excel at semantic understanding and zero-shot generalization, whereas Uniform-noise Diffusion Language…

Computation and Language · Computer Science 2026-02-03 Yue Liu , Yuzhong Zhao , Zheyong Xie , Qixiang Ye , Jianbin Jiao , Yao Hu , Shaosheng Cao , Yunfan Liu

Multimodal Large Language Models (MLLMs) excel in solving text-based mathematical problems, but they struggle with mathematical diagrams since they are primarily trained on natural scene images. For humans, visual aids generally enhance…

Computation and Language · Computer Science 2024-09-26 Wenwen Zhuang , Xin Huang , Xiantao Zhang , Jin Zeng

Unified Multimodal Large Language Models (MLLMs) require a visual representation that simultaneously supports high-fidelity reconstruction, complex semantic extraction, and generative suitability. However, existing visual tokenizers…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Shaobin Zhuang , Yuang Ai , Jiaming Han , Weijia Mao , Xiaohui Li , Fangyikang Wang , Xiao Wang , Yan Li , Shanchuan Lin , Kun Xu , Zhenheng Yang , Huaibo Huang , Xiangyu Yue , Hao Chen , Yali Wang
‹ Prev 1 8 9 10 Next ›