English
Related papers

Related papers: UVLM: A Universal Vision-Language Model Loader for…

200 papers

Unified vision-language frameworks have greatly advanced in recent years, most of which adopt an encoder-decoder architecture to unify image-text tasks as sequence-to-sequence generation. However, existing video-language (VidL) models still…

Computer Vision and Pattern Recognition · Computer Science 2022-06-16 Linjie Li , Zhe Gan , Kevin Lin , Chung-Ching Lin , Zicheng Liu , Ce Liu , Lijuan Wang

We introduce UViM, a unified approach capable of modeling a wide range of computer vision tasks. In contrast to previous models, UViM has the same functional form for all tasks; it requires no task-specific modifications which require…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Alexander Kolesnikov , André Susano Pinto , Lucas Beyer , Xiaohua Zhai , Jeremiah Harmsen , Neil Houlsby

With Transformers achieving outstanding performance on individual remote sensing (RS) tasks, we are now approaching the realization of a unified model that excels across multiple tasks through multi-task learning (MTL). Compared to…

Computer Vision and Pattern Recognition · Computer Science 2026-01-12 Qingyun Li , Shuran Ma , Junwei Luo , Yi Yu , Yue Zhou , Fengxiang Wang , Xudong Lu , Xiaoxing Wang , Xin He , Yushi Chen , Xue Yang

Multimodal large language models are increasingly expected to perform thinking with images, yet existing visual latent reasoning methods still rely on explicit textual chain-of-thought interleaved with visual latent tokens. This interleaved…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Houcheng Jiang , Jiajun Fu , Junfeng Fang , Chen Gao , Xiang Wang , Xiangnan He , Yong Li

Recent advancements in multi-modal large language models (MLLMs) have led to substantial improvements in visual understanding, primarily driven by sophisticated modality alignment strategies. However, predominant approaches prioritize…

Computer Vision and Pattern Recognition · Computer Science 2024-08-29 Jinjin Xu , Liwu Xu , Yuzhe Yang , Xiang Li , Fanyi Wang , Yanchun Xie , Yi-Jie Huang , Yaqian Li

We present GLM-4.1V-Thinking, GLM-4.5V, and GLM-4.6V, a family of vision-language models (VLMs) designed to advance general-purpose multimodal understanding and reasoning. In this report, we share our key findings in the development of the…

Recently, the remarkable success of large language models (LLMs) has achieved a profound impact on the field of artificial intelligence. Numerous advanced works based on LLMs have been proposed and applied in various scenarios. Among them,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Xizhe Xue , Yang Zhou , Dawei Yan , Lijie Tao , Junjie Li , Ying Li , Haokui Zhang , Rong Xiao

Multimodal Vision Language Models (VLMs) have emerged as a transformative topic at the intersection of computer vision and natural language processing, enabling machines to perceive and reason about the world through both visual and textual…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Zongxia Li , Xiyang Wu , Hongyang Du , Fuxiao Liu , Huy Nghiem , Guangyao Shi

We present VisionLLM v2, an end-to-end generalist multimodal large model (MLLM) that unifies visual perception, understanding, and generation within a single framework. Unlike traditional MLLMs limited to text output, VisionLLM v2…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Jiannan Wu , Muyan Zhong , Sen Xing , Zeqiang Lai , Zhaoyang Liu , Zhe Chen , Wenhai Wang , Xizhou Zhu , Lewei Lu , Tong Lu , Ping Luo , Yu Qiao , Jifeng Dai

We introduce Xmodel-VLM, a cutting-edge multimodal vision language model. It is designed for efficient deployment on consumer GPU servers. Our work directly confronts a pivotal industry issue by grappling with the prohibitive service costs…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Wanting Xu , Yang Liu , Langping He , Xucheng Huang , Ling Jiang

Current large vision-language models (LVLMs) typically employ a connector module to link visual features with text embeddings of large language models (LLMs) and use end-to-end training to achieve multi-modal understanding in a unified…

Artificial Intelligence · Computer Science 2025-08-14 Zixian Guo , Ming Liu , Qilong Wang , Zhilong Ji , Jinfeng Bai , Lei Zhang , Wangmeng Zuo

Multimodal large language models (MLLMs) have enabled a wide range of advanced vision-language applications, including fine-grained object recognition and contextual understanding. When querying specific regions or objects in an image,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Mingjie Xu , Jinpeng Chen , Yuzhi Zhao , Jason Chun Lok Li , Yue Qiu , Zekang Du , Mengyang Wu , Pingping Zhang , Kun Li , Hongzheng Yang , Wenao Ma , Jiaheng Wei , Qinbin Li , Kangcheng Liu , Wenqiang Lei

Large Vision-Language Models (LVLMs) have become essential for advancing the integration of visual and linguistic information. However, the evaluation of LVLMs presents significant challenges as the evaluation benchmark always demands lots…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Han Bao , Yue Huang , Yanbo Wang , Jiayi Ye , Xiangqi Wang , Xiuying Chen , Yue Zhao , Tianyi Zhou , Mohamed Elhoseiny , Xiangliang Zhang

Current visual grounding models are either based on a Multimodal Large Language Model (MLLM) that performs auto-regressive decoding, which is slow and risks hallucinations, or on re-aligning an LLM with vision features to learn new special…

Computer Vision and Pattern Recognition · Computer Science 2025-12-15 Weitai Kang , Jason Kuen , Mengwei Ren , Zijun Wei , Yan Yan , Kangning Liu

Vision-language models (VLMs) are essential to Embodied AI, enabling robots to perceive, reason, and act in complex environments. They also serve as the foundation for the recent Vision-Language-Action (VLA) models. Yet most evaluations of…

World models - generative models that simulate environment dynamics conditioned on past observations and actions - are gaining prominence in planning, simulation, and embodied AI. However, evaluating their rollouts remains a fundamental…

Despite the success of Large Vision--Language Models (LVLMs), most existing architectures suffer from a representation bottleneck: they rely on static, instruction-agnostic vision encoders whose visual representations are utilized in an…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Hanpeng Liu , Yaqian Li , Zidan Wang , Shuoxi Zhang , Zihao Bo , Rinyoichi Takezoe , Kaiwen Long , Kun He

Unified vision-language models (VLMs) promise to streamline computer vision pipelines by reframing multiple visual tasks such as classification, detection, and keypoint localization within a single language-driven interface. This…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Conor Wallace , Isaac Corley , Jonathan Lwowski

In the field of multimodal chain-of-thought (CoT) reasoning, existing approaches predominantly rely on reasoning on pure language space, which inherently suffers from language bias and is largely confined to math or science domains. This…

Computer Vision and Pattern Recognition · Computer Science 2026-05-04 Jiacong Wang , Zijian Kang , Haochen Wang , Haiyong Jiang , Jiawen Li , Bohong Wu , Ya Wang , Jiao Ran , Xiao Liang , Chao Feng , Jun Xiao

Large Vision-Language Models (LVLMs) consistently require new arenas to guide their expanding boundaries, yet their capabilities with hypergraphs remain unexplored. In the real world, hypergraphs have significant practical applications in…

Computation and Language · Computer Science 2026-04-20 Yanbin Wei , Chun Kang , Siwei Li , Haoxuan Che , Yang Chen , Hua Liu , Jian Liu , Zhuang Liu , Can Ouyang , Fei Xing , Lei Sha , Rui Liu , Yu Zhang , James Kwok