English
Related papers

Related papers: Phi-4-reasoning-vision-15B Technical Report

200 papers

We present a novel 4.5B parameter small language model that can handle multiple input and output modalities, including text, images, videos, and audio. Despite its small size, the model achieves near state-of-the-art performance on a…

Machine Learning · Computer Science 2024-11-12 Ben Koska , Mojmír Horváth

Effectiveness and interpretability are two essential properties for trustworthy AI systems. Most recent studies in visual reasoning are dedicated to improving the accuracy of predicted answers, and less attention is paid to explaining the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-14 Shi Chen , Qi Zhao

We present Nanbeige4-3B, a family of small-scale but high-performing language models. Pretrained on 23T high-quality tokens and finetuned on over 30 million diverse instructions, we extend the boundary of the scaling law for small language…

Large language models (LLMs) with Chain-of-Thought (CoT) prompting achieve strong reasoning but often produce unnecessarily long explanations, increasing cost and sometimes reducing accuracy. Fair comparison of efficiency-oriented…

Computation and Language · Computer Science 2025-11-14 Junquan Huang , Haotian Wu , Yubo Gao , Yibo Yan , Junyan Zhang , Yonghua Hei , Song Dai , Jie Zhang , Puay Siew Tan , Xuming Hu

Chain-of-thought (CoT) reasoning has exhibited impressive performance in language models for solving complex tasks and answering questions. However, many real-world questions require multi-modal information, such as text and images.…

Artificial Intelligence · Computer Science 2023-12-15 Liqi He , Zuchao Li , Xiantao Cai , Ping Wang

Recent advances in industrial anomaly detection have highlighted the need for deeper logical anomaly analysis, where unexpected relationships among objects, counts, and spatial configurations must be identified and explained. Existing…

Computer Vision and Pattern Recognition · Computer Science 2025-04-18 Weijia Li , Guanglei Chu , Jiong Chen , Guo-Sen Xie , Caifeng Shan , Fang Zhao

Multimodal Large Language Models (MLLMs) are undergoing rapid progress and represent the frontier of AI development. However, their training and inference efficiency have emerged as a core bottleneck in making MLLMs more accessible and…

Multimodal reasoning remains a fundamental challenge in artificial intelligence. Despite substantial advances in text-based reasoning, even state-of-the-art models such as GPT-o3 struggle to maintain strong performance in multimodal…

Computation and Language · Computer Science 2025-09-09 Hao Liang , Ruitao Wu , Bohan Zeng , Junbo Niu , Wentao Zhang , Bin Dong

Visual language reasoning requires a system to extract text or numbers from information-dense images like charts or plots and perform logical or arithmetic reasoning to arrive at an answer. To tackle this task, existing work relies on…

Computation and Language · Computer Science 2023-10-05 Peifang Wang , Olga Golovneva , Armen Aghajanyan , Xiang Ren , Muhao Chen , Asli Celikyilmaz , Maryam Fazel-Zarandi

Large vision-language models (LVLMs) have witnessed significant progress on visual understanding tasks. However, they often prioritize language knowledge over image information on visual reasoning tasks, incurring performance degradation.…

Computer Vision and Pattern Recognition · Computer Science 2025-10-16 Jingqi Zhou , Sheng Wang , Jingwei Dong , Kai Liu , Lei Li , Jiahui Gao , Jiyue Jiang , Lingpeng Kong , Chuan Wu

Multimodal Large Language Models (MLLMs) have shown impressive performance on vision-language tasks, but their long Chain-of-Thought (CoT) capabilities in multimodal scenarios remain underexplored. Inspired by OpenAI's o3 model, which…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Ye Wang , Qianglong Chen , Zejun Li , Siyuan Wang , Shijie Guo , Zhirui Zhang , Zhongyu Wei

Humans possess spatial reasoning abilities that enable them to understand spaces through multimodal observations, such as vision and sound. Large multimodal reasoning models extend these abilities by learning to perceive and reason, showing…

Medical imaging provides critical evidence for clinical diagnosis, treatment planning, and surgical decisions, yet most existing imaging models are narrowly focused and require multiple specialized networks, limiting their generalization.…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Guoxin Wang , Jun Zhao , Xinyi Liu , Yanbo Liu , Xuyang Cao , Chao Li , Zhuoyun Liu , Qintian Sun , Fangru Zhou , Haoqiang Xing , Zhenhong Yang

Remote-sensing applications often run on edge hardware that cannot host today's 7B-parameter multimodal language models. This paper introduces TinyRS, the first 2B-parameter multimodal small language model (MSLM) optimized for remote…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Aybora Koksal , A. Aydin Alatan

We present Hermes 4, a family of hybrid reasoning models that combine structured, multi-turn reasoning with broad instruction-following ability. We describe the challenges encountered during data curation, synthesis, training, and…

Artificial Intelligence · Computer Science 2025-09-03 Ryan Teknium , Roger Jin , Jai Suphavadeeprasit , Dakota Mahan , Jeffrey Quesnelle , Joe Li , Chen Guang , Shannon Sands , Karan Malhotra

We present GLM-4.1V-Thinking, GLM-4.5V, and GLM-4.6V, a family of vision-language models (VLMs) designed to advance general-purpose multimodal understanding and reasoning. In this report, we share our key findings in the development of the…

Over the past years, advances in artificial intelligence (AI) have demonstrated how AI can solve many perception and generation tasks, such as image classification and text writing, yet reasoning remains a challenge. This paper introduces…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Andreas Plesner , Turlan Kuzhagaliyev , Roger Wattenhofer

Recent R1-Zero-like research further demonstrates that reasoning extension has given large language models (LLMs) unprecedented reasoning capabilities, and Reinforcement Learning is the core technology to elicit its complex reasoning.…

Artificial Intelligence · Computer Science 2025-08-15 Anxiang Zeng , Haibo Zhang , Kaixiang Mo , Long Zhang , Shuman Liu , Yanhui Huang , Yawen Liu , Yuepeng Sheng , Yuwei Huang

Recently, improving the reasoning ability of large multimodal models (LMMs) through reinforcement learning has made great progress. However, most existing works are based on highly reasoning-intensive datasets such as mathematics and code,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Xingjian Zhang , Siwei Wen , Wenjun Wu , Lei Huang

Large Multimodal Models (LMMs) have recently demonstrated remarkable visual understanding performance on both vision-language and vision-centric tasks. However, they often fall short in integrating advanced, task-specific capabilities for…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Yufei Zhan , Hongyin Zhao , Yousong Zhu , Shurong Zheng , Fan Yang , Ming Tang , Jinqiao Wang