English
Related papers

Related papers: Omni-o3: Deep Nested Omnimodal Deduction for Delib…

200 papers

Data-driven modeling of constrained multibody dynamics remains challenged by (i) the training cost of Neural ODEs, which typically require backpropagation through an ODE solver, and (ii) error accumulation in rollout predictions. We…

Machine Learning · Computer Science 2026-03-23 Hongyu Wang , Jingquan Wang , Dan Negrut

Multimodal large language models (MLLMs) have shown strong vision-language reasoning abilities but still lack robust 3D spatial understanding, which is critical for autonomous driving. This limitation stems from two key challenges: (1) the…

Artificial Intelligence · Computer Science 2025-09-09 Ruixun Liu , Lingyu Kong , Derun Li , Hang Zhao

Training large language models (LLMs) with synthetic reasoning data has become a popular approach to enhancing their reasoning capabilities, while a key factor influencing the effectiveness of this paradigm is the quality of the generated…

Artificial Intelligence · Computer Science 2026-03-24 Zhuojie Yang , Wentao Wan , Keze Wang

Large language models have recently evolved from fluent text generation to advanced reasoning across diverse domains, giving rise to reasoning language models. Among these domains, mathematical reasoning serves as a representative benchmark…

Recently, reasoning-based MLLMs have achieved a degree of success in generating long-form textual reasoning chains. However, they still struggle with complex tasks that necessitate dynamic and iterative focusing on and revisiting of visual…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Chaoya Jiang , Yongrui Heng , Wei Ye , Han Yang , Haiyang Xu , Ming Yan , Ji Zhang , Fei Huang , Shikun Zhang

Deep reasoning is fundamental for solving complex tasks, especially in vision-centric scenarios that demand sequential, multimodal understanding. However, existing benchmarks typically evaluate agents with fully synthetic, single-turn…

Adaptive multimodal reasoning has emerged as a promising frontier in Vision-Language Models (VLMs), aiming to dynamically modulate between tool-augmented visual reasoning and text reasoning to enhance both effectiveness and efficiency.…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Xintong Zhang , Xiaowen Zhang , Jingrong Wu , Zhi Gao , Shilin Yan , Zhenxin Diao , Kunpeng Gao , Xuanyan Chen , Yuwei Wu , Yunde Jia , Qing Li

Longitudinal brain MRI is essential for characterizing the progression of neurological diseases such as Alzheimer's disease assessment. However, current deep-learning tools fragment this process: classifiers reduce a scan to a label,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Zhaoyang Jiang , Zhizhong Fu , David McAllister , Yunsoo Kim , Honghan Wu

Effectively retrieving, reasoning, and understanding multimodal information remains a critical challenge for agentic systems. Traditional Retrieval-augmented Generation (RAG) methods rely on linear interaction histories, which struggle to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Qiuchen Wang , Shihang Wang , Yu Zeng , Qiang Zhang , Fanrui Zhang , Zhuoning Guo , Bosi Zhang , Wenxuan Huang , Lin Chen , Zehui Chen , Pengjun Xie , Ruixue Ding

We present M2-omni, a cutting-edge, open-source omni-MLLM that achieves competitive performance to GPT-4o. M2-omni employs a unified multimodal sequence modeling framework, which empowers Large Language Models(LLMs) to acquire comprehensive…

Diffusion Large Language Models (dLLMs) are rapidly emerging alongside autoregressive models as a powerful paradigm for complex reasoning, with reinforcement learning increasingly used for downstream alignment. Existing trajectory-based RL…

Machine Learning · Computer Science 2025-11-20 Ranfei Chen , Ming Chen , Kaifei Wang

In this paper, we introduce a new task: Zero-Shot 3D Reasoning Segmentation for parts searching and localization for objects, which is a new paradigm to 3D segmentation that transcends limitations for previous category-specific 3D semantic…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Tianrun Chen , Chunan Yu , Jing Li , Jianqi Zhang , Lanyun Zhu , Deyi Ji , Yong Zhang , Ying Zang , Zejian Li , Lingyun Sun

Compositional visual reasoning has emerged as a key research frontier in multimodal AI, aiming to endow machines with the human-like ability to decompose visual scenes, ground intermediate concepts, and perform multi-step logical inference.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-28 Fucai Ke , Joy Hsu , Zhixi Cai , Zixian Ma , Xin Zheng , Xindi Wu , Sukai Huang , Weiqing Wang , Pari Delir Haghighi , Gholamreza Haffari , Ranjay Krishna , Jiajun Wu , Hamid Rezatofighi

We present a new pre-training strategy called M$^{3}$3D ($\underline{M}$ulti-$\underline{M}$odal $\underline{M}$asked $\underline{3D}$) built based on Multi-modal masked autoencoders that can leverage 3D priors and learned cross-modal…

Computer Vision and Pattern Recognition · Computer Science 2023-09-28 Muhammad Abdullah Jamal , Omid Mohareri

Multimodal Large Language Models (MLLMs) have shown remarkable progress in visual reasoning and understanding tasks but still struggle to capture the complexity and subjectivity of human emotions. Existing approaches based on supervised…

Artificial Intelligence · Computer Science 2026-03-02 Yiyang Fang , Wenke Huang , Pei Fu , Yihao Yang , Kehua Su , Zhenbo Luo , Jian Luan , Mang Ye

Recent advances in multimodal Reward Models (RMs) have shown significant promise in delivering reward signals to align vision models with human preferences. However, current RMs are generally restricted to providing direct responses or…

Computer Vision and Pattern Recognition · Computer Science 2025-10-30 Yibin Wang , Zhimin Li , Yuhang Zang , Chunyu Wang , Qinglin Lu , Cheng Jin , Jiaqi Wang

Vision-language models benefit from high-resolution images, but the increase in visual-token count incurs high compute overhead. Humans resolve this tension via foveation: a coarse view guides "where to look", while selectively acquired…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Juhong Min , Lazar Valkov , Vitali Petsiuk , Hossein Souri , Deen Dayal Mohan

Emerging reasoning models hold promise for automating scientific discovery. However, their training is hindered by a critical supervision gap: experimental outcomes are abundant, whereas intermediate reasoning steps are rarely documented at…

Biomolecules · Quantitative Biology 2026-03-24 Zequn Liu , Kehan Wu , Shufang Xie , Zekun Guo , Wei Zhang , Tao Qin , Renhe Liu , Yingce Xia

As multi-modal large language models (MLLMs) are increasingly applied to complex reasoning tasks, the diversity and quality of reasoning paths become crucial factors affecting their performance. Although current methods aim to enhance…

Neural and Evolutionary Computing · Computer Science 2024-12-12 Biqing Qi , Zhouyi Qian , Yiang Luo , Junqi Gao , Dong Li , Kaiyan Zhang , Bowen Zhou

Recent advances have explored integrating large language models (LLMs) into end-to-end autonomous driving systems to enhance generalization and interpretability. However, most existing approaches are limited to either driving performance or…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Yunsheng Ma , Burhaneddin Yaman , Xin Ye , Mahmut Yurt , Jingru Luo , Abhirup Mallik , Ziran Wang , Liu Ren