English
Related papers

Related papers: Omni-o3: Deep Nested Omnimodal Deduction for Delib…

200 papers

Large Language Models (LLMs) demonstrate enhanced capabilities and reliability by reasoning more, evolving from Chain-of-Thought prompting to product-level solutions like OpenAI o1. Despite various efforts to improve LLM reasoning,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-05 Yuhao Dong , Zuyan Liu , Hai-Long Sun , Jingkang Yang , Winston Hu , Yongming Rao , Ziwei Liu

Multimodal Large Language Models (MLLMs) have recently made rapid progress toward unified Omni models that integrate vision, language, and audio. However, existing environments largely focus on 2D or 3D visual context and vision-language…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Yurui Dong , Ziyue Wang , Shuyun Lu , Dairu Liu , Xuechen Liu , Fuwen Luo , Peng Li , Yang Liu

Multimodal embedding models aim to map heterogeneous inputs, such as text, images, videos, and audio, into a shared semantic space. However, existing methods and benchmarks remain largely limited to partial modality coverage, making it…

Information Retrieval · Computer Science 2026-04-28 Haohang Huang , Xuan Lu , Mingyi Su , Xuan Zhang , Ziyan Jiang , Ping Nie , Kai Zou , Tomas Pfister , Wenhu Chen , Wei Zhang , Xiaoyu Shen , Rui Meng

Omni-modal Large Language Models (OLLMs) that process text, images, videos, and audio introduce new challenges for safety and value guardrails in human-AI interaction. Prior guardrail research largely targets unimodal settings and typically…

Artificial Intelligence · Computer Science 2025-12-03 Boyu Zhu , Xiaofei Wen , Wenjie Jacky Mo , Tinghui Zhu , Yanan Xie , Peng Qi , Muhao Chen

Recent work on human animation usually incorporates large-scale video models, thereby achieving more vivid performance. However, the practical use of such methods is hindered by the slow inference speed and high computational demands.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Rang Meng , Yan Wang , Weipeng Wu , Ruobing Zheng , Yuming Li , Chenguang Ma

Standard Transformers have a fixed computational depth, fundamentally limiting their ability to generalize to tasks requiring variable-depth reasoning, such as multi-hop graph traversal or nested logic. We propose a depth-recurrent…

Machine Learning · Computer Science 2026-03-24 Hung-Hsuan Chen

Open-vocabulary detection (OVD) is a challenging task to detect and classify objects from an unrestricted set of categories, including those unseen during training. Existing open-vocabulary detectors are limited by complex visual-textual…

Computer Vision and Pattern Recognition · Computer Science 2025-02-27 Caixiong Li , Xiongwei Zhao , Jinhang Zhang , Xing Zhang , Qihao Sun , Zhou Wu

Reasoning-enabled large language models (LLMs) excel in logical tasks, yet their utility for evaluating natural language generation remains unexplored. This study systematically compares reasoning LLMs with non-reasoning counterparts across…

Computation and Language · Computer Science 2025-06-02 Daniil Larionov , Sotaro Takeshita , Ran Zhang , Yanran Chen , Christoph Leiter , Zhipin Wang , Christian Greisinger , Steffen Eger

Large multimodal reasoning models have achieved rapid progress, but their advancement is constrained by two major limitations: the absence of open, large-scale, high-quality long chain-of-thought (CoT) data, and the instability of…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Sicong Leng , Jing Wang , Jiaxi Li , Hao Zhang , Zhiqiang Hu , Boqiang Zhang , Yuming Jiang , Hang Zhang , Xin Li , Lidong Bing , Deli Zhao , Wei Lu , Yu Rong , Aixin Sun , Shijian Lu

Large reasoning models (LRMs) like OpenAI-o1 have demonstrated impressive long stepwise reasoning capabilities through large-scale reinforcement learning. However, their extended reasoning processes often suffer from knowledge…

Artificial Intelligence · Computer Science 2025-01-10 Xiaoxi Li , Guanting Dong , Jiajie Jin , Yuyao Zhang , Yujia Zhou , Yutao Zhu , Peitian Zhang , Zhicheng Dou

This paper presents our winning submission to the AI Mathematical Olympiad - Progress Prize 2 (AIMO-2) competition. Our recipe for building state-of-the-art mathematical reasoning models relies on three key pillars. First, we create a…

Artificial Intelligence · Computer Science 2025-04-24 Ivan Moshkov , Darragh Hanley , Ivan Sorokin , Shubham Toshniwal , Christof Henkel , Benedikt Schifferer , Wei Du , Igor Gitman

Recent advances in reasoning models have demonstrated remarkable success in text and vision domains through extended chain-of-thought deliberation. However, a perplexing phenomenon persists in audio language models: they consistently…

Deep reinforcement learning has achieved remarkable performance in various domains by leveraging deep neural networks for approximating value functions and policies. However, using neural networks to approximate value functions or policy…

Machine Learning · Computer Science 2023-10-31 Yiqin Tan , Ling Pan , Longbo Huang

This paper asks whether a bounded neural architecture can exhibit a meaningful division of labor between intuition and deliberation on a classic 64-item syllogistic reasoning benchmark. More broadly, the benchmark is relevant to ongoing…

Artificial Intelligence · Computer Science 2026-03-25 Laurence Anthony

We present Omni-Embed-Nemotron, a unified multimodal retrieval embedding model developed to handle the increasing complexity of real-world information needs. While Retrieval-Augmented Generation (RAG) has significantly advanced language…

Computation and Language · Computer Science 2025-10-07 Mengyao Xu , Wenfei Zhou , Yauhen Babakhin , Gabriel Moreira , Ronay Ak , Radek Osmulski , Bo Liu , Even Oldridge , Benedikt Schifferer

While recent multimodal large language models (MLLMs) have made impressive strides, they predominantly employ a conventional autoregressive architecture as their backbone, leaving significant room to explore effective and efficient…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Lijiang Li , Zuwei Long , Yunhang Shen , Heting Gao , Haoyu Cao , Xing Sun , Caifeng Shan , Ran He , Chaoyou Fu

While Deep Learning has improved Brain-Computer Interface (BCI) decoding accuracy, clinical adoption is hindered by the "Black Box" nature of these algorithms, leading to user frustration and poor neuroplasticity outcomes. We propose…

Artificial Intelligence · Computer Science 2026-01-06 Ayda Aghaei Nia

The emergence of large language models has enabled sophisticated multi-agent systems, yet coordinating their reasoning capabilities through prompt engineering remains challenging. We present a theoretically-grounded framework for dynamic…

Multiagent Systems · Computer Science 2025-10-02 Hassen Dhrif

Recent video multimodal large language models (MLLMs) increasingly couple step-by-step reasoning with on-demand visual evidence retrieval, allowing models to revisit relevant video segments during inference. However, two structural gaps…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Peng Zhang , Guanghao Zhang , Wanggui He , Longxiang Zhang , Mushui Liu , Yan Xia , Zhenhao Peng , Weilong Dai , Jinlong Liu , Haobing Tang , Le Zhang , Hao Jiang , Pipei Huang

Multi-modal reasoning requires the seamless integration of visual and linguistic cues, yet existing Chain-of-Thought methods suffer from two critical limitations in cross-modal scenarios: (1) over-reliance on single coarse-grained image…

Computer Vision and Pattern Recognition · Computer Science 2026-01-07 Wenting Lu , Didi Zhu , Tao Shen , Donglin Zhu , Ayong Ye , Chao Wu