中文
相关论文

相关论文: Omni-AutoThink: Adaptive Multimodal Reasoning via …

200 篇论文

Multimodal Large Language Models (MLLMs) have gained significant traction for their ability to process diverse input data types and generate coherent, contextually relevant outputs across various applications. While supervised fine-tuning…

机器学习 · 计算机科学 2025-03-31 Zhiyuan Liu , Yuting Zhang , Feng Liu , Changwang Zhang , Ying Sun , Jun Wang

Large language models (LLMs) can face factual limitations when responding to time-sensitive queries about recent events that arise after their knowledge thresholds in the training corpus. Existing search-augmented approaches fall into two…

信息检索 · 计算机科学 2025-06-11 Wentao Shi , Yiqing Shen

In this work, we present the first application of Reinforcement Learning with Verifiable Reward (RLVR) to an Omni-multimodal large language model in the context of emotion recognition, a task where both visual and audio modalities play…

机器学习 · 计算机科学 2025-03-11 Jiaxing Zhao , Xihan Wei , Liefeng Bo

Vision-Language Models (VLMs) show promise for autonomous driving, yet their struggle with hallucinations, inefficient reasoning, and limited real-world validation hinders accurate perception and robust step-by-step reasoning. To overcome…

Standing in 2025, at a critical juncture in the pursuit of Artificial General Intelligence (AGI), reinforcement fine-tuning (RFT) has demonstrated significant potential in enhancing the reasoning capability of large language models (LLMs)…

计算与语言 · 计算机科学 2025-05-27 Haoyuan Sun , Jiaqi Wu , Bo Xia , Yifu Luo , Yifei Zhao , Kai Qin , Xufei Lv , Tiantian Zhang , Yongzhe Chang , Xueqian Wang

Reinforcement Learning (RL) has shown promise in improving the reasoning abilities of Large Language Models (LLMs). However, the specific challenges of adapting RL to multimodal data and formats remain relatively unexplored. In this work,…

机器学习 · 计算机科学 2025-05-20 Zirun Guo , Minjie Hong , Tao Jin

Human cognition operates through two complementary modes: fast intuitive thinking and slow deliberate thinking. Vanilla large language models (LLMs) predominantly follow the fast-thinking paradigm, producing immediate responses; while…

人工智能 · 计算机科学 2026-01-07 Shengjia Zhang , Junjie Wu , Jiawei Chen , Changwang Zhang , Zhe Li , Xingyu Lou , Wangchunshu Zhou , Sheng Zhou , Can Wang , Jun Wang

While anomaly detection has made significant progress, generating detailed analyses that incorporate industrial knowledge remains a challenge. To address this gap, we introduce OmniAD, a novel framework that unifies anomaly detection and…

计算机视觉与模式识别 · 计算机科学 2025-05-29 Shifang Zhao , Yiheng Lin , Lu Han , Yao Zhao , Yunchao Wei

Existing reasoning segmentation approaches typically fine-tune multimodal large language models (MLLMs) using image-text pairs and corresponding mask labels. However, they exhibit limited generalization to out-of-distribution scenarios…

计算机视觉与模式识别 · 计算机科学 2025-05-30 Song Wang , Gongfan Fang , Lingdong Kong , Xiangtai Li , Jianyun Xu , Sheng Yang , Qiang Li , Jianke Zhu , Xinchao Wang

The inherent capabilities of a language model (LM) and the reasoning strategies it employs jointly determine its performance in reasoning tasks. While test-time scaling is regarded as an effective approach to tackling complex reasoning…

计算与语言 · 计算机科学 2025-05-27 Zhihong Pan , Kai Zhang , Yuze Zhao , Yupeng Han

Reinforcement Learning with Verifiable Rewards (RLVR) is an essential paradigm that enhances the reasoning capabilities of Large Language Models (LLMs). However, existing methods typically rely on static policy optimization schemes that…

计算与语言 · 计算机科学 2026-05-08 Yiming Huang , Zhenbo Shi , Shuzheng Gao , Cuiyun Gao , Peiyi Han , Chuanyi Liu

Large language models (LLMs) have shown impressive multilingual capabilities through pretraining on diverse corpora. Although these models show strong reasoning abilities, their performance varies significantly between languages due to the…

Multimodal large language models (MLLMs) have advanced perception across text, vision, and audio, yet they often struggle with structured cross-modal reasoning, particularly when integrating audio and visual signals. We introduce…

计算机视觉与模式识别 · 计算机科学 2025-06-20 Zhenghao Xing , Xiaowei Hu , Chi-Wing Fu , Wenhai Wang , Jifeng Dai , Pheng-Ann Heng

With the rapid evolution of multimodal large language models, the capacity to deeply understand and interpret human intentions has emerged as a critical capability, which demands detailed and thoughtful reasoning. In recent studies,…

计算机视觉与模式识别 · 计算机科学 2025-06-27 Qize Yang , Shimin Yao , Weixuan Chen , Shenghao Fu , Detao Bai , Jiaxing Zhao , Boyuan Sun , Bowen Yin , Xihan Wei , Jingren Zhou

Recent advancements in large language models, multimodal large language models, and large audio language models (LALMs) have significantly improved their reasoning capabilities through reinforcement learning with rule-based rewards.…

声音 · 计算机科学 2025-11-05 Shu Wu , Chenxing Li , Wenfu Wang , Hao Zhang , Hualei Wang , Meng Yu , Dong Yu

Large reasoning models (LRMs) achieve strong performance through extended reasoning traces, but they often exhibit overthinking behavior for low-complexity queries. Existing efforts to mitigate this issue are fundamentally limited by…

机器学习 · 计算机科学 2026-02-27 Zihang Xu , Haozhi Xie , Ziqi Miao , Wuxuan Gong , Chen Qian , Lijun Li

Current multimodal models often suffer from shallow reasoning, leading to errors caused by incomplete or inconsistent thought processes. To address this limitation, we propose Self-Verification and Self-Rectification (SVSR), a unified…

人工智能 · 计算机科学 2026-05-29 Zhe Qian , Nianbing Su , Zhonghua Wang , Hebei Li , Zhongxing Xu , Yueying Li , Fei Luo , Zhuohan Ouyang , Yanbiao Ma

In this work, we propose Reinforced Functional Token Tuning (RFTT), a novel reinforced fine-tuning framework that empowers Large Language Models (LLMs) with self-play learn-to-reason capabilities. Unlike prior prompt-driven reasoning…

人工智能 · 计算机科学 2025-02-20 Kongcheng Zhang , Qi Yao , Baisheng Lai , Jiaxing Huang , Wenkai Fang , Dacheng Tao , Mingli Song , Shunyu Liu

Large Reasoning Models (LRMs) often suffer from the ``over-thinking'' problem, generating unnecessarily long reasoning on simple tasks. Some strategies have been proposed to mitigate this issue, such as length penalties or routing…

计算与语言 · 计算机科学 2025-10-16 Jian Xie , Zhendong Chu , Aoxiao Zhong , Kai Zhang , Mingzhe Han , Xing Fan , Jialie Shen , Qingsong Wen

MLLMs have been successfully applied to multimodal embedding tasks, yet their generative reasoning capabilities remain underutilized. Directly incorporating chain-of-thought reasoning into embedding learning introduces two fundamental…

计算机视觉与模式识别 · 计算机科学 2026-04-08 Yuchi Wang , Haiyang Yu , Weikang Bian , Jiefeng Long , Xiao Liang , Chao Feng , Hongsheng Li