中文
相关论文

相关论文: OneThinker: All-in-one Reasoning Model for Image a…

200 篇论文

Large-scale vision-language models (VLMs), trained on extensive datasets of image-text pairs, exhibit strong multimodal understanding capabilities by implicitly learning associations between textual descriptions and image regions. This…

计算机视觉与模式识别 · 计算机科学 2025-03-17 Mir Rayat Imtiaz Hossain , Mennatullah Siam , Leonid Sigal , James J. Little

Existing reasoning segmentation approaches typically fine-tune multimodal large language models (MLLMs) using image-text pairs and corresponding mask labels. However, they exhibit limited generalization to out-of-distribution scenarios…

计算机视觉与模式识别 · 计算机科学 2025-05-30 Song Wang , Gongfan Fang , Lingdong Kong , Xiangtai Li , Jianyun Xu , Sheng Yang , Qiang Li , Jianke Zhu , Xinchao Wang

Large Language Models (LLMs) demonstrate transformative potential, yet their reasoning remains inconsistent and unreliable. Reinforcement learning (RL)-based fine-tuning is a key mechanism for improvement, but its effectiveness is…

机器学习 · 计算机科学 2026-02-11 Pei-Chi Pan , Yingbin Liang , Sen Lin

Recent advancements in reinforcement learning with verifiable rewards have pushed the boundaries of the visual reasoning capabilities in large vision-language models (LVLMs). However, training LVLMs with reinforcement fine-tuning (RFT) is…

计算机视觉与模式识别 · 计算机科学 2025-09-30 Zilin Xiao , Jaywon Koo , Siru Ouyang , Jefferson Hernandez , Yu Meng , Vicente Ordonez

Despite significant progress, Vision-Language Models (VLMs) still struggle with complex visual reasoning, where multi-step dependencies cause early errors to cascade through the reasoning chain. Existing post-training paradigms are limited:…

计算机视觉与模式识别 · 计算机科学 2025-11-14 Yanbei Jiang , Chao Lei , Yihao Ding , Krista Ehinger , Jey Han Lau

Recent advances in reinforcement learning (RL) have delivered strong reasoning capabilities in natural image domains, yet their potential for Earth Observation (EO) remains largely unexplored. EO tasks introduce unique challenges, spanning…

计算机视觉与模式识别 · 计算机科学 2025-10-15 Mustansar Fiaz , Hiyam Debary , Paolo Fraccaro , Danda Paudel , Luc Van Gool , Fahad Khan , Salman Khan

Reinforcement Learning (RL) has proven to be an effective post-training strategy for enhancing reasoning in vision-language models (VLMs). Group Relative Policy Optimization (GRPO) is a recent prominent method that encourages models to…

人工智能 · 计算机科学 2025-10-30 Jiaqi Wang , Kevin Qinghong Lin , James Cheng , Mike Zheng Shou

The application of reinforcement learning (RL) to enhance the reasoning capabilities of Multimodal Large Language Models (MLLMs) constitutes a rapidly advancing research area. While MLLMs extend Large Language Models (LLMs) to handle…

人工智能 · 计算机科学 2025-05-22 Guanghao Zhou , Panjia Qiu , Cen Chen , Jie Wang , Zheming Yang , Jian Xu , Minghui Qiu

Recent multimodal large language models (MLLMs) have advanced video understanding, yet most still "think about videos" ie once a video is encoded, reasoning unfolds entirely in text, treating visual input as a static context. This passive…

计算机视觉与模式识别 · 计算机科学 2025-12-01 Hanoona Rasheed , Mohammed Zumri , Muhammad Maaz , Ming-Hsuan Yang , Fahad Shahbaz Khan , Salman Khan

Recent advances in vision-language models (VLMs) have demonstrated strong generalization in natural image tasks. However, their performance often degrades on unmanned aerial vehicle (UAV)-based aerial imagery, which features high…

计算机视觉与模式识别 · 计算机科学 2026-05-07 Jiajin Guan , Haibo Mei , Bonan Zhang , Dan Liu , Yuanshuang Fu , Yue Zhang

Recent advances in Omni models have enabled unified multimodal perception and generation. However, most existing systems still exhibit rigid reasoning behaviors, either overthinking simple problems or failing to reason when necessary. To…

人工智能 · 计算机科学 2025-12-05 Dongchao Yang , Songxiang Liu , Disong Wang , Yuanyuan Wang , Guanglu Wan , Helen Meng

Existing LLM test-time scaling laws emphasize the emergence of self-reflective behaviors through extended reasoning length. Nevertheless, this vertical scaling strategy often encounters plateaus in exploration as the model becomes locked…

计算机视觉与模式识别 · 计算机科学 2026-05-08 Haoran Xu , Hongyu Wang , Jiaze Li , Shunpeng Chen , Zizhao Tong , Jianzhong Ju , Zhenbo Luo , Jian Luan

Multimodal sentiment analysis aims to integrate textual, acoustic, and visual information for deep emotional understanding. Despite the progress of multimodal large language models (MLLMs) via supervised fine-tuning, their "black-box"…

计算与语言 · 计算机科学 2026-04-14 Miaosen Luo , Zhenhao Yang , Jieshen Long , Jinghu Sun , Yichu Liu , Sijie Mai

Multimodal large language models via reinforcement learning (RL) have demonstrated remarkable capabilities in complex visual reasoning tasks, yet they remain limited in long-horizon multimodal scenarios, often suffering from visual…

计算机视觉与模式识别 · 计算机科学 2026-05-26 Chenghao Li , Fusheng Hao , Xikai Zhang , Likang Xiao , Yanwei Ren , Fuxiang Wu , Quan Chen , Liu Liu

We present Entropic Mutual-Information Geometry Large-Language Model Alignment (ENIGMA), a novel approach to Large-Language Model (LLM) training that jointly improves reasoning, alignment and robustness by treating an organisation's…

机器学习 · 计算机科学 2025-10-17 Gareth Seneque , Lap-Hang Ho , Nafise Erfanian Saeedi , Jeffrey Molendijk , Ariel Kuperman , Tim Elson

Unified vision-language frameworks have greatly advanced in recent years, most of which adopt an encoder-decoder architecture to unify image-text tasks as sequence-to-sequence generation. However, existing video-language (VidL) models still…

计算机视觉与模式识别 · 计算机科学 2022-06-16 Linjie Li , Zhe Gan , Kevin Lin , Chung-Ching Lin , Zicheng Liu , Ce Liu , Lijuan Wang

In medical visual question answering (Med-VQA), achieving accurate responses relies on three critical steps: precise perception of medical imaging data, logical reasoning grounded in visual input and textual questions, and coherent answer…

计算机视觉与模式识别 · 计算机科学 2025-06-17 Songtao Jiang , Yuan Wang , Ruizhe Chen , Yan Zhang , Ruilin Luo , Bohan Lei , Sibo Song , Yang Feng , Jimeng Sun , Jian Wu , Zuozhu Liu

Recent advances in large Vision-Language Models (VLMs) have exhibited strong reasoning capabilities on complex visual tasks by thinking with images in their Chain-of-Thought (CoT), which is achieved by actively invoking tools to analyze…

计算机视觉与模式识别 · 计算机科学 2026-01-08 Wenhao Yang , Yu Xia , Jinlong Huang , Shiyin Lu , Qing-Guo Chen , Zhao Xu , Weihua Luo , Kaifu Zhang , Yuanyu Wan , Lijun Zhang

With Transformers achieving outstanding performance on individual remote sensing (RS) tasks, we are now approaching the realization of a unified model that excels across multiple tasks through multi-task learning (MTL). Compared to…

计算机视觉与模式识别 · 计算机科学 2026-01-12 Qingyun Li , Shuran Ma , Junwei Luo , Yi Yu , Yue Zhou , Fengxiang Wang , Xudong Lu , Xiaoxing Wang , Xin He , Yushi Chen , Xue Yang

Recent progress in Multimodal Large Language Models (MLLMs) has demonstrated strong semantic understanding capabilities, but struggles to perform precise spatio-temporal understanding. Existing spatio-temporal methods primarily focus on the…