中文
相关论文

相关论文: VisionCreator-R1: A Reflection-Enhanced Native Vis…

200 篇论文

Visual Language Models (VLMs), with powerful multimodal reasoning capabilities, are gradually integrated into autonomous driving by several automobile manufacturers to enhance planning capability in challenging environments. However, the…

机器人学 · 计算机科学 2025-10-06 Yifan Liao , Zhen Sun , Xiaoyun Qiu , Zixiao Zhao , Wenbing Tang , Xinlei He , Xinhu Zheng , Tianwei Zhang , Xinyi Huang , Xingshuo Han

Visual reasoning may require models to interpret images and videos and respond to implicit text queries across diverse output formats, from pixel-level segmentation masks to natural language descriptions. Existing approaches rely on…

计算机视觉与模式识别 · 计算机科学 2025-11-18 Yiqing Shen , Mathias Unberath

Large Vision-Language Models (LVLMs) typically follow a two-stage training paradigm-pretraining and supervised fine-tuning. Recently, preference optimization, derived from the language domain, has emerged as an effective post-training…

计算机视觉与模式识别 · 计算机科学 2025-03-25 Yufei Zhan , Yousong Zhu , Shurong Zheng , Hongyin Zhao , Fan Yang , Ming Tang , Jinqiao Wang

The Reflow operation aims to straighten the inference trajectories of the rectified flow during training by constructing deterministic couplings between noises and images, thereby improving the quality of generated images in single-step or…

计算机视觉与模式识别 · 计算机科学 2025-07-15 Jimin Dai , Jiexi Yan , Jian Yang , Lei Luo

Safe and feasible trajectory planning is critical for real-world autonomous driving systems. However, existing learning-based planners rely heavily on expert demonstrations, which not only lack explicit safety awareness but also risk…

机器人学 · 计算机科学 2025-09-29 Xiaolong Tang , Meina Kan , Shiguang Shan , Xilin Chen

Vision-Language Models (VLMs) often suffer from visual hallucinations: generating things that are not consistent with visual inputs and language shortcuts, where they skip the visual part and just rely on text priors. These issues arise…

计算机视觉与模式识别 · 计算机科学 2026-04-28 Zongxia Li , Wenhao Yu , Chengsong Huang , Zhenwen Liang , Rui Liu , Fuxiao Liu , Jingxi Che , Dian Yu , Jordan Boyd-Graber , Haitao Mi , Dong Yu

While Large Language Models (LLMs) can generate fluent text, producing high-quality creative stories remains challenging. Reinforcement Learning (RL) offers a promising solution but faces two critical obstacles: designing reliable reward…

人工智能 · 计算机科学 2026-01-13 Zhaoyan Li , Hang Lei , Yujia Wang , Lanbo Liu , Hao Liu , Liang Yu

Recent advances in vision-language-action (VLA) models have motivated the extension of their capabilities to embodied settings, where reinforcement learning (RL) offers a principled way to optimize task success through interaction. However,…

Humans can perceive and reason about spatial relationships from sequential visual observations, such as egocentric video streams. However, how pretrained models acquire such abilities, especially high-level reasoning, remains unclear. This…

人工智能 · 计算机科学 2025-04-18 Baining Zhao , Ziyou Wang , Jianjie Fang , Chen Gao , Fanhang Man , Jinqiang Cui , Xin Wang , Xinlei Chen , Yong Li , Wenwu Zhu

Tool-augmented large language models (LLMs) are usually trained with supervised imitation or coarse-grained reinforcement learning that optimizes single tool calls. Current self-reflection practices rely on heuristic prompts or one-way…

计算机视觉与模式识别 · 计算机科学 2026-04-16 Junhao Su , Yuanliang Wan , Junwei Yang , Hengyu Shi , Tianyang Han , Junfeng Luo , Yurui Qiu

Reward Models (RMs) are critical components in the Reinforcement Learning from Human Feedback (RLHF) pipeline, directly determining the alignment quality of Large Language Models (LLMs). Recently, Generative Reward Models (GRMs) have…

人工智能 · 计算机科学 2026-04-21 Kai Qin , Liangxin Liu , Yu Liang , Longzheng Wang , Yan Wang , Yueyang Zhang , Long Xia , Zhiyuan Sun , Houde Liu , Daiting Shi

In real-world software engineering tasks, solving a problem often requires understanding and modifying multiple functions, classes, and files across a large codebase. Therefore, on the repository level, it is crucial to extract the relevant…

软件工程 · 计算机科学 2024-09-25 Jicheng Wang , Yifeng He , Hao Chen

Proactive task-oriented agents must autonomously anticipate user needs, identify actionable opportunities, and trigger software actions at appropriate moments - fundamentally shifting from reactive systems that await explicit instructions.…

人工智能 · 计算机科学 2026-05-26 Lei Ding , Bin He , Chenguang Wang , Yang Liu

Vision-Language Navigation (VLN) is a core challenge in embodied AI, requiring agents to navigate real-world environments using natural language instructions. Current language model-based navigation systems operate on discrete topological…

计算机视觉与模式识别 · 计算机科学 2025-06-26 Zhangyang Qi , Zhixiong Zhang , Yizhou Yu , Jiaqi Wang , Hengshuang Zhao

Reinforcement learning for agentic multimodal models often suffers from interaction collapse, where models learn to reduce tool usage and multi-turn reasoning, limiting the benefits of agentic behavior. We introduce PyVision-RL, a…

人工智能 · 计算机科学 2026-02-25 Shitian Zhao , Shaoheng Lin , Ming Li , Haoquan Zhang , Wenshuo Peng , Kaipeng Zhang , Chen Wei

Long-horizon action-conditioned video generation aims to synthesize temporally coherent videos that follow complex action instructions over extended horizons, requiring procedural ordering, persistent action execution, and scene consistency…

计算机视觉与模式识别 · 计算机科学 2026-05-22 Yu Yang , Yue Liao , Jianbiao Mei , Baisen Wang , Xuemeng Yang , Licheng Wen , Jiangning Zhang , Xiangtai Li , Liang Lv , Hanlin Chen , Botian Shi , Yong Liu , Shuicheng Yan , Gim Hee Lee

Multi-modal large language models (MLLMs) have demonstrated significant progress in reasoning capabilities and shown promising effectiveness in video anomaly understanding (VAU) tasks. However, existing MLLM-based approaches remain largely…

计算机视觉与模式识别 · 计算机科学 2026-02-03 Zihao Zhao , Shengting Cao , Muchao Ye

Retrieval-Augmented Generation (RAG) extends Large Vision-Language Models (LVLMs) with external visual knowledge. However, existing visual RAG systems typically rely on generic retrieval signals that overlook the fine-grained visual…

计算机视觉与模式识别 · 计算机科学 2026-04-20 Jun Wang , Shuo Tan , Zelong Sun , Tiancheng Gu , Yongle Zhao , Ziyong Feng , Kaicheng Yang , Zhiwu Lu

Autoregressive models recently achieved comparable results versus state-of-the-art Generative Adversarial Networks (GANs) with the help of Vector Quantized Variational AutoEncoders (VQ-VAE). However, autoregressive models have several…

计算机视觉与模式识别 · 计算机科学 2020-07-21 Kenan E. Ak , Ning Xu , Zhe Lin , Yilin Wang

Consistent image generation requires faithfully preserving identities, styles, and logical coherence across multiple images, which is essential for applications such as storytelling and character design. Supervised training approaches…

计算机视觉与模式识别 · 计算机科学 2026-03-17 Bowen Ping , Chengyou Jia , Minnan Luo , Changliang Xia , Xin Shen , Zhuohang Dang , Hangwei Qian