中文
相关论文

相关论文: FlowErase-RL: Rethinking Concept Erasure as Reward…

200 篇论文

Object pose estimation is a fundamental problem in computer vision and plays a critical role in virtual reality and embodied intelligence, where agents must understand and interact with objects in 3D space. Recently, score based generative…

计算机视觉与模式识别 · 计算机科学 2026-02-06 Diya He , Qingchen Liu , Cong Zhang , Jiahu Qin

The integration of Reinforcement Learning (RL) into flow matching models for text-to-image (T2I) generation has driven substantial advances in generation quality. However, these gains often come at the cost of exhaustive exploration and…

计算机视觉与模式识别 · 计算机科学 2026-05-18 Xiaolong Fu , Lichen Ma , Zipeng Guo , ShiPing Dong , Lan Yang , Tan Lit Sin , Gaojing Zhou , Yu He , Jingling Fu , Shizhe Zhou , Junshi Huang , Jason Li

Visual metaphor generation is a challenging task that aims to generate an image given an input text metaphor. Inherently, it needs language understanding to bind a source concept with a target concept, in a way that preserves meaning while…

计算与语言 · 计算机科学 2025-08-27 Girish A. Koushik , Fatemeh Nazarieh , Katherine Birch , Shenbin Qian , Diptesh Kanojia

Automatic evaluation is crucial yet challenging for open-ended natural language generation, especially when rule-based metrics are infeasible. Compared with traditional methods, the recent LLM-as-a-Judge paradigms enable better and more…

计算与语言 · 计算机科学 2026-02-03 Xinyu Hu , Yancheng He , Weixun Wang , Tao Feng , Li Lin , Jiashun Liu , Wenbo Su , Bo Zheng , Xiaojun Wan

With respect to improving the reasoning accuracy of LLMs, the representative reinforcement learning (RL) method GRPO faces failure due to insignificant reward variance, while verification methods based on process reward models (PRMs) suffer…

人工智能 · 计算机科学 2025-09-09 Sining Zhoubian , Dan Zhang , Jie Tang

Reinforcement learning with verifiable rewards (RLVR) has become an effective paradigm for improving reasoning language models on tasks such as mathematics, coding, and scientific question answering. However, widely used group-relative…

计算与语言 · 计算机科学 2026-05-29 Redacted by arXiv

Consistent image generation requires faithfully preserving identities, styles, and logical coherence across multiple images, which is essential for applications such as storytelling and character design. Supervised training approaches…

计算机视觉与模式识别 · 计算机科学 2026-03-17 Bowen Ping , Chengyou Jia , Minnan Luo , Changliang Xia , Xin Shen , Zhuohang Dang , Hangwei Qian

While modern generative models such as diffusion-based architectures have enabled impressive creative capabilities, they also raise important safety and ethical risks. These concerns have led to growing interest in concept erasure, the…

机器学习 · 计算机科学 2026-04-14 Chi Zhang , Jingpu Cheng , Zhixian Wang , Ping Liu

Flow matching has recently emerged as a promising alternative to diffusion-based generative models, offering faster sampling and simpler training by learning continuous flows governed by ordinary differential equations. Despite growing…

机器学习 · 计算机科学 2025-12-02 Mudit Gaur , Prashant Trivedi , Shuchin Aeron , Amrit Singh Bedi , George K. Atia , Vaneet Aggarwal

In image restoration, single-step discriminative mappings often lack fine details via expectation learning, whereas generative paradigms suffer from inefficient multi-step sampling and noise-residual coupling. To address this dilemma, we…

计算机视觉与模式识别 · 计算机科学 2026-04-22 Zihao Fan , Xin Lu , Jie Xiao , Dong Li , Jie Huang , Xueyang Fu

Reinforcement learning (RL), earlier proven to be effective in large language and multi-modal models, has been successfully extended to enhance 2D image generation recently. However, applying RL to 3D generation remains largely unexplored…

计算机视觉与模式识别 · 计算机科学 2025-12-12 Yiwen Tang , Zoey Guo , Kaixin Zhu , Ray Zhang , Qizhi Chen , Dongzhi Jiang , Junli Liu , Bohan Zeng , Haoming Song , Delin Qu , Tianyi Bai , Dan Xu , Wentao Zhang , Bin Zhao

Reinforcement learning (RL) post-training is crucial for aligning generative models with human preferences, but its prohibitive computational cost remains a major barrier to widespread adoption. We introduce \textbf{TreeGRPO}, a novel RL…

机器学习 · 计算机科学 2025-12-10 Zheng Ding , Weirui Ye

Text-to-image generative models can produce photo-realistic images for an extremely broad range of concepts, and their usage has proliferated widely among the general public. On the flip side, these models have numerous drawbacks, including…

机器学习 · 计算机科学 2023-10-10 Minh Pham , Kelly O. Marshall , Niv Cohen , Govind Mittal , Chinmay Hegde

Large Reasoning Models (LRMs) have shown remarkable capabilities in solving complex problems through reinforcement learning (RL), particularly by generating long reasoning traces. However, these extended outputs often exhibit substantial…

计算与语言 · 计算机科学 2025-05-22 Wei Liu , Ruochen Zhou , Yiyun Deng , Yuzhen Huang , Junteng Liu , Yuntian Deng , Yizhe Zhang , Junxian He

Autoregressive (AR) models have achieved unified and strong performance across both visual understanding and image generation tasks. However, removing undesired concepts from AR models while maintaining overall generation quality remains an…

计算机视觉与模式识别 · 计算机科学 2025-06-26 Haipeng Fan , Shiyuan Zhang , Baohunesitu , Zihang Guo , Huaiwen Zhang

As Test-Time Scaling emerges as an active research focus in the large language model community, advanced post-training methods increasingly emphasize extending chain-of-thought (CoT) generation length, thereby enhancing reasoning…

人工智能 · 计算机科学 2025-05-20 Muzhi Dai , Chenxu Yang , Qingyi Si

Concept erasure is the task of erasing information about a concept (e.g., gender or race) from a representation set while retaining the maximum possible utility -- information from original representations. Concept erasure is useful in…

Goal-conditioned reinforcement learning (RL) is an interesting extension of the traditional RL framework, where the dynamic environment and reward sparsity can cause conventional learning algorithms to fail. Reward shaping is a practical…

机器学习 · 计算机科学 2023-07-18 Hongyu Ding , Yuanze Tang , Qing Wu , Bo Wang , Chunlin Chen , Zhi Wang

Reinforcement learning has become a cornerstone for aligning and unlocking the reasoning capabilities of large-scale models. At its core, the training loop of GRPO and its variants alternates between rollout sampling and policy update.…

机器学习 · 计算机科学 2026-05-21 Xikai Zhang , Yongzhi Li , Likang Xiao , Yingze Zhang , Yanhua Cheng , Quan Chen , Peng Jiang , Wenjun Wu , Liu Liu

Reinforcement Learning (RL) is pivotal for enhancing Large Language Model (LLM) reasoning, yet mainstream algorithms such as GRPO and DAPO remain constrained by a coarse-grained credit assignment paradigm, where all tokens within the same…

计算与语言 · 计算机科学 2026-02-06 Hongze Tan , Zihan Wang , Jianfei Pan , Jinghao Lin , Hao Wang , Yifan Wu , Tao Chen , Zhihang Zheng , Zhihao Tang , Haihua Yang