中文
相关论文

相关论文: EditReward: A Human-Aligned Reward Model for Instr…

200 篇论文

Existing open-source datasets for arbitrary-instruction image editing remain suboptimal, while a plug-and-play editing module compatible with community-prevalent generative models is notably absent. In this paper, we first introduce the…

计算机视觉与模式识别 · 计算机科学 2025-11-11 Jian Ma , Xujie Zhu , Zihao Pan , Qirong Peng , Xu Guo , Chen Chen , Haonan Lu

In recent years, instruction-based image editing methods have garnered significant attention in image editing. However, despite encompassing a wide range of editing priors, these methods are helpless when handling editing tasks that are…

图形学 · 计算机科学 2024-03-28 Ruoyu Zhao , Qingnan Fan , Fei Kou , Shuai Qin , Hong Gu , Wei Wu , Pengcheng Xu , Mingrui Zhu , Nannan Wang , Xinbo Gao

Instruction-based image editing has made a great process in using natural human language to manipulate the visual content of images. However, existing models are limited by the quality of the dataset and cannot accurately localize editing…

计算机视觉与模式识别 · 计算机科学 2024-06-17 Tiancheng Li , Jinxiu Liu , Huajun Chen , Qi Liu

The quality and diversity of instruction-based image editing datasets are continuously increasing, yet large-scale, high-quality datasets for instruction-based video editing remain scarce. To address this gap, we introduce OpenVE-3M, an…

计算机视觉与模式识别 · 计算机科学 2025-12-17 Haoyang He , Jie Wang , Jiangning Zhang , Zhucun Xue , Xingyuan Bu , Qiangpeng Yang , Shilei Wen , Lei Xie

Generative foundation models are susceptible to implicit biases that can arise from extensive unsupervised training data. Such biases can produce suboptimal samples, skewed outcomes, and unfairness, with potentially serious consequences.…

机器学习 · 计算机科学 2023-12-04 Hanze Dong , Wei Xiong , Deepanshu Goyal , Yihan Zhang , Winnie Chow , Rui Pan , Shizhe Diao , Jipeng Zhang , Kashun Shum , Tong Zhang

High-quality source-target image pairs with precise editing instructions are essential for instruction-guided image editing, yet constructing such training triplets at scale remains costly. Recent pipelines often rely on vision-language…

计算机视觉与模式识别 · 计算机科学 2026-05-26 Xiangyuan Wang , Honghao Cai , Yunhao Bai , Chao Hui , Tianze Zhou , Haohua Chen , Hao Shi , Yuling Wu , Yao Hu , Xu Tang , Yibo Chen , Wei Zhu

Instruction-based image editing aims to modify specific image elements with natural language instructions. However, current models in this domain often struggle to accurately execute complex user instructions, as they are trained on…

计算机视觉与模式识别 · 计算机科学 2025-04-01 Qifan Yu , Wei Chow , Zhongqi Yue , Kaihang Pan , Yang Wu , Xiaoyang Wan , Juncheng Li , Siliang Tang , Hanwang Zhang , Yueting Zhuang

Aligning Text-to-Image (T2I) generation models with human preferences increasingly relies on image reward models that score or rank generated images according to prompt alignment and perceptual quality. Existing reward models are commonly…

人工智能 · 计算机科学 2026-05-22 Kuei-Chun Kao , Daixuan Huo , Yuanhao Ban , Cho-Jui Hsieh

We present FireRed-Image-Edit, a diffusion transformer for instruction-based image editing that achieves state-of-the-art performance through systematic optimization of data curation, training methodology, and evaluation design. We…

We introduce neuralCAD-Edit, the first benchmark for editing 3D CAD models collected from expert CAD engineers. Instead of text conditioning as in prior works, we collect realistic CAD editing requests by capturing videos of professional…

计算机视觉与模式识别 · 计算机科学 2026-04-20 Toby Perrett , Matthew Bouchard , William McCarthy

Due to the challenges of manually collecting accurate editing data, existing datasets are typically constructed using various automated methods, leading to noisy supervision signals caused by the mismatch between editing instructions and…

计算机视觉与模式识别 · 计算机科学 2025-05-06 Ming Li , Xin Gu , Fan Chen , Xiaoying Xing , Longyin Wen , Chen Chen , Sijie Zhu

A well-designed reward is critical for effective reinforcement learning-based policy improvement. In real-world robotics, obtaining such rewards typically requires either labor-intensive human labeling or brittle, handcrafted objectives.…

机器人学 · 计算机科学 2026-01-09 Tony Lee , Andrew Wagenmaker , Karl Pertsch , Percy Liang , Sergey Levine , Chelsea Finn

Large Vision-Language Models (LVLMs) typically follow a two-stage training paradigm-pretraining and supervised fine-tuning. Recently, preference optimization, derived from the language domain, has emerged as an effective post-training…

计算机视觉与模式识别 · 计算机科学 2025-03-25 Yufei Zhan , Yousong Zhu , Shurong Zheng , Hongyin Zhao , Fan Yang , Ming Tang , Jinqiao Wang

Contemporary image generation systems have achieved high fidelity and superior aesthetic quality beyond basic text-image alignment. However, existing evaluation frameworks have failed to evolve in parallel. This study reveals that human…

计算机视觉与模式识别 · 计算机科学 2025-07-28 Ying Ba , Tianyu Zhang , Yalong Bai , Wenyi Mo , Tao Liang , Bing Su , Ji-Rong Wen

Making language models bigger does not inherently make them better at following a user's intent. For example, large language models can generate outputs that are untruthful, toxic, or simply not helpful to the user. In other words, these…

Pre-trained large language models (LLMs) can be tailored to adhere to human instructions through instruction tuning. However, due to shifts in the distribution of test-time data, they may not always execute instructions accurately,…

计算与语言 · 计算机科学 2024-09-04 Hai Ye , Hwee Tou Ng

Text-to-image models are powerful for producing high-quality images based on given text prompts, but crafting these prompts often requires specialized vocabulary. To address this, existing methods train rewriting models with supervision…

计算机视觉与模式识别 · 计算机科学 2025-12-16 Hongji Yang , Yucheng Zhou , Wencheng Han , Jianbing Shen

While real-world applications increasingly demand intricate scene manipulation, existing instruction-guided image editing benchmarks often oversimplify task complexity and lack comprehensive, fine-grained instructions. To bridge this gap,…

Text-to-motion generation, which synthesizes 3D human motions from text inputs, holds immense potential for applications in gaming, film, and robotics. Recently, diffusion-based methods have been shown to generate more diversity and…

计算机视觉与模式识别 · 计算机科学 2025-11-25 Wanjiang Weng , Xiaofeng Tan , Junbo Wang , Guo-Sen Xie , Pan Zhou , Hongsong Wang

Large Language Models (LLMs) exhibit impressive capabilities but require careful alignment with human preferences. Traditional training-time methods finetune LLMs using human preference datasets but incur significant training costs and…

计算与语言 · 计算机科学 2025-07-16 Yuancheng Xu , Udari Madhushani Sehwag , Alec Koppel , Sicheng Zhu , Bang An , Furong Huang , Sumitra Ganesh