中文
相关论文

相关论文: Generation Navigator: A State-Aware Agentic Framew…

200 篇论文

Conditional image generation is an active research topic including text2image and image translation. Recently image manipulation with linguistic instruction brings new challenges of multimodal conditional generation. However, traditional…

计算机视觉与模式识别 · 计算机科学 2022-04-05 Zhenhuan Liu , Jincan Deng , Liang Li , Shaofei Cai , Qianqian Xu , Shuhui Wang , Qingming Huang

Reinforcement learning (RL), particularly GRPO, improves image generation quality significantly by comparing the relative performance of images generated within the same group. However, in the later stages of training, the model tends to…

计算机视觉与模式识别 · 计算机科学 2025-12-29 Henglin Liu , Huijuan Huang , Jing Wang , Chang Liu , Xiu Li , Xiangyang Ji

Subject-driven image generation models face a fundamental trade-off between identity preservation (fidelity) and prompt adherence (editability). While online reinforcement learning (RL), specifically GPRO, offers a promising solution, we…

机器学习 · 计算机科学 2026-04-23 Ziwei Huang , Ying Shu , Hao Fang , Quanyu Long , Wenya Wang , Qiushi Guo , Tiezheng Ge , Leilei Gan

Learning interactive motion behaviors among multiple agents is a core challenge in autonomous driving. While imitation learning models generate realistic trajectories, they often inherit biases from datasets dominated by safe…

机器人学 · 计算机科学 2025-12-16 Hyunki Seong , Jeong-Kyun Lee , Heesoo Myeong , Yongho Shin , Hyun-Mook Cho , Duck Hoon Kim , Pranav Desai , Monu Surana

Text-to-image (T2I) generation has achieved remarkable progress, yet existing methods often lack the ability to dynamically reason and refine during generation--a hallmark of human creativity. Current reasoning-augmented paradigms most rely…

计算机视觉与模式识别 · 计算机科学 2026-02-03 Harold Haodong Chen , Xinxiang Yin , Wen-Jie Shu , Hongfei Zhang , Zixin Zhang , Chenfei Liao , Litao Guo , Qifeng Chen , Ying-Cong Chen

Text-to-image (T2I) systems enable rapid generation of high-fidelity imagery but are misaligned with how visual ideas develop. T2I systems generate outputs that make implicit visual decisions on behalf of the user, often introduce…

人机交互 · 计算机科学 2026-04-16 Zoe De Simone , Angie Boggust , Fredo Durand , Ashia Wilson , Arvind Satyanarayan

As a typical open-ended generation task, creative writing lacks verifiable reference answers, which has long constrained reward modeling and automatic evaluation due to high human annotation costs, evaluative bias, and coarse feedback…

计算与语言 · 计算机科学 2026-03-17 Jihao Zhao , Shuaishuai Zu , Zhiyuan Ji , Chunlai Zhou , Biao Qin

Recent deep generative models are able to provide photo-realistic images as well as visual or textual content embeddings useful to address various tasks of computer vision and natural language processing. Their usefulness is nevertheless…

机器学习 · 计算机科学 2020-01-29 Antoine Plumerault , Hervé Le Borgne , Céline Hudelot

The long-standing goal of multimodal AI is to build unified models in which visual understanding and visual generation mutually enhance one another. Despite recent works such as BAGEL, BLIP3o achieves remarkable progress; In practice,…

计算机视觉与模式识别 · 计算机科学 2026-05-18 Yujun Tong , Dongliang Chang , Zijin Yin , Xintong Liu , Yuanchen Fang , Zhanyu Ma

We consider the problem of building a state representation model in a continual fashion. As the environment changes, the aim is to efficiently compress the sensory state's information without losing past knowledge. The learned features are…

机器学习 · 计算机科学 2018-12-12 Hugo Caselles-Dupré , Michael Garcia-Ortiz , David Filliat

Recent advancements in Multimodal Large Language Models (MLLMs) have incentivized models to ``think with images'' by actively invoking visual tools during multi-turn reasoning. The common Reinforcement Learning (RL) practice of relying on…

计算机视觉与模式识别 · 计算机科学 2026-04-09 Wenhao Yang , Yu Xia , Jinlong Huang , Shiyin Lu , Qing-Guo Chen , Zhao Xu , Weihua Luo , Kaifu Zhang , Yuchen Zhou , Xiaobo Xia , Yuanyu Wan , Lijun Zhang , Tat-Seng Chua

Generative Adversarial Networks (GANs) have known a tremendous success for many continuous generation tasks, especially in the field of image generation. However, for discrete outputs such as language, optimizing GANs remains an open…

Training Large Language Models (LLMs) for multi-turn Tool-Integrated Reasoning (TIR) - where models iteratively reason, generate code, and verify through execution - remains challenging for existing reinforcement learning (RL) approaches.…

机器学习 · 计算机科学 2026-04-21 Yifeng Ding , Hung Le , Songyang Han , Kangrui Ruan , Zhenghui Jin , Varun Kumar , Zijian Wang , Anoop Deoras

The malicious misuse and widespread dissemination of AI-generated images pose a significant threat to the authenticity of online information. Current detection methods often struggle to generalize to unseen generative models, and the rapid…

计算机视觉与模式识别 · 计算机科学 2026-01-12 Hanyi Wang , Jun Lan , Yaoyu Kang , Huijia Zhu , Weiqiang Wang , Zhuosheng Zhang , Shilin Wang

Text-to-image generative models have achieved remarkable visual quality but still struggle with compositionality$-$accurately capturing object relationships, attribute bindings, and fine-grained details in prompts. A key limitation is that…

计算机视觉与模式识别 · 计算机科学 2025-12-11 Arman Zarei , Jiacheng Pan , Matthew Gwilliam , Soheil Feizi , Zhenheng Yang

Recent studies have demonstrated the importance of high-quality visual representations in image generation and have highlighted the limitations of generative models in image understanding. As a generative paradigm originally designed for…

计算机视觉与模式识别 · 计算机科学 2025-09-19 Xiaoyu Yue , Zidong Wang , Yuqing Wang , Wenlong Zhang , Xihui Liu , Wanli Ouyang , Lei Bai , Luping Zhou

Image-to-text (I2T) understanding and text-to-image (T2I) generation are two fundamental, important yet traditionally isolated multimodal tasks. Despite their intrinsic connection, existing approaches typically optimize them independently,…

计算机视觉与模式识别 · 计算机科学 2026-04-01 Zhiyuan Yan , Kaiqing Lin , Zongjian Li , Junyan Ye , Hui Han , Haochen Wang , Zhendong Wang , Bin Lin , Hao Li , Xinyan Xiao , Jingdong Wang , Haifeng Wang , Li Yuan

The rapid advancement of text-to-image (T2I) models has increased the need for reliable human preference modeling, a demand further amplified by recent progress in reinforcement learning for preference alignment. However, existing…

计算机视觉与模式识别 · 计算机科学 2025-10-02 Yuxiang Guo , Jiang Liu , Ze Wang , Hao Chen , Ximeng Sun , Yang Zhao , Jialian Wu , Xiaodong Yu , Zicheng Liu , Emad Barsoum

Generative AI (GenAI) is rapidly advancing the field of Autonomous Driving (AD), extending beyond traditional applications in text, image, and video generation. We explore how generative models can enhance automotive tasks, such as static…

Imitation learning in a high-dimensional environment is challenging. Most inverse reinforcement learning (IRL) methods fail to outperform the demonstrator in such a high-dimensional environment, e.g., Atari domain. To address this…

机器学习 · 计算机科学 2020-09-14 Xingrui Yu , Yueming Lyu , Ivor W. Tsang