English
Related papers

Related papers: Astrolabe: Steering Forward-Process Reinforcement …

200 papers

Current state-of-the-art video understanding methods typically struggle with two critical challenges: (1) the computational infeasibility of processing every frame in dense video content and (2) the difficulty in identifying semantically…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Kehua Chen

Reinforcement learning (RL) has become a standard technique for post-training diffusion-based image synthesis models, as it enables learning from reward signals to explicitly improve desirable aspects such as image quality and prompt…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 David McAllister , Miika Aittala , Tero Karras , Janne Hellsten , Angjoo Kanazawa , Timo Aila , Samuli Laine

To achieve real-time interactive video generation, current methods distill pretrained bidirectional video diffusion models into few-step autoregressive (AR) models, facing an architectural gap when full attention is replaced by causal…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Hongzhou Zhu , Min Zhao , Guande He , Hang Su , Chongxuan Li , Jun Zhu

Predictive autoscaling (autoscaling with workload forecasting) is an important mechanism that supports autonomous adjustment of computing resources in accordance with fluctuating workload demands in the Cloud. In recent works, Reinforcement…

Recent advances in video generation have been dominated by diffusion and flow-matching models, which produce high-quality results but remain computationally intensive and difficult to scale. In this work, we introduce VideoAR, the first…

Computer Vision and Pattern Recognition · Computer Science 2026-01-15 Longbin Ji , Xiaoxiong Liu , Junyuan Shang , Shuohuan Wang , Yu Sun , Hua Wu , Haifeng Wang

Streaming applications are becoming widespread across an extensive range of business domains as an increasing number of sources continuously produce data that need to be processed and analysed in real time. Modern businesses are…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-02-28 Maria R. Read , Chinmaya Dehury , Satish Narayana Srirama , Rajkumar Buyya

Blind super-resolution methods based on stable diffusion showcase formidable generative capabilities in reconstructing clear high-resolution images with intricate details from low-resolution inputs. However, their practical applicability is…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Rui Xie , Chen Zhao , Kai Zhang , Zhenyu Zhang , Jun Zhou , Jian Yang , Ying Tai

Fine-tuning pre-trained generative models with Reinforcement Learning (RL) has emerged as an effective approach for aligning outputs more closely with nuanced human preferences. In this paper, we investigate the application of Group…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Matteo Gallici , Haitz Sáez de Ocáriz Borde

Recent hybrid video generation models combine autoregressive temporal dynamics with diffusion-based spatial denoising, but their sequential, iterative nature leads to error accumulation and long inference times. In this work, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Yongqi Yang , Huayang Huang , Xu Peng , Xiaobin Hu , Donghao Luo , Jiangning Zhang , Chengjie Wang , Yu Wu

Deep reinforcement learning (DRL) policies have been shown to be deceived by perturbations (e.g., random noise or intensional adversarial attacks) on state observations that appear at test time but are unknown during training. To increase…

Machine Learning · Computer Science 2020-12-25 Xinghua Qu , Yew-Soon Ong , Abhishek Gupta , Zhu Sun

In deep reinforcement learning (RL), data augmentation is widely considered as a tool to induce a set of useful priors about semantic consistency and improve sample efficiency and generalization performance. However, even when the prior is…

Machine Learning · Computer Science 2023-03-02 Byungchan Ko , Jungseul Ok

In deep reinforcement learning (RL), data augmentation is widely considered as a tool to induce a set of useful priors about semantic consistency and improve sample efficiency and generalization performance. However, even when the prior is…

Machine Learning · Computer Science 2022-10-21 Byungchan Ko , Jungseul Ok

Action-conditioned robot world models generate future video frames of the manipulated scene given a robot action sequence, offering a promising alternative for simulating tasks that are difficult to model with traditional physics engines.…

Robotics · Computer Science 2026-03-27 Jai Bardhan , Patrik Drozdik , Josef Sivic , Vladimir Petrik

Distribution Matching Distillation (DMD) facilitates efficient inference by distilling multi-step diffusion models into few-step variants. Concurrently, Reinforcement Learning (RL) has emerged as a vital tool for aligning generative models…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Dengyang Jiang , Dongyang Liu , Zanyi Wang , Qilong Wu , Liuzhuozheng Li , Hengzhuang Li , Xin Jin , David Liu , Changsheng Lu , Zhen Li , Bo Zhang , Mengmeng Wang , Steven Hoi , Peng Gao , Harry Yang

Post-training with Reinforcement Learning (RL) has substantially improved reasoning in Large Language Models (LLMs) via test-time scaling. However, extending this paradigm to Multimodal LLMs (MLLMs) through verbose rationales yields limited…

Computation and Language · Computer Science 2026-02-16 Bangzheng Li , Jianmo Ni , Chen Qu , Ian Miao , Liu Yang , Xingyu Fu , Muhao Chen , Derek Zhiyuan Cheng

Denoising-based generative models, particularly diffusion and flow matching algorithms, have achieved remarkable success. However, aligning their output distributions with complex downstream objectives, such as human preferences,…

Machine Learning · Computer Science 2025-08-29 Luozhijie Jin , Zijie Qiu , Jie Liu , Zijie Diao , Lifeng Qiao , Ning Ding , Alex Lamb , Xipeng Qiu

We present Reinforcement Learning via Auxiliary Task Distillation (AuxDistill), a new method that enables reinforcement learning (RL) to perform long-horizon robot control problems by distilling behaviors from auxiliary RL tasks. AuxDistill…

Machine Learning · Computer Science 2024-06-26 Abhinav Narayan Harish , Larry Heck , Josiah P. Hanna , Zsolt Kira , Andrew Szot

Flow models are effective at progressively generating realistic images, but they generally struggle to capture long-range dependencies during the generation process as they compress all the information from previous time steps into a single…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Mude Hui , Rui-Jie Zhu , Songlin Yang , Yu Zhang , Zirui Wang , Yuyin Zhou , Jason Eshraghian , Cihang Xie

Large Language Model agents excel at solving complex tasks through iterative reasoning and tool use, but typically depend on ultra-large, costly backbones. Existing distillation approaches train smaller students to imitate full teacher…

Computation and Language · Computer Science 2025-10-10 Yuanjie Lyu , Chengyu Wang , Jun Huang , Tong Xu

Reinforcement learning (RL) has become a promising paradigm for optimizing Retrieval-Augmented Generation (RAG) in complex reasoning tasks. However, traditional outcome-based RL approaches often suffer from reward sparsity and inefficient…

Artificial Intelligence · Computer Science 2026-01-30 Zhao Wang , Ziliang Zhao , Zhicheng Dou