English
Related papers

Related papers: VADE: Variance-Aware Dynamic Sampling via Online S…

200 papers

The ability to accurately model random fields plays a critical role in science and engineering for problems involving uncertain, spatially-varying quantities such as heterogeneous material properties and turbulent flows. Deep generative…

In mathematical reasoning, data selection strategies predominantly rely on static, externally defined metrics, which fail to adapt to the evolving capabilities of models during training. This misalignment limits the efficiency of Supervised…

Artificial Intelligence · Computer Science 2026-04-20 Jun Rao , Xuebo Liu , Hexuan Deng , Zepeng Lin , Zixiong Yu , Jiansheng Wei , Xiaojun Meng , Min Zhang

We present Diversity-Aware Meta Visual Prompting~(DAM-VP), an efficient and effective prompting method for transferring pre-trained models to downstream tasks with frozen backbone. A challenging issue in visual prompting is that image…

Computer Vision and Pattern Recognition · Computer Science 2023-03-15 Qidong Huang , Xiaoyi Dong , Dongdong Chen , Weiming Zhang , Feifei Wang , Gang Hua , Nenghai Yu

Auto-bidding, with its strong capability to optimize bidding decisions within dynamic and competitive online environments, has become a pivotal strategy for advertising platforms. Existing approaches typically employ rule-based strategies…

Machine Learning · Computer Science 2025-04-28 Jingtong Gao , Yewen Li , Shuai Mao , Peng Jiang , Nan Jiang , Yejing Wang , Qingpeng Cai , Fei Pan , Peng Jiang , Kun Gai , Bo An , Xiangyu Zhao

Poor sample efficiency continues to be the primary challenge for deployment of deep Reinforcement Learning (RL) algorithms for real-world applications, and in particular for visuo-motor control. Model-based RL has the potential to be highly…

Machine Learning · Computer Science 2022-12-13 Nicklas Hansen , Yixin Lin , Hao Su , Xiaolong Wang , Vikash Kumar , Aravind Rajeswaran

In offline reinforcement learning (RL), the absence of active exploration calls for attention on the model robustness to tackle the sim-to-real gap, where the discrepancy between the simulated and deployed environments can significantly…

Machine Learning · Computer Science 2024-06-28 He Wang , Laixi Shi , Yuejie Chi

High-quality and diverse multimodal data are essential for improving vision-language models (VLMs), yet existing datasets often contain noisy, redundant, and poorly aligned samples. To address these problems, data filtering is commonly used…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Biao Wu , Yiwu Zhong , Meng Fang , Ling Chen

Recent large reasoning models (LRMs) driven by reinforcement learning algorithms (e.g., GRPO) have achieved remarkable performance on challenging reasoning tasks. However, these models suffer from overthinking, generating unnecessarily long…

Artificial Intelligence · Computer Science 2026-03-03 Gang Li , Yan Chen , Ming Lin , Tianbao Yang

Recent advances in Vision-Language-Action (VLA) models, powered by large language models and reinforcement learning-based fine-tuning, have shown remarkable progress in robotic manipulation. Existing methods often treat long-horizon actions…

Robotics · Computer Science 2025-12-25 Feng Xu , Guangyao Zhai , Xin Kong , Tingzhong Fu , Daniel F. N. Gordon , Xueli An , Benjamin Busam

Order dispatch is a critical task in ride-sharing systems with Autonomous Vehicles (AVs), directly influencing efficiency and profits. Recently, Multi-Agent Reinforcement Learning (MARL) has emerged as a promising solution to this problem…

Artificial Intelligence · Computer Science 2026-04-17 Zijian Zhao , Sen Li

Policy optimization methods are powerful algorithms in Reinforcement Learning (RL) for their flexibility to deal with policy parameterization and ability to handle model misspecification. However, these methods usually suffer from slow…

Machine Learning · Computer Science 2023-06-19 Yunfan Li , Yiran Wang , Yu Cheng , Lin Yang

Post-training LLMs with Reinforcement Learning, specifically Group Relative Policy Optimization (GRPO), has emerged as a paradigm for enhancing mathematical reasoning. However, standard GRPO relies on scalar correctness rewards that are…

Computation and Language · Computer Science 2026-03-03 Xiwen Chen , Wenhui Zhu , Peijie Qiu , Xuanzhao Dong , Hao Wang , Haiyu Wu , Huayu Li , Aristeidis Sotiras , Yalin Wang , Abolfazl Razi

Autoregressive (AR) models are highly effective for image generation, yet their standard maximum-likelihood estimation training lacks direct optimization for sample quality and diversity. While reinforcement learning (RL) has been used to…

Machine Learning · Computer Science 2026-03-25 Orhun Buğra Baran , Melih Kandemir , Ramazan Gokberk Cinbis

Offline reinforcement learning methods hold the promise of learning policies from pre-collected datasets without the need to query the environment for new transitions. This setting is particularly well-suited for continuous control robotic…

Machine Learning · Computer Science 2022-03-18 Xi Chen , Ali Ghadirzadeh , Tianhe Yu , Yuan Gao , Jianhao Wang , Wenzhe Li , Bin Liang , Chelsea Finn , Chongjie Zhang

Despite the recent advancements of vision-language-action (VLA) models on a variety of robotics tasks, they suffer from critical issues such as poor generalizability to unseen tasks, due to their reliance on behavior cloning exclusively…

Robotics · Computer Science 2025-02-05 Zijian Zhang , Kaiyuan Zheng , Zhaorun Chen , Joel Jang , Yi Li , Siwei Han , Chaoqi Wang , Mingyu Ding , Dieter Fox , Huaxiu Yao

Model-free reinforcement learning (RL) methods are succeeding in a growing number of tasks, aided by recent advances in deep learning. However, they tend to suffer from high sample complexity, which hinders their use in real-world domains.…

Machine Learning · Computer Science 2018-10-08 Thanard Kurutach , Ignasi Clavera , Yan Duan , Aviv Tamar , Pieter Abbeel

Sampling complex free energy surfaces is one of the main challenges of modern atomistic simulation methods. The presence of kinetic bottlenecks in such surfaces often renders a direct approach useless. A popular strategy is to identify a…

Computational Physics · Physics 2019-09-25 Luigi Bonati , Yue-Yu Zhang , Michele Parrinello

Group-relative RL training (GRPO) samples a small group of parallel rollouts for every training prompt and uses their within-group reward spread to compute per-trajectory advantages. In agentic environments each rollout is a long multi-turn…

Machine Learning · Computer Science 2026-05-08 Zhiyuan Zhai , Xin Wang

Mixture-of-Experts (MoE) has emerged as an effective approach to reduce the computational overhead of Transformer architectures by sparsely activating a subset of parameters for each token while preserving high model capacity. This paradigm…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Dohwan Ko , Jinyoung Park , Seoung Choi , Sanghyeok Lee , Seohyun Lee , Hyunwoo J. Kim

Recent advances in flow matching models, particularly with reinforcement learning (RL), have significantly enhanced human preference alignment in few step text to image generators. However, existing RL based approaches for flow matching…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Zhixiong Yue , Zixuan Ni , Feiyang Ye , Jinshan Zhang , Sheng Shen , Zhenpeng Mi