FlowRL: Flow-Augmented Few-Shot Reinforcement Learning for Semi-Structured Sensor Data
Abstract
Reinforcement learning (RL) in few-shot scenarios with limited sensor data is challenging due to insufficient training samples, particularly in applications like Dynamic Voltage and Frequency Scaling (DVFS) where sensor readings are semi-structured with inherent correlations. We propose Flow-Augmented Reinforcement Learning (FlowRL), a novel method that leverages continuous normalizing flows to generate high-quality synthetic data for few-shot RL. By integrating latent space bootstrapping for diversity and feature-weighted flow matching to preserve critical data correlations, FlowRL enhances sample efficiency and policy robustness. Evaluated on a DVFS case study using the NVIDIA Jetson TX2, our approach achieves up to 35\% higher frame rates and faster Q-value convergence compared to baselines, demonstrating its effectiveness in resource-constrained environments. FlowRL generalizes to other semi-structured domains, such as robotics and smart grids, offering a scalable solution for data-scarce RL settings.
Cite
@article{arxiv.2409.14178,
title = {FlowRL: Flow-Augmented Few-Shot Reinforcement Learning for Semi-Structured Sensor Data},
author = {Mohammad Pivezhandi and Abusayeed Saifullah},
journal= {arXiv preprint arXiv:2409.14178},
year = {2026}
}
Comments
13 pages, 5 figures, 2 tables