English
Related papers

Related papers: Revisiting Reweighted Wake-Sleep for Models with S…

200 papers

We introduce Statistical Flow Matching (SFM), a novel and mathematically rigorous flow-matching framework on the manifold of parameterized probability measures inspired by the results from information geometry. We demonstrate the…

Machine Learning · Computer Science 2025-11-26 Chaoran Cheng , Jiahan Li , Jian Peng , Ge Liu

Despite the strong theoretical guarantees that variance-reduced finite-sum optimization algorithms enjoy, their applicability remains limited to cases where the memory overhead they introduce (SAG/SAGA), or the periodic full gradient…

Optimization and Control · Mathematics 2021-03-24 Ayoub El Hanchi , David A. Stephens

Designing a deep neural network (DNN) with good generalization capability is a complex process especially when the weights are severely quantized. Model averaging is a promising approach for achieving the good generalization capability of…

Machine Learning · Computer Science 2020-02-04 Sungho Shin , Yoonho Boo , Wonyong Sung

Recurrent neural networks (RNNs) are powerful models for processing time-series data, but it remains challenging to understand how they function. Improving this understanding is of substantial interest to both the machine learning and…

Machine Learning · Computer Science 2021-11-03 Jimmy T. H. Smith , Scott W. Linderman , David Sussillo

Imitation learning has emerged as an effective approach for bootstrapping sequential decision-making in robotics, achieving strong performance even in high-dimensional dexterous manipulation tasks. Recent behavior cloning methods further…

Robotics · Computer Science 2026-02-06 Entong Su , Tyler Westenbroek , Anusha Nagabandi , Abhishek Gupta

Pronounced variability due to the growth of renewable energy sources, flexible loads, and distributed generation is challenging residential distribution systems. This context, motivates well fast, efficient, and robust reactive power…

Systems and Control · Electrical Eng. & Systems 2019-10-31 Qiuling Yang , Alireza Sadeghi , Gang Wang , Georgios B. Giannakis , Jian Sun

Queuing network control is essential for managing congestion in job-processing systems such as service systems, communication networks, and manufacturing processes. Despite growing interest in applying reinforcement learning (RL)…

Machine Learning · Computer Science 2024-09-06 Ethan Che , Jing Dong , Hongseok Namkoong

A data set sampled from a certain population is biased if the subgroups of the population are sampled at proportions that are significantly different from their underlying proportions. Training machine learning models on biased data sets…

Machine Learning · Computer Science 2021-08-30 Jing An , Lexing Ying , Yuhua Zhu

Multi-Task Learning (MTL) has achieved success in various fields. However, how to balance different tasks to achieve good performance is a key problem. To achieve the task balancing, there are many works to carefully design dynamical…

Machine Learning · Computer Science 2022-07-28 Baijiong Lin , Feiyang Ye , Yu Zhang , Ivor W. Tsang

Reward-based fine-tuning steers a pretrained diffusion or flow-based generative model toward higher-reward samples while remaining close to the pretrained model. Although existing methods are derived from different perspectives, we show…

Machine Learning · Computer Science 2026-05-08 Jeongjae Lee , Jinho Chang , Jeongsol Kim , Jong Chul Ye

Machine learning frameworks such as Genetic Programming (GP) and Reinforcement Learning (RL) are gaining popularity in flow control. This work presents a comparative analysis of the two, bench-marking some of their most representative…

Fluid Dynamics · Physics 2023-03-22 Fabio Pino , Lorenzo Schena , Jean Rabault , Miguel A. Mendez

Score-based diffusion models currently constitute the state of the art in continuous generative modeling. These methods are typically formulated via overdamped or underdamped Ornstein--Uhlenbeck-type stochastic differential equations, in…

Machine Learning · Computer Science 2025-12-22 Herlock Rahimi

We investigate the convergence rates and data sample sizes required for training a machine learning model using a stochastic gradient descent (SGD) algorithm, where data points are sampled based on either their loss value or uncertainty…

Machine Learning · Computer Science 2024-11-26 Daniel Haimovich , Dima Karamshuk , Fridolin Linder , Niek Tax , Milan Vojnovic

Preclinical sleep research remains constrained by labor intensive, manual vigilance state classification and inter rater variability, limiting throughput and reproducibility. This study presents an automated framework developed by Team…

Signal Processing · Electrical Eng. & Systems 2025-07-22 Sankalp Jajee , Gaurav Kumar , Homayoun Valafar

Recent advancements in reinforcement learning (RL) have achieved great success in fine-tuning diffusion-based generative models. However, fine-tuning continuous flow-based generative models to align with arbitrary user-defined reward…

Machine Learning · Computer Science 2025-02-11 Jiajun Fan , Shuaike Shen , Chaoran Cheng , Yuxin Chen , Chumeng Liang , Ge Liu

Continual learning algorithms which keep the parameters of new tasks close to that of previous tasks, are popular in preventing catastrophic forgetting in sequential task learning settings. However, 1) the performance for the new continual…

Machine Learning · Computer Science 2023-07-21 Wei Cong , Yang Cong , Gan Sun , Yuyang Liu , Jiahua Dong

This paper considers a class of reinforcement learning problems, which involve systems with two types of states: stochastic and pseudo-stochastic. In such systems, stochastic states follow a stochastic transition kernel while the…

Machine Learning · Computer Science 2023-11-09 Honghao Wei , Xin Liu , Weina Wang , Lei Ying

Reinforcement learning (RL) has become an effective way to improve prompt alignment and perceptual quality in diffusion and flow-matching generators. A critical step for applying online RL to flow matching is turning the deterministic…

Machine Learning · Computer Science 2026-05-25 Jade Zou , Tao Huang , Weijie Kong , Junzhe Li , Yue Wu , Qi Tian , Jiangfeng Xiong , Jianwei Zhang , Liefeng Bo , Zhao Zhong

In constrained reinforcement learning (C-RL), an agent seeks to learn from the environment a policy that maximizes the expected cumulative reward while satisfying minimum requirements in secondary cumulative reward constraints. Several…

Machine Learning · Computer Science 2022-12-06 Tianqi Zheng , Pengcheng You , Enrique Mallada

Graphical models are powerful tools for modeling high-dimensional data, but learning graphical models in the presence of latent variables is well-known to be difficult. In this work we give new results for learning Restricted Boltzmann…

Machine Learning · Computer Science 2020-07-28 Surbhi Goel , Adam Klivans , Frederic Koehler