English
Related papers

Related papers: Neural Dynamic Data Valuation: A Stochastic Optima…

200 papers

Dynamic programming is a class of algorithms used to compute optimal control policies for Markov decision processes. Dynamic programming is ubiquitous in control theory, and is also the foundation of reinforcement learning. In this paper,…

Category Theory · Mathematics 2023-08-01 Jules Hedges , Riu Rodríguez Sakamoto

Neural Networks (NNs) have been successfully employed to represent the state evolution of complex dynamical systems. Such models, referred to as NN dynamic models (NNDMs), use iterative noisy predictions of NN to estimate a distribution of…

Systems and Control · Electrical Eng. & Systems 2025-05-27 Rayan Mazouz , Karan Muvvala , Akash Ratheesh , Luca Laurenti , Morteza Lahijanian

It is well-known that deep neural networks (DNNs) have shown remarkable success in many fields. However, when adding an imperceptible magnitude perturbation on the model input, the model performance might get rapid decrease. To address this…

Machine Learning · Computer Science 2022-01-04 Hao Yang , Min Wang , Zhengfei Yu , Yun Zhou

Control of a dynamical system without the knowledge of dynamics is an important and challenging task. Modern machine learning approaches, such as deep neural networks (DNNs), allow for the estimation of a dynamics model from control inputs…

Systems and Control · Electrical Eng. & Systems 2023-11-14 Suruchi Sharma , Volodymyr Makarenko , Gautam Kumar , Stas Tiomkin

In this article, we propose a data-enabled economic predictive control method for a class of nonlinear systems, which aims to optimize the economic operational performance while handling hard constraints on the system outputs. Two lifting…

Systems and Control · Electrical Eng. & Systems 2025-12-30 Mingxue Yan , Xuewen Zhang , Kaixiang Zhang , Zhaojian Li , Xunyuan Yin

We present a neural network approach for approximating the value function of high-dimensional stochastic control problems. Our training process simultaneously updates our value function estimate and identifies the part of the state space…

Optimization and Control · Mathematics 2024-05-08 Xingjian Li , Deepanshu Verma , Lars Ruthotto

This text presents an introduction to an emerging paradigm in control of dynamical systems and differentiable reinforcement learning called online nonstochastic control. The new approach applies techniques from online convex optimization…

Machine Learning · Computer Science 2026-04-28 Elad Hazan , Karan Singh

In data mining, estimating the number of distinct values (NDV) is a fundamental problem with various applications. Existing methods for estimating NDV can be broadly classified into two categories: i) scanning-based methods, which scan the…

Databases · Computer Science 2022-06-14 Jiajun Li , Zhewei Wei , Bolin Ding , Xiening Dai , Lu Lu , Jingren Zhou

In this paper, we consider the classic stochastic (dynamic) knapsack problem, a fundamental mathematical model in revenue management, with general time-varying random demand. Our main goal is to study the optimal policies, which can be…

Optimization and Control · Mathematics 2018-07-19 Yingdong Lu

To acquire a new skill, humans learn better and faster if a tutor, based on their current knowledge level, informs them of how much attention they should pay to particular content or practice problems. Similarly, a machine learning model…

Machine Learning · Computer Science 2021-06-18 Xinyi Wang , Hieu Pham , Paul Michel , Antonios Anastasopoulos , Jaime Carbonell , Graham Neubig

Traditionally, data valuation (DV) is posed as a problem of equitably splitting the validation performance of a learning algorithm among the training data. As a result, the calculated data values depend on many design choices of the…

Machine Learning · Computer Science 2023-12-21 Hoang Anh Just , Feiyang Kang , Jiachen T. Wang , Yi Zeng , Myeongseob Ko , Ming Jin , Ruoxi Jia

The current dominant paradigm in sensorimotor control, whether imitation or reinforcement learning, is to train policies directly in raw action spaces such as torque, joint angle, or end-effector position. This forces the agent to make…

Machine Learning · Computer Science 2020-12-07 Shikhar Bahl , Mustafa Mukadam , Abhinav Gupta , Deepak Pathak

Data selection is one of the fundamental problems in neural network training, particularly for multi-layer perceptrons (MLPs) where identifying the most valuable training samples from massive, multi-source, and heterogeneous data sources…

Machine Learning · Computer Science 2025-10-27 Xiyang Zhang , Chen Liang , Haoxuan Qiu , Hongzhi Wang

This paper introduces a new formulation for stochastic optimal control and stochastic dynamic optimization that ensures safety with respect to state and control constraints. The proposed methodology brings together concepts such as…

Systems and Control · Electrical Eng. & Systems 2021-02-19 Marcus Aloysius Pereira , Ziyi Wang , Ioannis Exarchos , Evangelos A. Theodorou

Interpretation of Deep Neural Networks (DNNs) training as an optimal control problem with nonlinear dynamical systems has received considerable attention recently, yet the algorithmic development remains relatively limited. In this work, we…

Machine Learning · Computer Science 2021-06-14 Guan-Horng Liu , Tianrong Chen , Evangelos A. Theodorou

The coordinated and efficient distribution of limited resources by individual decisions is a fundamental, unsolved problem. When individuals compete for road capacities, time, space, money, goods, etc., they normally make decisions based on…

Statistical Mechanics · Physics 2009-11-07 Dirk Helbing , Martin Schoenhof , Daniel Kern

Traditional statistical estimation, or statistical inference in general, is static, in the sense that the estimate of the quantity of interest does not change the future evolution of the quantity. In some sequential estimation problems…

Machine Learning · Computer Science 2021-12-01 Aolin Xu

Data selection has emerged as a crucial downstream application of data valuation. While existing data valuation methods have shown promise in selection tasks, the theoretical foundations and full potential of using data values for selection…

Artificial Intelligence · Computer Science 2025-02-10 Hongliang Chi , Qiong Wu , Zhengyi Zhou , Jonathan Light , Emily Dodwell , Yao Ma

We introduce Direct Value Optimization (DVO), an innovative reinforcement learning framework for enhancing large language models in complex reasoning tasks. Unlike traditional methods relying on preference labels, DVO utilizes value signals…

Computation and Language · Computer Science 2025-02-20 Hongbo Zhang , Han Cui , Guangsheng Bao , Linyi Yang , Jun Wang , Yue Zhang

Finding valuable training data points for deep neural networks has been a core research challenge with many applications. In recent years, various techniques for calculating the "value" of individual training datapoints have been proposed…

Machine Learning · Computer Science 2021-04-29 Soumi Das , Arshdeep Singh , Saptarshi Chatterjee , Suparna Bhattacharya , Sourangshu Bhattacharya