English
Related papers

Related papers: Dynamic Optimization and Learning for Renewal Syst…

200 papers

We develop an approach for solving time-consistent risk-sensitive stochastic optimization problems using model-free reinforcement learning (RL). Specifically, we assume agents assess the risk of a sequence of random variables using dynamic…

Machine Learning · Computer Science 2022-12-01 Anthony Coache , Sebastian Jaimungal

A challenging category of robotics problems arises when sensing incurs substantial costs. This paper examines settings in which a robot wishes to limit its observations of state, for instance, motivated by specific considerations of energy…

Robotics · Computer Science 2023-09-26 Patrick Zhong , Federico Rossi , Dylan A. Shell

Much as replacing hand-designed features with learned functions has revolutionized how we solve perceptual tasks, we believe learned algorithms will transform how we train models. In this work we focus on general-purpose learned optimizers…

Machine Learning · Computer Science 2020-09-24 Luke Metz , Niru Maheswaranathan , C. Daniel Freeman , Ben Poole , Jascha Sohl-Dickstein

The paper addresses large-scale, convex optimization problems that need to be solved in a distributed way by agents communicating according to a random time-varying graph. Specifically, the goal of the network is to minimize the sum of…

Optimization and Control · Mathematics 2020-10-28 Andrea Camisa , Francesco Farina , Ivano Notarnicola , Giuseppe Notarstefano

Evolutionary algorithms have been widely applied for solving dynamic constrained optimization problems (DCOPs) as a common area of research in evolutionary optimization. Current benchmarks proposed for testing these problems in the…

Neural and Evolutionary Computing · Computer Science 2019-07-10 Maryam Hasani-Shoreh , María-Yaneli Ameca-Alducin , Wilson Blaikie , Frank Neumann , Marc Schoenauer

Evolutionary algorithms are bio-inspired algorithms that can easily adapt to changing environments. Recent results in the area of runtime analysis have pointed out that algorithms such as the (1+1)~EA and Global SEMO can efficiently…

Neural and Evolutionary Computing · Computer Science 2022-06-07 Vahid Roostapour , Aneta Neumann , Frank Neumann

Meta-reinforcement learning algorithms provide a data-driven way to acquire policies that quickly adapt to many tasks with varying rewards or dynamics functions. However, learned meta-policies are often effective only on the exact task…

Machine Learning · Computer Science 2023-07-13 Anurag Ajay , Abhishek Gupta , Dibya Ghosh , Sergey Levine , Pulkit Agrawal

We address the problem of sequentially selecting and observing processes from a given set to find the anomalies among them. The decision-maker observes a subset of the processes at any given time instant and obtains a noisy binary indicator…

Machine Learning · Computer Science 2021-12-10 Geethu Joseph , Chen Zhong , M. Cenk Gursoy , Senem Velipasalar , Pramod K. Varshney

The problem of behaviour prediction for linear parameter-varying systems is considered in the interval framework. It is assumed that the system is subject to uncertain inputs and the vector of scheduling parameters is unmeasurable, but all…

Systems and Control · Computer Science 2019-08-13 Edouard Leurent , Denis Efimov , Tarek Raïssi , Wilfrid Perruquetti

Dynamic Programming (DP) provides standard algorithms to solve Markov Decision Processes. However, these algorithms generally do not optimize a scalar objective function. In this paper, we draw connections between DP and (constrained)…

Machine Learning · Computer Science 2019-10-30 Nino Vieillard , Olivier Pietquin , Matthieu Geist

In this paper, a novel distributed optimization framework has been proposed. The key idea is to convert optimization problems into optimal control problems where the objective of each agent is to design the current control input minimizing…

Optimization and Control · Mathematics 2025-04-01 Ziyuan Guo , Yue Sun , Yeming Xu , Liping Zhang , Huanshui Zhang

Decision-making under distribution shift is a central challenge in reinforcement learning (RL), where training and deployment environments differ. We study this problem through the lens of robust Markov decision processes (RMDPs), which…

Machine Learning · Computer Science 2025-10-17 Jingwen Gu , Yiting He , Zhishuai Liu , Pan Xu

Classic algorithms and machine learning systems like neural networks are both abundant in everyday life. While classic computer science algorithms are suitable for precise execution of exactly defined tasks such as finding the shortest path…

Machine Learning · Computer Science 2022-09-02 Felix Petersen

Imitation learning is a paradigm to address complex motion planning problems by learning a policy to imitate an expert's behavior. However, relying solely on the expert's data might lead to unsafe actions when the robot deviates from the…

Robotics · Computer Science 2024-11-06 Amin Abyaneh , Hsiu-Chin Lin

Recent advancements in meta-learning have enabled the automatic discovery of novel reinforcement learning algorithms parameterized by surrogate objective functions. To improve upon manually designed algorithms, the parameterization of this…

Traditional maximum entropy and sparsity-based algorithms for analytic continuation often suffer from the ill-posed kernel matrix or demand tremendous computation time for parameter tuning. Here we propose a neural network method by convex…

Machine Learning · Computer Science 2022-02-07 Dongchen Huang , Yi-feng Yang

Deep neural networks are typically trained by uniformly sampling large datasets across epochs, despite evidence that not all samples contribute equally throughout learning. Recent work shows that progressively reducing the amount of…

Machine Learning · Computer Science 2026-04-15 Amar Gahir , Varshil Patel , Shreyank N Gowda

The connection between control algorithms for Markov decision processes and optimization algorithms has been implicitly and explicitly exploited since the introduction of dynamic programming algorithm by Bellman in the 1950s. Recently, this…

Optimization and Control · Mathematics 2025-12-09 Tolga Ok , Arman Sharifi Kolarijani , Mohamad Amin Sharif Kolarijani , Peyman Mohajerin Esfahani

We study the problem of learning to predict the next state of a dynamical system when the underlying evolution function is unknown. Unlike previous work, we place no parametric assumptions on the dynamical system, and study the problem from…

Machine Learning · Computer Science 2025-06-04 Vinod Raman , Unique Subedi , Ambuj Tewari

When optimizing problems with uncertain parameter values in a linear objective, decision-focused learning enables end-to-end learning of these values. We are interested in a stochastic scheduling problem, in which processing times are…

Machine Learning · Computer Science 2024-08-16 Kim van den Houten , David M. J. Tax , Esteban Freydell , Mathijs de Weerdt