English
Related papers

Related papers: Resource-Aware Discretization of Accelerated Optim…

200 papers

Discrete distributions, particularly in high-dimensional deep models, are often highly multimodal due to inherent discontinuities. While gradient-based discrete sampling has proven effective, it is susceptible to becoming trapped in local…

Machine Learning · Computer Science 2024-10-28 Patrick Pynadath , Riddhiman Bhattacharya , Arun Hariharan , Ruqi Zhang

Deep neural networks are typically trained by uniformly sampling large datasets across epochs, despite evidence that not all samples contribute equally throughout learning. Recent work shows that progressively reducing the amount of…

Machine Learning · Computer Science 2026-04-15 Amar Gahir , Varshil Patel , Shreyank N Gowda

In the dynamical systems approach to describing turbulent or otherwise chaotic flows, an important quantity is the Lyapunov exponents and vectors that characterize the strange attractor of the flow. In particular, knowledge of the Lyapunov…

Fluid Dynamics · Physics 2019-05-01 Malik Hassanaly , Venkat Raman

In decentralized optimization, nodes of a communication network each possess a local objective function, and communicate using gossip-based methods in order to minimize the average of these per-node functions. While synchronous algorithms…

Optimization and Control · Mathematics 2022-09-02 Mathieu Even , Hadrien Hendrikx , Laurent Massoulie

This research gauges the ability of deep reinforcement learning (DRL) techniques to assist the optimization and control of fluid mechanical systems. It combines a novel, "degenerate" version of the proximal policy optimization (PPO)…

Optimization and Control · Mathematics 2021-05-19 H. Ghraieb , J. Viquerat , A. Larcher , P. Meliga , E. Hachem

The timely delivery of resource-intensive and latency-sensitive services (e.g., industrial automation, augmented reality) over distributed computing networks (e.g., mobile edge computing) is drawing increasing attention. Motivated by the…

Networking and Internet Architecture · Computer Science 2022-06-01 Yang Cai , Jaime Llorca , Antonia M. Tulino , Andreas F. Molisch

In a Hilbert setting we aim to study a second order in time differential equation, combining viscous and Hessian-driven damping, containing a time scaling parameter function and a Tikhonov regularization term. The dynamical system is…

Optimization and Control · Mathematics 2024-04-24 Robert Ernö Csetnek , Mikhail A. Karapetyants

Sampling from discrete distributions is a ubiquitous task in machine learning, recently revisited by the emergence of discrete diffusion models. While Langevin algorithms constitute the state of the art for continuous spaces, discrete…

Statistics Theory · Mathematics 2026-02-18 Armand Gissler , Saeed Saremi , Francis Bach

The coordinated and efficient distribution of limited resources by individual decisions is a fundamental, unsolved problem. When individuals compete for road capacities, time, space, money, goods, etc., they normally make decisions based on…

Statistical Mechanics · Physics 2009-11-07 Dirk Helbing , Martin Schoenhof , Daniel Kern

Many systems exhibit a mixture of continuous and discrete dynamics. We consider a family of mixed-integer non-convex non-linear optimisation problems obtained in discretisations of optimal control of such systems. For this family, a…

Optimization and Control · Mathematics 2020-01-23 Jorn Baayen , Jakub Marecek

Many reinforcement learning algorithms are built on an assumption that an agent interacts with an environment over fixed-duration, discrete time steps. However, physical systems are continuous in time, requiring a choice of…

Machine Learning · Computer Science 2024-09-04 Kris De Asis , Richard S. Sutton

In this paper, a deep reinforcement learning (DRL)-based approach to the Lyapunov optimization is considered to minimize the time-average penalty while maintaining queue stability. A proper construction of state and action spaces is…

Networking and Internet Architecture · Computer Science 2020-12-16 Sohee Bae , Seungyul Han , Youngchul Sung

We propose a data-driven online convex optimization algorithm for controlling dynamical systems. In particular, the control scheme makes use of an initially measured input-output trajectory and behavioral systems theory which enable it to…

Optimization and Control · Mathematics 2021-11-03 Marko Nonhoff , Matthias A. Müller

This work studies the design problem of feedback stabilizers for discrete-time systems with input delays. A backstepping procedure is proposed for disturbance-free discrete-time systems. The feedback law designed by using backstepping…

Optimization and Control · Mathematics 2012-12-05 Iasson Karafyllis , Miroslav Krstic

We present a novel methodology for convex optimization algorithm design using ideas from electric RLC circuits. Given an optimization problem, the first stage of the methodology is to design an appropriate electric circuit whose…

Optimization and Control · Mathematics 2025-01-22 Stephen P. Boyd , Tetiana Parshakova , Ernest K. Ryu , Jaewook J. Suh

Recently, there has been a growing interest in distributionally robust optimization (DRO) as a principled approach to data-driven decision making. In this paper, we consider a distributionally robust two-stage stochastic optimization…

Optimization and Control · Mathematics 2020-12-07 Zhe Zhang , Shabbir Ahmed , Guanghui Lan

Analyzing and controlling system entropy is a powerful tool for regulating predictability of control systems. Applications benefiting from such approaches range from reinforcement learning and data security to human-robot collaboration. In…

Systems and Control · Electrical Eng. & Systems 2026-03-06 Menno van Zutphen , Giannis Delimpaltadakis , Duarte J. Antunes

Finite-time optimal feedback control for flow networks under information constraints is studied. By utilizing the framework of multi-parametric linear programming, it is demonstrated that when cost/constraints can be modeled or approximated…

Systems and Control · Computer Science 2019-09-24 Saeid Jafari , Ketan Savla

Stochastic optimal control problems have a long tradition in applied probability, with the questions addressed being of high relevance in a multitude of fields. Even though theoretical solutions are well understood in many scenarios, their…

Statistics Theory · Mathematics 2024-05-28 Sören Christensen , Claudia Strauch , Lukas Trottner

We consider the problem of sampling from a discrete and structured distribution as a sequential decision problem, where the objective is to find a stochastic policy such that objects are sampled at the end of this sequential process…

Machine Learning · Computer Science 2024-05-29 Tristan Deleu , Padideh Nouri , Nikolay Malkin , Doina Precup , Yoshua Bengio