English
Related papers

Related papers: Online Dynamic Programming

200 papers

Most methods for decision-theoretic online learning are based on the Hedge algorithm, which takes a parameter called the learning rate. In most previous analyses the learning rate was carefully tuned to obtain optimal worst-case…

Machine Learning · Statistics 2015-03-04 Tim van Erven , Peter Grünwald , Wouter M. Koolen , Steven de Rooij

In this paper, we present a quantum algorithm for dynamic programming approach for problems on directed acyclic graphs (DAGs). The running time of the algorithm is $O(\sqrt{\hat{n}m}\log \hat{n})$, and the running time of the best known…

Data Structures and Algorithms · Computer Science 2019-06-21 Kamil Khadiev , Liliya Safina

Learning the structure of Directed Acyclic Graphs (DAGs) presents a significant challenge due to the vast combinatorial search space of possible graphs, which scales exponentially with the number of nodes. Recent advancements have redefined…

Machine Learning · Computer Science 2024-11-01 Klea Ziu , Slavomír Hanzely , Loka Li , Kun Zhang , Martin Takáč , Dmitry Kamzolov

This paper presents a method for online trajectory planning in known environments. The proposed algorithm is a fusion of sampling-based techniques and model-based optimization via quadratic programming. The former is used to efficiently…

Existing high-dimensional online learning methods often face the challenge that their error bounds, or per-batch sample sizes, diverge as the number of data batches increases. To address this issue, we propose an asynchronous decomposition…

Machine Learning · Statistics 2026-03-24 Shixiang Liu , Zhifan Li , Hanming Yang , Jianxin Yin

This paper presents a novel learning-based trajectory planning framework for quadrotors that combines model-based optimization techniques with deep learning. Specifically, we formulate the trajectory optimization problem as a quadratic…

Robotics · Computer Science 2023-12-05 Yuwei Wu , Xiatao Sun , Igor Spasojevic , Vijay Kumar

Districting is a complex combinatorial problem that consists in partitioning a geographical area into small districts. In logistics, it is a major strategic decision determining operating costs for several years. Solving districting…

Machine Learning · Computer Science 2024-12-12 Cheikh Ahmed , Alexandre Forel , Axel Parmentier , Thibaut Vidal

In many problems, the inputs arrive over time, and must be dealt with irrevocably when they arrive. Such problems are online problems. A common method of solving online problems is to first solve the corresponding linear program, and then…

Data Structures and Algorithms · Computer Science 2012-04-04 Umang Bhaskar , Lisa Fleischer

In this paper, we present a quantum algorithm for the dynamic programming approach for problems on directed acyclic graphs (DAGs). The running time of the algorithm is $O(\sqrt{\hat{n}m}\log \hat{n})$, and the running time of the best known…

Quantum Physics · Physics 2023-01-02 Kamil Khadiev , Liliya Safina

Despite significant recent advances in deep neural networks, training them remains a challenge due to the highly non-convex nature of the objective function. State-of-the-art methods rely on error backpropagation, which suffers from several…

Online learning algorithms for dynamical systems provide finite time guarantees for control in the presence of sequentially revealed cost functions. We pose the classical linear quadratic tracking problem in the framework of online…

Systems and Control · Electrical Eng. & Systems 2024-10-18 Aren Karapetyan , Diego Bolliger , Anastasios Tsiamis , Efe C. Balta , John Lygeros

Transfer learning techniques have been widely used in the reality that it is difficult to obtain sufficient labeled data in the target domain, but a large amount of auxiliary data can be obtained in the relevant source domain. But most of…

Machine Learning · Computer Science 2019-10-22 Guokun Chi , Min Jiang , Xing Gao , Weizhen Hu , Shihui Guo , Kay Chen Tan

This paper considers the problem of designing a dynamical system to solve constrained optimization problems in a distributed way and in an anytime fashion (i.e., such that the feasible set is forward invariant). For problems with separable…

Optimization and Control · Mathematics 2023-09-07 Pol Mestres , Jorge Cortés

Online learning is a powerful tool for analyzing iterative algorithms. However, the classic adversarial setup sometimes fails to capture certain regularity in online problems in practice. Motivated by this, we establish a new setup, called…

Machine Learning · Computer Science 2022-04-06 Ching-An Cheng , Jonathan Lee , Ken Goldberg , Byron Boots

Dynamic programming is widely used for exact computations based on tree decompositions of graphs. However, the space complexity is usually exponential in the treewidth. We study the problem of designing efficient dynamic programming…

Data Structures and Algorithms · Computer Science 2014-06-16 Martin Furer , Huiwen Yu

In this paper we develop optimal algorithms in the binary-forking model for a variety of fundamental problems, including sorting, semisorting, list ranking, tree contraction, range minima, and ordered set union, intersection and difference.…

Data Structures and Algorithms · Computer Science 2020-06-26 Guy E. Blelloch , Jeremy T. Fineman , Yan Gu , Yihan Sun

In online learning an algorithm plays against an environment with losses possibly picked by an adversary at each round. The generality of this framework includes problems that are not adversarial, for example offline optimization, or saddle…

Machine Learning · Computer Science 2021-02-04 Ryan D'Orazio , Ruitong Huang

Estimating the structure of directed acyclic graphs (DAGs, also known as Bayesian networks) is a challenging problem since the search space of DAGs is combinatorial and scales superexponentially with the number of nodes. Existing approaches…

Machine Learning · Statistics 2018-11-06 Xun Zheng , Bryon Aragam , Pradeep Ravikumar , Eric P. Xing

We present an efficient distributed online learning scheme to classify data captured from distributed, heterogeneous, and dynamic data sources. Our scheme consists of multiple distributed local learners, that analyze different streams of…

Machine Learning · Computer Science 2013-08-27 Luca Canzian , Yu Zhang , Mihaela van der Schaar

The goal in offline data-driven decision-making is synthesize decisions that optimize a black-box utility function, using a previously-collected static dataset, with no active interaction. These problems appear in many forms: offline…

Machine Learning · Computer Science 2022-11-28 Han Qi , Yi Su , Aviral Kumar , Sergey Levine