English
Related papers

Related papers: Divide and Conquer Dynamic Programming: An Almost …

200 papers

The main goal of this paper is to investigate continuous-time distributed dynamic programming (DP) algorithms for networked multi-agent Markov decision problems (MAMDPs). In our study, we adopt a distributed multi-agent framework where…

Systems and Control · Electrical Eng. & Systems 2024-06-14 Donghwan Lee , Han-Dong Lim , Do Wan Kim

Mirror descent (MD) is a powerful first-order optimization technique that subsumes several optimization algorithms including gradient descent (GD). In this work, we develop a semi-definite programming (SDP) framework to analyze the…

Optimization and Control · Mathematics 2022-01-19 Youbang Sun , Mahyar Fazlyab , Shahin Shahrampour

We propose a new, computationally efficient, sparsity adaptive changepoint estimator for detecting changes in unknown subsets of a high-dimensional data sequence. Assuming the data sequence is Gaussian, we prove that the new method…

Methodology · Statistics 2023-11-27 Per August Jarval Moen , Ingrid Kristine Glad , Martin Tveten

Many offline unsupervised change point detection algorithms rely on minimizing a penalized sum of segment-wise costs. We extend this framework by proposing to minimize a sum of discrepancies between segments. In particular, we propose to…

Machine Learning · Computer Science 2020-09-04 Aurélien Serre , Didier Chételat , Andrea Lodi

High-dimensional data that evolve dynamically feature predominantly in the modern data era. As a partial response to this, recent years have seen increasing emphasis to address the dimensionality challenge. However, the non-static nature of…

Methodology · Statistics 2019-01-21 Binyan Jiang , Ziqi Chen , Chenlei Leng

The goal of the change-point detection is to discover changes of time series distribution. One of the state of the art approaches of the change-point detection are based on direct density ratio estimation. In this work we show how existing…

Machine Learning · Computer Science 2022-06-22 Mikhail Hushchyn , Andrey Ustyuzhanin

A number of real world problems in many domains (e.g. sociology, biology, political science and communication networks) can be modeled as dynamic networks with nodes representing entities of interest and edges representing interactions…

Social and Information Networks · Computer Science 2017-06-06 Yu Wang , Aniket Chakrabarti , David Sivakoff , Srinivasan Parthasarathy

Differential Dynamic Programming is an optimal control technique often used for trajectory generation. Many variations of this algorithm have been developed in the literature, including algorithms for stochastic dynamics or state and input…

Optimization and Control · Mathematics 2022-05-26 Dennis Gramlich , Carsten W. Scherer , Christian Ebenbauer

This paper presents a unified framework for supervised learning and inference procedures using the divide-and-conquer approach for high-dimensional correlated outcomes. We propose a general class of estimators that can be implemented in a…

Statistics Theory · Mathematics 2020-09-22 Emily C. Hector , Peter X. -K. Song

Dynamic mode decomposition (DMD) is a powerful data-driven technique for construction of reduced-order models of complex dynamical systems. Multiple numerical tests have demonstrated the accuracy and efficiency of DMD, but mostly for…

Numerical Analysis · Mathematics 2021-07-28 Hannah Lu , Daniel M. Tartakovsky

Single-stage neural combinatorial optimization solvers have achieved near-optimal results on various small-scale combinatorial optimization (CO) problems without requiring expert knowledge. However, these solvers exhibit significant…

Artificial Intelligence · Computer Science 2025-01-22 Zhi Zheng , Changliang Zhou , Tong Xialiang , Mingxuan Yuan , Zhenkun Wang

In this paper we introduce a novel approach for an important problem of break detection. Specifically, we are interested in detection of an abrupt change in the covariance structure of a high-dimensional random process -- a problem, which…

Statistics Theory · Mathematics 2020-07-30 Valeriy Avanesov , Nazar Buzun

We propose a novel framework for learning a low-dimensional representation of data based on nonlinear dynamical systems, which we call dynamical dimension reduction (DDR). In the DDR model, each point is evolved via a nonlinear flow towards…

Machine Learning · Statistics 2022-04-19 Ryeongkyung Yoon , Braxton Osting

In this paper, we will develop a systematic approach to deriving guaranteed bounds for approximate dynamic programming (ADP) schemes in optimal control problems. Our approach is inspired by our recent results on bounding the performance of…

Optimization and Control · Mathematics 2014-03-31 Yajing Liu , Edwin K. P. Chong , Ali Pezeshki , Bill Moran

We study change-point detection for high-dimensional data in regimes where inference must be performed from small batches of observations. Our primary focus is the high-dimensional, low sample size (HDLSS) regime, where the sequence length…

Methodology · Statistics 2026-05-26 Jyotishka Ray Choudhury , Yao Xie

Identifying breakpoints in piecewise regression is critical in enhancing the reliability and interpretability of data fitting. In this paper, we propose novel algorithms based on the greedy algorithm to accurately and efficiently identify…

Machine Learning · Statistics 2026-04-14 Taehyeong Kim , Hyungu Lee , Myungjin Kim , Hayoung Choi

We investigate unsupervised anomaly detection for high-dimensional data and introduce a deep metric learning (DML) based framework. In particular, we learn a distance metric through a deep neural network. Through this metric, we project the…

Machine Learning · Computer Science 2020-05-13 Selim F. Yilmaz , Suleyman S. Kozat

We address the computational challenge of finding the robust sequential change-point detection procedures when the pre- and post-change distributions are not completely specified. Earlier works [veeravalli 1994] and [Unnikrishnan 2011]…

Methodology · Statistics 2018-03-14 Yang Cao , Yao Xie

Multilevel Image thresholding is an important preprocessing algorithm in computer vision applications nowadays. Since most common thresholding methods take the desired count of thresholds as input by the user, thresholding methods that…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Eslam Hegazy , Mohamed Gabr

Low precision deep neural network (DNN) training is one of the most effective techniques for boosting DNNs' training efficiency, as it trims down the training cost from the finest bit level. While existing works mostly fix the model…

Machine Learning · Computer Science 2022-03-16 Zhongzhi Yu , Yonggan Fu , Shang Wu , Mengquan Li , Haoran You , Yingyan Lin