English
Related papers

Related papers: Adaptive Shivers Sort: An Alternative Sorting Algo…

200 papers

This paper presents a numerical solver for computing continuous trajectories in non-convex environments. Our approach relies on a customized implementation of the Alternating Direction Method of Multipliers (ADMM) built upon two key…

Robotics · Computer Science 2026-03-13 Lukas Pries , Jon Arrizabalaga , Zachary Manchester , Markus Ryll

We introduce a family of numerical algorithms for the solution of linear system in higher dimensions with the matrix and right hand side given and the solution sought in the tensor train format. The proposed methods are rank--adaptive and…

Numerical Analysis · Mathematics 2014-10-07 Sergey V. Dolgov , Dmitry V. Savostyanov

We propose a batchwise monotone algorithm for dictionary learning. Unlike the state-of-the-art dictionary learning algorithms which impose sparsity constraints on a sample-by-sample basis, we instead treat the samples as a batch, and impose…

Machine Learning · Computer Science 2015-02-03 Huan Wang , John Wright , Daniel Spielman

Although adaptive optimization algorithms have been successful in many applications, there are still some mysteries in terms of convergence analysis that have not been unraveled. This paper provides a novel non-convex analysis of adaptive…

Optimization and Control · Mathematics 2025-04-08 Zhishuai Guo , Yi Xu , Wotao Yin , Rong Jin , Tianbao Yang

High order cumulant tensors carry information about statistics of non-normally distributed multivariate data. In this work we present a new efficient algorithm for calculation of cumulants of arbitrary order in a sliding window for data…

Data Structures and Algorithms · Computer Science 2022-10-06 Krzysztof Domino , Piotr Gawron

The Alternating Direction Method of Multipliers (ADMM) has been studied for years. The traditional ADMM algorithm needs to compute, at each iteration, an (empirical) expected loss function on all training examples, resulting in a…

Machine Learning · Statistics 2014-06-10 Peilin Zhao , Jinwei Yang , Tong Zhang , Ping Li

We present a new adaptive algorithm for learning discrete distributions under distribution drift. In this setting, we observe a sequence of independent samples from a discrete distribution that is changing over time, and the goal is to…

Machine Learning · Computer Science 2024-03-11 Alessio Mazzetto

We present a novel sequential Monte Carlo approach to online smoothing of additive functionals in a very general class of path-space models. Hitherto, the solutions proposed in the literature suffer from either long-term numerical…

Computation · Statistics 2022-10-24 Alessandro Mastrototaro , Jimmy Olsson , Johan Alenlöv

We consider the consensual distributed optimization problem and propose an asynchronous version of the Alternating Direction Method of Multipliers (ADMM) algorithm to solve it. The `asynchronous' part here refers to the fact that only one…

Optimization and Control · Mathematics 2022-04-01 Suhail M. Shah , Konstantin E. Avrachenkov

We propose an adaptive smoothing algorithm based on Nesterov's smoothing technique in \cite{Nesterov2005c} for solving "fully" nonsmooth composite convex optimization problems. Our method combines both Nesterov's accelerated proximal…

Optimization and Control · Mathematics 2016-07-05 Quoc Tran-Dinh

In this work, we develop an adaptive, multivariate partitioning algorithm for solving mixed-integer nonlinear programs (MINLP) with multi-linear terms to global optimality. This iterative algorithm primarily exploits the advantages of…

Optimization and Control · Mathematics 2019-02-05 Harsha Nagarajan , Mowen Lu , Site Wang , Russell Bent , Kaarthik Sundar

Parallel trajectory optimization via the Alternating Direction Method of Multipliers (ADMM) has emerged as a scalable approach to long-horizon motion planning. However, existing frameworks typically decompose the problem into parallel…

Robotics · Computer Science 2026-04-27 Jiajun Yu , Guodong Liu , Li Wang , Pengxiang Zhou , Wentao Liu , Yin He , Chao Xu , Fei Gao , Yanjun Cao

We propose a new family of adaptive first-order methods for a class of convex minimization problems that may fail to be Lipschitz continuous or smooth in the standard sense. Specifically, motivated by a recent flurry of activity on…

Optimization and Control · Mathematics 2021-07-19 Kimon Antonakopoulos , Panayotis Mertikopoulos

Online machine learning systems need to adapt to domain shifts. Meanwhile, acquiring label at every timestep is expensive. We propose a surprisingly simple algorithm that adaptively balances its regret and its number of label queries in…

Machine Learning · Computer Science 2021-03-01 Yining Chen , Haipeng Luo , Tengyu Ma , Chicheng Zhang

The Adaptive Smoothing Method (ASM) is a data-driven approach for traffic state estimation. It interpolates unobserved traffic quantities by smoothing measurements along spatio-temporal directions defined by characteristic traffic wave…

Optimization and Control · Mathematics 2022-12-14 Chuhan Yang , Bilal Thonnam Thodi , Saif Eddin Jabari

Consider a set of networked agents endowed with private cost functions and seeking to find a consensus on the minimizer of the aggregate cost. A new class of random asynchronous distributed optimization methods is introduced. The methods…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-03-13 Franck Iutzeler , Pascal Bianchi , Philippe Ciblat , Walid Hachem

Many important problems in discrete optimization require maximization of a monotonic submodular function subject to matroid constraints. For these problems, a simple greedy algorithm is guaranteed to obtain near-optimal solutions. In this…

Data Structures and Algorithms · Computer Science 2015-03-17 Daniel Golovin , Andreas Krause

We introduce a natural online allocation problem that connects several of the most fundamental problems in online optimization. Let $M$ be an $n$-point metric space. Consider a resource that can be allocated in arbitrary fractions to the…

Data Structures and Algorithms · Computer Science 2021-12-01 Nikhil Bansal , Christian Coester

This paper considers the quickest search problem to identify anomalies among large numbers of data streams. These streams can model, for example, disjoint regions monitored by a mobile robot. A particular challenge is a version of the…

Optimization and Control · Mathematics 2023-03-20 Matthew Ubl , Benjamin D. Robinson , Matthew T. Hale

Much of the copious literature on the subject of sorting has concentrated on minimizing the number of comparisons and/or exchanges/copies. However, a more appropriate yardstick for the performance of sorting algorithms is based on the total…

Data Structures and Algorithms · Computer Science 2020-12-03 R. C. Hillyard , Yunlu Liaozheng , Sai Vineeth K. R