English
Related papers

Related papers: Geometric Guidance for Globally Synchronized Deplo…

200 papers

One of the most common methods to train machine learning algorithms today is the stochastic gradient descent (SGD). In a distributed setting, SGD-based algorithms have been shown to converge theoretically under specific circumstances. A…

Machine Learning · Computer Science 2025-08-22 Soumya Sarkar , Shweta Jain

Machine learning has been progressively generalised to operate within non-Euclidean domains, but geometrically accurate methods for learning on surfaces are still falling behind. The lack of closed-form Riemannian operators, the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Hippolyte Verninas , Caner Korkmaz , Stefanos Zafeiriou , Tolga Birdal , Simone Foti

Decentralized optimization has become vital for leveraging distributed data without central control, enhancing scalability and privacy. However, practical deployments face fundamental challenges due to heterogeneous computation speeds and…

Machine Learning · Computer Science 2025-05-16 Yijie Zhou , Shi Pu

Ergodic exploration has spawned a lot of interest in mobile robotics due to its ability to design time trajectories that match desired spatial coverage statistics. However, current ergodic approaches are for continuous spaces, which require…

Robotics · Computer Science 2025-09-30 Benjamin Wong , Ryan H. Lee , Tyler M. Paine , Santosh Devasia , Ashis G. Banerjee

We present a novel approach for the reconstruction of dynamic geometric shapes using a single hand-held consumer-grade RGB-D sensor at real-time rates. Our method does not require a pre-defined shape template to start with and builds up the…

Computer Vision and Pattern Recognition · Computer Science 2016-08-02 Matthias Innmann , Michael Zollhöfer , Matthias Nießner , Christian Theobalt , Marc Stamminger

This paper studies decentralized stochastic nonconvex optimization problem over row-stochastic networks. We consider the heavy-tailed gradient noise which is empirically observed in many popular real-world applications. Specifically, we…

Optimization and Control · Mathematics 2026-01-19 Menglian Wang , Zhuanghua Liu , Luo Luo

3D Gaussian Splatting (3DGS) has made significant strides in scene representation and neural rendering, with intense efforts focused on adapting it for dynamic scenes. Despite delivering remarkable rendering quality and speed, existing…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Sangwoon Kwak , Joonsoo Kim , Jun Young Jeong , Won-Sik Cheong , Jihyong Oh , Munchurl Kim

Stochastic convex optimization algorithms are the most popular way to train machine learning models on large-scale data. Scaling up the training process of these models is crucial, but the most popular algorithm, Stochastic Gradient Descent…

Machine Learning · Statistics 2018-10-30 Ashok Cutkosky , Robert Busa-Fekete

We generalize stochastic subgradient descent methods to situations in which we do not receive independent samples from the distribution over which we optimize, but instead receive samples that are coupled over time. We show that as long as…

Optimization and Control · Mathematics 2012-08-02 John C. Duchi , Alekh Agarwal , Mikael Johansson , Michael I. Jordan

This paper considers the problem of distributed optimization over time-varying graphs. For the case of undirected graphs, we introduce a distributed algorithm, referred to as DIGing, based on a combination of a distributed inexact gradient…

Optimization and Control · Mathematics 2017-03-21 Angelia Nedich , Alex Olshevsky , Wei Shi

We first propose a decentralized proximal stochastic gradient tracking method (DProxSGT) for nonconvex stochastic composite problems, with data heterogeneously distributed on multiple workers in a decentralized connected network. To save…

Optimization and Control · Mathematics 2023-03-01 Yonggui Yan , Jie Chen , Pin-Yu Chen , Xiaodong Cui , Songtao Lu , Yangyang Xu

We propose a general convex optimization problem for computing regularized geodesic distances. We show that under mild conditions on the regularizer the problem is well posed. We propose three different regularizers and provide analytical…

Graphics · Computer Science 2023-05-23 Michal Edelstein , Nestor Guillen , Justin Solomon , Mirela Ben-Chen

We propose a decentralised "local2global"' approach to graph representation learning, that one can a-priori use to scale any embedding technique. Our local2global approach proceeds by first dividing the input graph into overlapping…

Machine Learning · Computer Science 2022-01-14 Lucas G. S. Jeub , Giovanni Colavizza , Xiaowen Dong , Marya Bazzi , Mihai Cucuringu

We propose a space-time scheme that combines an unfitted finite element method in space with a discontinuous Galerkin time discretisation for the accurate numerical approximation of parabolic problems with moving domains or interfaces. We…

Numerical Analysis · Mathematics 2023-01-23 Santiago Badia , Hridya Dilip , Francesc Verdugo

An optimal guidance method is developed that reduces sensitivity to parameters in the dynamic model. The method combines a previously developed method for guidance and control using adaptive Legendre-Gauss-Radau (LGR) collocation and a…

Optimization and Control · Mathematics 2024-08-09 Katrina L. Winkler , Anil V. Rao

Full 3D modelling of time-domain electromagnetic data requires tremendous computational resources. Consequently, simplified physics models prevail in geophysics, using a much faster but approximate (1D) forward model. We propose to join the…

Computational Physics · Physics 2024-09-02 Wouter Deleersnyder , Evert Slob

We consider a system consisting of multiple mobile robots in which the user can at any time issue relocation tasks ordering one of the robots to move from its current location to a given destination location. In this paper, we deal with the…

Robotics · Computer Science 2015-02-02 Michal Čáp , Jiří Vokřínek , Alexander Kleiner

We introduce a new class of spatially stochastic physics and data informed deep latent models for parametric partial differential equations (PDEs) which operate through scalable variational neural processes. We achieve this by assigning…

Machine Learning · Computer Science 2023-06-08 Arnaud Vadeboncoeur , Ieva Kazlauskaite , Yanni Papandreou , Fehmi Cirak , Mark Girolami , Ömer Deniz Akyildiz

This work proposes a scheme for significantly reducing the computational complexity of discretized problems involving the non-smooth forward propagation of uncertainty by combining the adaptive hierarchical sparse grid stochastic…

Computational Physics · Physics 2015-09-07 Robert L. Gates , Maximilian R. Bittens

We consider distributed optimization under communication constraints for training deep learning models. We propose a new algorithm, whose parameter updates rely on two forces: a regular gradient step, and a corrective direction dictated by…

Machine Learning · Computer Science 2022-04-29 Yunfei Teng , Wenbo Gao , Francois Chalus , Anna Choromanska , Donald Goldfarb , Adrian Weller