English
Related papers

Related papers: Stochastic Optimization of 3D Non-Cartesian Sampli…

200 papers

While popular optimization methods such as SGD, AdamW, and Lion depend on steepest descent updates in either $\ell_2$ or $\ell_\infty$ norms, there remains a critical gap in handling the non-Euclidean structure observed in modern deep…

Machine Learning · Computer Science 2025-06-11 Xinyu Luo , Cedar Site Bai , Bolian Li , Petros Drineas , Ruqi Zhang , Brian Bullins

In non-linear estimations, it is common to assess sampling uncertainty by bootstrap inference. For complex models, this can be computationally intensive. This paper combines optimization with resampling: turning stochastic optimization into…

Econometrics · Economics 2022-05-09 Jean-Jacques Forneron

Neural networks are trained by optimizing multi-dimensional sets of fitting parameters on non-convex loss landscapes. Low-loss regions of the landscapes correspond to the parameter sets that perform well on the training data. A key issue in…

Machine Learning · Computer Science 2026-02-26 Jianneng Yu , Alexandre V. Morozov

Many machine learning models, such as logistic regression~(LR) and support vector machine~(SVM), can be formulated as composite optimization problems. Recently, many distributed stochastic optimization~(DSO) methods have been proposed to…

Machine Learning · Statistics 2016-12-13 Shen-Yi Zhao , Ru Xiang , Ying-Hao Shi , Peng Gao , Wu-Jun Li

Optimal experimental design (OED) seeks experiments expected to yield the most useful data for some purpose. In practical circumstances where experiments are time-consuming or resource-intensive, OED can yield enormous savings. We pursue…

Computation · Statistics 2014-12-30 Xun Huan , Youssef M. Marzouk

Planning safe paths is a major building block in robot autonomy. It has been an active field of research for several decades, with a plethora of planning methods. Planners can be generally categorised as either trajectory optimisers or…

Robotics · Computer Science 2017-05-18 Gilad Francis , Lionel Ott , Fabio Ramos

Sampling-based model predictive control methods like MPPI and CEM are essential for real-time control of nonlinear robotic systems, particularly where discontinuous dynamics preclude gradient-based optimization. However, these methods…

Robotics · Computer Science 2026-05-05 Vincent Pacelli , Akash Ratheesh , Evangelos A. Theodorou

As deep learning applications continue to deploy increasingly large artificial neural networks, the associated high energy demands are creating a need for alternative neuromorphic approaches. Optics and photonics are particularly compelling…

Optics · Physics 2025-08-19 Nicola Dal Cin , Florian Marquardt , Clara C. Wanjura

Magnetic Resonance Imaging (MRI) has long been considered to be among the gold standards of today's diagnostic imaging. The most significant drawback of MRI is long acquisition times, prohibiting its use in standard practice for some…

Image and Video Processing · Electrical Eng. & Systems 2020-08-12 Jonathan Alush-Aben , Linor Ackerman-Schraier , Tomer Weiss , Sanketh Vedula , Ortal Senouf , Alex Bronstein

Multi-contrast Magnetic Resonance Imaging (MRI) acquisitions from a single scan have tremendous potential to streamline exams and reduce imaging time. However, maintaining clinically feasible scan time necessitates significant…

Image and Video Processing · Electrical Eng. & Systems 2021-03-09 Ke Wang , Enhao Gong , Yuxin Zhang , Suchadrima Banerjee , Greg Zaharchuk , John Pauly

In this paper, we present a novel reinforcement learning framework designed to optimize molecular dynamics by focusing on the entire trajectory rather than just the final molecular configuration. Leveraging a stochastic version of…

Optimization and Control · Mathematics 2024-10-22 Chandrajit Bajaj , Minh Nguyen , Conrad Li

With the pervasiveness of Stochastic Shortest-Path (SSP) problems in high-risk industries, such as last-mile autonomous delivery and supply chain management, robust planning algorithms are crucial for ensuring successful task completion…

Artificial Intelligence · Computer Science 2024-08-19 Clinton Enwerem , Erfaun Noorani , John S. Baras , Brian M. Sadler

This work introduces a stochastic hierarchical optimization framework inspired by Sloppy Model theory for the efficient calibration of physical models. Central to this method is the use of a reduced Hessian approximation, which identifies…

Machine Learning · Computer Science 2026-02-06 José Afonso , Vasco Guerra , Pedro Viegas

High-dimensional nonlinear systems pose considerable challenges for modeling and control across many domains, from fluid mechanics to advanced robotics. Such systems are typically approximated with reduced-order models, which often rely on…

Systems and Control · Electrical Eng. & Systems 2025-09-05 Hugo Buurmeijer , Luis A. Pabon , John Irvin Alora , Roshan S. Kaundinya , George Haller , Marco Pavone

Contact-rich manipulation is challenging due to its high dimensionality, the requirement for long time horizons, and the presence of hybrid contact dynamics. Sampling-based methods have become a popular approach for this class of problems,…

Robotics · Computer Science 2026-05-01 Zhongqi Wei , Frederike Dümbgen

In this paper we consider the problem of minimizing composite objective functions consisting of a convex differentiable loss function plus a non-smooth regularization term, such as $L_1$ norm or nuclear norm, under R\'enyi differential…

Machine Learning · Computer Science 2019-09-26 Chen Chen , Jaewoo Lee

In this paper, we propose a trajectory optimization for computing smooth collision free trajectories for nonholonomic curvature bounded vehicles among static and dynamic obstacles. One of the key novelties of our formulation is a hierarchal…

This paper considers stochastic optimization problems for a large class of objective functions, including convex and continuous submodular. Stochastic proximal gradient methods have been widely used to solve such problems; however, their…

Optimization and Control · Mathematics 2018-11-13 Aryan Mokhtari , Hamed Hassani , Amin Karbasi

Dense random sampling and surfacing of shapes encoded via implicit occupancy functions (OFs) are critical elements of many applications. Existing methods largely provide either one or the other of random sampling or mesh surfaces: ray…

Graphics · Computer Science 2026-05-06 Suzuran Takikawa , Leo Foord-Kelcey , Oliver Oxford , Nicholas Vining , Alla Sheffer

Magnetic resonance imaging (MRI) is a powerful medical imaging modality, but long acquisition times limit throughput, patient comfort, and clinical accessibility. Diffusion-based generative models serve as strong image priors for reducing…

Machine Learning · Computer Science 2026-02-13 Sriram Ravula , Brett Levac , Yamin Arefeen , Ajil Jalal , Alexandros G. Dimakis , Jonathan I. Tamir