English
Related papers

Related papers: Direction Selection in Stochastic Directional Dist…

200 papers

In this paper we focus on the linear functionals defining an approximate version of the gradient of a function. These functionals are often used when dealing with optimization problems where the computation of the gradient of the objective…

Optimization and Control · Mathematics 2021-05-21 Marco Boresta , Tommaso Colombo , Alberto De Santis , Stefano Lucidi

Stochastic-gradient sampling methods are often used to perform Bayesian inference on neural networks. It has been observed that the methods in which notions of differential geometry are included tend to have better performances, with the…

Machine Learning · Computer Science 2024-04-02 Hanlin Yu , Marcelo Hartmann , Bernardo Williams , Arto Klami

Discriminatively learned correlation filters (DCF) have been widely used in online visual tracking filed due to its simplicity and efficiency. These methods utilize a periodic assumption of the training samples to construct a circulant data…

Computer Vision and Pattern Recognition · Computer Science 2017-06-02 Xiaoxiang Hu , Yujiu Yang

When the nonconvex problem is complicated by stochasticity, the sample complexity of stochastic first-order methods may depend linearly on the problem dimension, which is undesirable for large-scale problems. To alleviate this linear…

Optimization and Control · Mathematics 2025-09-30 Yue Xie , Jiawen Bi , Hongcheng Liu

This paper proposes a new sampling-based kinodynamic motion planning algorithm, called FMT*PFF, for nonlinear systems. It exploits the novel idea of dimensionality reduction using partial-final-state-free (PFF) optimal controllers.With the…

Robotics · Computer Science 2023-06-06 Dongliang Zheng , Panagiotis Tsiotras

Large spatiotemporal demand datasets can prove intractable for location optimization problems, motivating the need to aggregate such data. However, demand aggregation introduces error which impacts the results of the location study. We…

Applications · Statistics 2019-10-14 Zachary T. Hornberger , Bruce A. Cox , Raymond R. Hill

We study a diagnostic strategy which is based on the anticipation of the diagnostic process by simulation of the dynamical process starting from the initial findings. We show that such a strategy could result in more accurate diagnoses…

Biological Physics · Physics 2018-04-04 Alireza Mashaghi , Abolfazl Ramezanpour

Optimizing 3D k-space sampling trajectories for efficient MRI is important yet challenging. This work proposes a generalized framework for optimizing 3D non-Cartesian sampling patterns via data-driven optimization. We built a differentiable…

Signal Processing · Electrical Eng. & Systems 2022-09-23 Guanhua Wang , Jon-Fredrik Nielsen , Jeffrey A. Fessler , Douglas C. Noll

In the field of computer vision, the numerical encoding of 3D surfaces is crucial. It is classical to represent surfaces with their Signed Distance Functions (SDFs) or Unsigned Distance Functions (UDFs). For tasks like representation…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Virgile Foy , Fabrice Gamboa , Reda Chhaibi

We develop a generalized control function approach to production function estimation. Our approach accommodates settings in which productivity evolves jointly with other unobservable factors such as latent demand shocks and the…

Econometrics · Economics 2025-12-10 Ulrich Doraszelski , Lixiong Li

In this work, we present the convergence analysis of one-point large deviations rate functions (LDRFs) of the spatial finite difference method (FDM) for stochastic wave equations with small noise, which is essentially about the asymptotical…

Numerical Analysis · Mathematics 2022-09-20 Diancong Jin , Jialin Hong , Derui Sheng

Despite its impressive theory \& practical performance, Frequent Directions (\acrshort{fd}) has not been widely adopted for large-scale regression tasks. Prior work has shown randomized sketches (i) perform worse in estimating the…

Machine Learning · Computer Science 2020-11-10 Charlie Dickens

We consider a class of stochastic optimal control problems for discrete-time stochastic linear systems which seek for control policies that will steer the probability distribution of the terminal state of the system close to a desired…

Optimization and Control · Mathematics 2020-10-01 Isin M. Balci , Efstathios Bakolas

A widely used heuristic for solving stochastic optimization problems is to use a deterministic rolling horizon procedure, which has been modified to handle uncertainty (e.g. buffer stocks, schedule slack). This approach has been criticized…

Optimization and Control · Mathematics 2017-03-16 Raymond T. Perkins , Warren B. Powell

In this paper, we consider the general non-oblivious stochastic optimization where the underlying stochasticity may change during the optimization procedure and depends on the point at which the function is evaluated. We develop Stochastic…

Optimization and Control · Mathematics 2020-09-10 Hamed Hassani , Amin Karbasi , Aryan Mokhtari , Zebang Shen

In some real world applications, such as spectrometry, functional models achieve better predictive performances if they work on the derivatives of order m of their inputs rather than on the original functions. As a consequence, the use of…

Statistics Theory · Mathematics 2011-05-04 Fabrice Rossi , Nathalie Villa-Vialaneix

In this report, we study decentralized stochastic optimization to minimize a sum of smooth and strongly convex cost functions when the functions are distributed over a directed network of nodes. In contrast to the existing work, we use…

Machine Learning · Computer Science 2020-07-24 Muhammad I. Qureshi , Ran Xin , Soummya Kar , Usman A. Khan

Assessing the practical identifiability of epidemic models is essential for determining whether parameters can be meaningfully estimated from observed data. Monte Carlo (MC) methods provide an accessible and intuitive framework; however,…

Methodology · Statistics 2025-10-01 Chiara Mattamira , Olivia Prosper Feldman

Stochastic collocation methods for approximating the solution of partial differential equations with random input data (e.g., coefficients and forcing terms) suffer from the curse of dimensionality whereby increases in the stochastic…

Numerical Analysis · Mathematics 2014-05-23 Aretha L. Teckentrup , Peter Jantsch , Clayton G. Webster , Max Gunzburger

Optimal control is an essential tool for stabilizing complex nonlinear systems. However, despite the extensive impacts of methods such as receding horizon control, dynamic programming and reinforcement learning, the design of cost functions…

Systems and Control · Electrical Eng. & Systems 2022-11-21 Tyler Westenbroek , Anand Siththaranjan , Mohsin Sarwari , Claire J. Tomlin , Shankar S. Sastry