English
Related papers

Related papers: Batched Second-Order Adjoint Sensitivity for Reduc…

200 papers

We present an object-oriented programming (OOP) CUDA-based package for fast and accurate simulation of second-harmonic generation (SHG) efficiency using focused Gaussian beams. The model includes linear as well as two-photon absorption that…

Optics · Physics 2024-10-08 A. D. Sanchez , S. Chaitanya Kumar , M. Ebrahim-Zadeh

This paper proposes an arc-search interior-point algorithm for the nonlinear constrained optimization problem. The proposed algorithm uses the second-order derivatives to construct a search arc that approaches the optimizer. Because the arc…

Optimization and Control · Mathematics 2025-06-13 Yaguang Yang

The homogeneous second-order descent method (Zhang et al. 2025, Mathematics of Operations Research) was initially proposed for unconstrained optimisation problems. HSODM shows excellent performance with respect to the global complexity rate…

Optimization and Control · Mathematics 2026-04-08 Yonggang Pei , Yubing Lin , Mauricio Silva Louzeiro , Detong Zhu

The ability of Gaussian processes (GPs) to predict the behavior of dynamical systems as a more sample-efficient alternative to parametric models seems promising for real-world robotics research. However, the computational complexity of GPs…

Robotics · Computer Science 2022-03-01 Abdolreza Taheri , Joni Pajarinen , Reza Ghabcheloo

The global 21-cm signal provides a powerful probe of early-Universe astrophysics, but its detection is hindered by Galactic foregrounds that are orders of magnitude brighter than the signal and distortions introduced by beam chromaticity.…

Instrumentation and Methods for Astrophysics · Physics 2026-03-16 Jacob L. Tutt , Peter H. Sims , Joe H. N. Pattison , Dominic J. Anstey , Samuel A. K. Leeney , Eloy de Lera Acedo

The availability of large volumes of remote sensing data insists on higher degree of automation in feature extraction, making it a need of the hour.The huge quantum of data that needs to be processed entails accelerated processing to be…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-04-16 K. Phani Tejaswi , D. Shanmukha Rao , Thara Nair , A. V. V. Prasad

Differentially private (stochastic) gradient descent is the workhorse of DP private machine learning in both the convex and non-convex settings. Without privacy constraints, second-order methods, like Newton's method, converge faster than…

Machine Learning · Computer Science 2023-05-23 Arun Ganesh , Mahdi Haghifam , Thomas Steinke , Abhradeep Thakurta

3D Gaussian Splatting (3DGS) has recently gained significant attention for high-quality and efficient view synthesis, making it widely adopted in fields such as AR/VR, robotics, and autonomous driving. Despite its impressive algorithmic…

This work introduces the nested-set Hessian approximation, a second-order approximation method that can be used in any derivative-free optimization routine that requires such information. It is built on the foundation of the generalized…

Optimization and Control · Mathematics 2020-11-06 Warren Hare , Gabriel Jarry-Bolduc , Chayne Planiden

We develop adaptive replicated designs for Gaussian process metamodels of stochastic experiments. Adaptive batching is a natural extension of sequential design heuristics with the benefit of replication growing as response features are…

Machine Learning · Statistics 2021-07-14 Xiong Lyu , Mike Ludkovski

Zeroth-order optimization addresses problems where gradient information is inaccessible or impractical to compute. While most existing methods rely on first-order approximations, incorporating second-order (curvature) information can, in…

Machine Learning · Computer Science 2025-07-09 Dongyoon Kim , Sungjae Lee , Wonjin Lee , Kwang In Kim

3D Gaussian Splatting (3DGS) has emerged as a mainstream solution for novel view synthesis and 3D reconstruction. By explicitly encoding a 3D scene using a collection of Gaussian kernels, 3DGS achieves high-quality rendering with superior…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Lei Lan , Tianjia Shao , Zixuan Lu , Yu Zhang , Chenfanfu Jiang , Yin Yang

In recent years, GPU-accelerated optimization solvers based on second-order methods (e.g., interior-point methods) have gained momentum with the advent of mature and efficient GPU-accelerated direct sparse linear solvers, such as cuDSS.…

Optimization and Control · Mathematics 2025-11-25 Alexis Montoison , François Pacaud , Sungho Shin , Mihai Anitescu

In this contribution we develop an efficient reduced order model for solving parametrized linear-quadratic optimal control problems with linear time-varying state system. The fully reduced model combines reduced basis approximations of the…

Numerical Analysis · Mathematics 2024-08-29 Hendrik Kleikamp , Lukas Renelt

We propose a new randomized optimization method for high-dimensional problems which can be seen as a generalization of coordinate descent to random subspaces. We show that an adaptive sampling strategy for the random subspace significantly…

Optimization and Control · Mathematics 2019-12-19 Jonathan Lacotte , Mert Pilanci , Marco Pavone

Block-tridiagonal systems are prevalent in state estimation and optimal control, and solving these systems is often the computational bottleneck. Improving the underlying solvers therefore has a direct impact on the real-time performance of…

Mathematical Software · Computer Science 2025-12-05 David Jin , Alexis Montoison , Sungho Shin

This paper introduces a framework for solving alternating current optimal power flow (ACOPF) problems using graphics processing units (GPUs). While GPUs have demonstrated remarkable performance in various computing domains, their…

Optimization and Control · Mathematics 2026-05-11 Sungho Shin , François Pacaud , Mihai Anitescu

Motivated by recent advances in serverless cloud computing, in particular the "function as a service" (FaaS) model, we consider the problem of minimizing a convex function in a massively parallel fashion, where communication between workers…

Optimization and Control · Mathematics 2024-10-03 Elad Romanov , Fangzhao Zhang , Mert Pilanci

Existing customization methods require access to multiple reference examples to align pre-trained diffusion probabilistic models (DPMs) with user-provided concepts. This paper aims to address the challenge of DPM customization when the only…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Jiachun Pan , Jun Hao Liew , Vincent Y. F. Tan , Jiashi Feng , Hanshu Yan

Second derivatives of mathematical models for real-world phenomena are fundamental ingredients of a wide range of numerical simulation methods including parameter sensitivity analysis, uncertainty quantification, nonlinear optimization and…

Mathematical Software · Computer Science 2021-10-27 Uwe Naumann , Shubhaditya Burela