English
Related papers

Related papers: PRISM: Structured Optimization via Anisotropic Spe…

200 papers

Reduced order modeling (ROM) is a field of techniques that approximates complex physics-based models of real-world processes by inexpensive surrogates that capture important dynamical characteristics with a smaller number of degrees of…

Machine Learning · Computer Science 2021-08-30 Rachel Cooper , Andrey A. Popov , Adrian Sandu

Neural fields are a highly effective representation across visual computing. This work observes that fitting these fields is greatly improved by incorporating spatial stochasticity during training, and that this simple technique can replace…

Graphics · Computer Science 2025-05-28 Selena Ling , Merlin Nimier-David , Alec Jacobson , Nicholas Sharp

Spectral behaviors have been widely discussed in machine learning, yet the optimizer's own spectral bias remains unclear. We argue that first-order optimizers exhibit an intrinsic frequency preference that significantly reshapes the…

Machine Learning · Computer Science 2025-09-08 Gongyue Zhang , Honghai Liu

A general, variational approach to derive low-order reduced systems is presented. The approach is based on the concept of optimal parameterizing manifold (OPM) that substitutes the more classical notions of invariant or slow manifold when…

Dynamical Systems · Mathematics 2023-09-18 Mickaël D. Chekroun , Honghu Liu , James C. McWilliams

We consider the problem of detecting change-points in univariate time series by fitting a continuous piecewise linear signal using the residual sum of squares. Values of the inferred signal at slope breaks are restricted to a finite set of…

Computation · Statistics 2022-04-08 Vincent Runge , Marco Pascucci , Nicolas Deschamps de Boishebert

Recent advances in Scientific Machine Learning have shown that second-order methods can enhance the training of Physics-Informed Neural Networks (PINNs), making them a suitable alternative to traditional numerical methods for Partial…

Machine Learning · Computer Science 2025-10-27 Andrea Bonfanti , Ismael Medina , Roman List , Björn Staeves , Roberto Santana , Marco Ellero

Foundational models such as the Segment Anything Model (SAM) are gaining traction in medical imaging segmentation, supporting multiple downstream tasks. However, such models are supervised in nature, still relying on large annotated…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Aishik Konwer , Zhijian Yang , Erhan Bas , Cao Xiao , Prateek Prasanna , Parminder Bhatia , Taha Kass-Hout

Efficient topology optimization based on the adaptive auxiliary reduced model reanalysis (AARMR) is proposed to improve computational efficiency and scale. In this method, a projection auxiliary reduced model (PARM) is integrated into the…

Computational Engineering, Finance, and Science · Computer Science 2023-01-04 Jichao Yin , Hu Wang , Shuhao Li , Daozhen Guo

Reconfigurable intelligent surfaces (RISs) are an emerging technology for improving spectral efficiency and reducing power consumption in future wireless systems. This paper investigates the joint design of the transmit precoding matrices…

Optimization and Control · Mathematics 2025-07-22 Shumin Wang , Hajar El Hassani , Marco Di Renzo , Marios Poulakis

We provide a novel computer-assisted technique for systematically analyzing first-order methods for optimization. In contrast with previous works, the approach is particularly suited for handling sublinear convergence rates and stochastic…

Optimization and Control · Mathematics 2021-12-22 Adrien Taylor , Francis Bach

We evaluate the advantages of performing cross-phase modulation (XPM) on a very-far-off-resonance atomic system. We consider a ladder system with a weak (few-photon level) control coherent field imparting a conditional nonlinear phase shift…

Quantum Physics · Physics 2016-10-26 Julián Martínez-Rincón , John C. Howell

We propose a new family of adaptive first-order methods for a class of convex minimization problems that may fail to be Lipschitz continuous or smooth in the standard sense. Specifically, motivated by a recent flurry of activity on…

Optimization and Control · Mathematics 2021-07-19 Kimon Antonakopoulos , Panayotis Mertikopoulos

Particle-based shape modeling (PSM) is a family of approaches that automatically quantifies shape variability across anatomical cohorts by positioning particles (pseudo landmarks) on shape surfaces in a consistent configuration. Recent…

Computer Vision and Pattern Recognition · Computer Science 2025-07-11 Hong Xu , Shireen Y. Elhabian

This paper proposes a computational framework for the design optimization of stable structures under large deformations by incorporating nonlinear buckling constraints. A novel strategy for suppressing spurious buckling modes related to…

Computational Engineering, Finance, and Science · Computer Science 2023-06-07 Guodong Zhang , Kapil Khandelwal , Tong Guo

Ising machines are emerging as a powerful physical alternative to digital processors for solving combinatorial optimization problems. Among them, spatial photonic Ising machines (SPIMs) offer compact, room-temperature hardware with…

Learning models that are robust to distribution shifts is a key concern in the context of their real-life applicability. Invariant Risk Minimization (IRM) is a popular framework that aims to learn robust models from multiple environments.…

Machine Learning · Computer Science 2023-04-04 Moulik Choraria , Ibtihal Ferwana , Ankur Mani , Lav R. Varshney

Primal-Dual Hybrid Gradient (PDHG) and Alternating Direction Method of Multipliers (ADMM) are two widely-used first-order optimization methods. They reduce a difficult problem to simple subproblems, so they are easy to implement and have…

Optimization and Control · Mathematics 2019-09-10 Yanli Liu , Yunbei Xu , Wotao Yin

Although recent masked image modeling (MIM)-based HSI-LiDAR/SAR classification methods have gradually recognized the importance of the spectral information, they have not adequately addressed the redundancy among different spectra,…

Image and Video Processing · Electrical Eng. & Systems 2024-06-04 Junyan Lin , Xuepeng Jin , Feng Gao , Junyu Dong , Hui Yu

This paper proposes a rank inspired neural network (RINN) to tackle the initialization sensitivity issue of physics informed extreme learning machines (PIELM) when numerically solving partial differential equations (PDEs). Unlike PIELM…

Numerical Analysis · Mathematics 2025-06-24 Wentao Peng , Yunqing Huang , Nianyu Yi

Mapping is one of the crucial tasks enabling autonomous navigation of a mobile robot. Conventional mapping methods output a dense geometric map representation, e.g. an occupancy grid, which is not trivial to keep consistent for prolonged…

Robotics · Computer Science 2025-02-10 Kirill Muravyev , Alexander Melekhin , Dmitry Yudin , Konstantin Yakovlev