English
Related papers

Related papers: Accelerate Neural Subspace-Based Reduced-Order Sol…

200 papers

We propose a non-intrusive Deep Learning-based Reduced Order Model (DL-ROM) capable of capturing the complex dynamics of mechanical systems showing inertia and geometric nonlinearities. In the first phase, a limited number of high fidelity…

Numerical Analysis · Mathematics 2021-11-25 Stefania Fresca , Giorgio Gobat , Patrick Fedeli , Attilio Frangi , Andrea Manzoni

Randomized-subspace methods reduce the cost of first-order optimization by using only low-dimensional projected-gradient information, a feature that is attractive in forward-mode automatic differentiation and communication-limited settings.…

Optimization and Control · Mathematics 2026-05-04 Gaku Omiya , Pierre-Louis Poirion , Akiko Takeda

We propose a self-supervised approach for learning physics-based subspaces for real-time simulation. Existing learning-based methods construct subspaces by approximating pre-defined simulation data in a purely geometric way. However, this…

Machine Learning · Computer Science 2024-04-30 Jiahong Wang , Yinwei Du , Stelian Coros , Bernhard Thomaszewski

This paper provides a new avenue for exploiting deep neural networks to improve physics-based simulation. Specifically, we integrate the classic Lagrangian mechanics with a deep autoencoder to accelerate elastic simulation of deformable…

Machine Learning · Computer Science 2021-02-23 Siyuan Shen , Yang Yin , Tianjia Shao , He Wang , Chenfanfu Jiang , Lei Lan , Kun Zhou

Discrete optimization belongs to the set of $\mathcal{NP}$-hard problems, spanning fields such as mixed-integer programming and combinatorial optimization. A current standard approach to solving convex discrete optimization problems is the…

Machine Learning · Computer Science 2024-02-28 Kyle Mana , Fernando Acero , Stephen Mak , Parisa Zehtabi , Michael Cashmore , Daniele Magazzeni , Manuela Veloso

Simulators based on neural networks offer a path to orders-of-magnitude faster electromagnetic wave simulations. Existing models, however, only address narrowly tailored classes of problems and only scale to systems of a few dozen degrees…

Optics · Physics 2024-04-02 Charles Dove , Jatearoon Boondicharern , Laura Waller

We propose a general scheme for solving convex and non-convex optimization problems on manifolds. The central idea is that, by adding a multiple of the squared retraction distance to the objective function in question, we "convexify" the…

Computation · Statistics 2020-10-20 Lizhen Lin , Bayan Saparbayeva , Michael Minyi Zhang , David B. Dunson

Learned denoisers play a fundamental role in various signal generation (e.g., diffusion models) and reconstruction (e.g., compressed sensing) architectures, whose success derives from their ability to leverage low-dimensional structure in…

Machine Learning · Computer Science 2025-08-14 Shiyu Wang , Mariam Avagyan , Yihan Shen , Arnaud Lamy , Tingran Wang , Szabolcs Márka , Zsuzsa Márka , John Wright

We develop multi-step gradient methods for network-constrained optimization of strongly convex functions with Lipschitz-continuous gradients. Given the topology of the underlying network and bounds on the Hessian of the objective function,…

Optimization and Control · Mathematics 2015-06-12 Euhanna Ghadimi , Iman Shames , Mikael Johansson

Many high-dimensional optimisation problems exhibit rich geometric structures in their set of minimisers, often forming smooth manifolds due to over-parametrisation or symmetries. When this structure is known, at least locally, it can be…

Optimization and Control · Mathematics 2025-10-27 Evan Markou , Thalaiyasingam Ajanthan , Stephen Gould

Planning collision-free motions for robots with many degrees of freedom is challenging in environments with complex obstacle geometries. Recent work introduced the idea of speeding up the planning by encoding prior experience of successful…

Robotics · Computer Science 2024-05-28 Johannes Tenhumberg , Darius Burschka , Berthold Bäuml

Neural fields have revolutionized the area of 3D reconstruction and novel view synthesis of rigid scenes. A key challenge in making such methods applicable to articulated objects, such as the human body, is to model the deformation of 3D…

Computer Vision and Pattern Recognition · Computer Science 2022-12-02 Xu Chen , Tianjian Jiang , Jie Song , Max Rietmann , Andreas Geiger , Michael J. Black , Otmar Hilliges

Algorithms proposed for solving high-dimensional optimization problems with no derivative information frequently encounter the "curse of dimensionality," becoming ineffective as the dimension of the parameter space grows. One feature of a…

Optimization and Control · Mathematics 2020-04-28 Dmitry Pozharskiy , Noah J. Wichrowski , Andrew B. Duncan , Grigorios A. Pavliotis , Ioannis G. Kevrekidis

This work is on constrained large-scale non-convex optimization where the constraint set implies a manifold structure. Solving such problems is important in a multitude of fundamental machine learning tasks. Recent advances on Riemannian…

Machine Learning · Computer Science 2023-02-23 Yian Deng , Tingting Mu

We propose a reduced-space elasto-dynamic solver that is well suited for augmenting rigged character animations with secondary motion. At the core of our method is a novel deformation subspace based on Linear Blend Skinning that overcomes…

We introduce a new method for speeding up the inference of deep neural networks. It is somewhat inspired by the reduced-order modeling techniques for dynamical systems.The cornerstone of the proposed method is the maximum volume algorithm.…

Machine Learning · Computer Science 2020-11-26 Julia Gusak , Talgat Daulbaev , Evgeny Ponomarev , Andrzej Cichocki , Ivan Oseledets

Neural ordinary differential equations (NODE) have garnered significant attention for their design of continuous-depth neural networks and the ability to learn data/feature dynamics. However, for high-dimensional systems, estimating…

Machine Learning · Computer Science 2025-10-07 Muhao Guo , Haoran Li , Yang Weng

Micromagnetics has made significant strides, particularly due to its wide-ranging applications in magnetic storage design. Numerical simulation is a cornerstone of micromagnetics research, relying on first-principle rules to compute the…

Machine Learning · Computer Science 2024-10-22 Yunqi Cai , Jiangnan Li , Dong Wang

Composite convex optimization models arise in several applications, and are especially prevalent in inverse problems with a sparsity inducing norm and in general convex optimization with simple constraints. The most widely used algorithms…

Optimization and Control · Mathematics 2016-07-15 Vahan Hovhannisyan , Panos Parpas , Stefanos Zafeiriou

We initiate the study of nonsmooth optimization problems under bounded local subgradient variation, which postulates bounded difference between (sub)gradients in small local regions around points, in either average or maximum sense. The…

Optimization and Control · Mathematics 2024-11-05 Jelena Diakonikolas , Cristóbal Guzmán