English
Related papers

Related papers: Abstracted Model Reduction: A General Framework fo…

200 papers

After training complex deep learning models, a common task is to compress the model to reduce compute and storage demands. When compressing, it is desirable to preserve the original model's per-example decisions (e.g., to go beyond top-1…

Machine Learning · Computer Science 2022-10-18 Jerry Chee , Megan Renz , Anil Damle , Christopher De Sa

Complex engineering models are typically computationally demanding and defined by a high-dimensional parameter space challenging the comprehensive exploration of parameter effects and design optimization. To overcome this curse of…

Applications · Statistics 2024-03-01 Corey Arndt , Cody Crusenberry , Bozhi Heng , Rochelle Butler , Stephanie TerMaath

The paper proposes a model reduction algorithm for linear hybrid systems, i.e., hybrid systems with externally induced discrete events, with linear continuous subsystems, and linear reset maps. The model reduction algorithm is based on…

Dynamical Systems · Mathematics 2020-03-19 Ion Victor Gosea , Mihaly Petreczky , John Leth , Rafael Wisniewski , Athanasios C. Antoulas

We propose in this paper an adaptive reduced order modelling technique based on domain partitioning for parametric problems of fracture. We show that coupling domain decomposition and projection-based model order reduction permits to focus…

Classical Physics · Physics 2015-06-11 Pierre Kerfriden , Olivier Goury , Timon Rabczuk , Stephane Pierre-Alain Bordas

Computational efficiency has remained a critical consideration in scaling high-capacity language models, with inference latency and resource consumption presenting significant constraints on real-time applications. The study has introduced…

Computation and Language · Computer Science 2025-03-26 Michael Mangrum , Jonathan Pemberton , Benedict Wetherby , Philip Montague

We consider model order reduction of parameterized Hamiltonian systems describing nondissipative phenomena, like wave-type and transport dominated problems. The development of reduced basis methods for such models is challenged by two main…

Numerical Analysis · Mathematics 2021-05-27 Cecilia Pagliantini

Model-based controllers can offer strong guarantees on stability and convergence by relying on physically accurate dynamic models. However, these are rarely available for high-dimensional mechanical systems such as deformable objects or…

Robotics · Computer Science 2026-02-10 Katharina Friedl , Noémie Jaquier , Seungyeon Kim , Jens Lundell , Danica Kragic

A standard approach to reduced-order modeling of higher-order linear dynamical systems is to rewrite the system as an equivalent first-order system and then employ Krylov-subspace techniques for reduced-order modeling of first-order…

Numerical Analysis · Mathematics 2007-05-23 Roland W. Freund

Designing controllers to satisfy temporal requirements has proven to be challenging for dynamical systems that are affected by uncertainty. This is mainly due to the states evolving in a continuous uncountable space, the stochastic…

Systems and Control · Electrical Eng. & Systems 2024-07-08 Birgit C. van Huijgevoort , Ruohan Wang , Sadegh Soudjani , Sofie Haesaert

We consider the computation of resilient controllers for perturbed non-linear dynamical systems w.r.t. linear-time temporal logic specifications. We address this problem through the paradigm of Abstraction-Based Controller Design (ABCD)…

Systems and Control · Electrical Eng. & Systems 2020-08-17 Stanly Samuel , Kaushik Mallik , Anne-Kathrin Schmuck , Daniel Neider

We introduce a novel data-driven order reduction method for nonlinear control systems, drawing on recent progress in machine learning and statistical dimensionality reduction. The method rests on the assumption that the nonlinear system…

Optimization and Control · Mathematics 2011-06-15 Jake Bouvrie , Boumediene Hamzi

Large Language Models (LLMs) have achieved remarkable success across a wide spectrum of natural language processing tasks. However, their ever-growing scale introduces significant barriers to real-world deployment, including substantial…

Computation and Language · Computer Science 2026-01-07 Guangxin Wu , Hao Zhang , Zhang Zhibin , Jiafeng Guo , Xueqi Cheng

This work proposes a model-reduction approach for the material point method on nonlinear manifolds. Our technique approximates the $\textit{kinematics}$ by approximating the deformation map using an implicit neural representation that…

Machine Learning · Computer Science 2023-02-13 Peter Yichen Chen , Maurizio M. Chiaramonte , Eitan Grinspun , Kevin Carlberg

The dynamic behavior of jointed assemblies exhibiting friction nonlinearities features amplitude-dependent dissipation and stiffness. To develop numerical simulations for predictive and design purposes, macro-scale High Fidelity Models…

Computational Engineering, Finance, and Science · Computer Science 2022-04-27 Ahmed Amr Morsy , Mariella Kast , Paolo Tiso

We propose a general strategy for reduced order modeling of systems that display highly nonlinear oscillations. By considering a continuous family of forced periodic orbits defined in relation to a stable fixed point and subsequently…

Dynamical Systems · Mathematics 2023-02-07 Dan Wilson , Kai Sun

Abstraction is crucial for effective sequential decision making in domains with large state spaces. In this work, we propose an information bottleneck method for learning approximate bisimulations, a type of state abstraction. We use a deep…

Machine Learning · Computer Science 2021-01-12 Ondrej Biza , Robert Platt , Jan-Willem van de Meent , Lawson L. S. Wong

Due to the substantial scale of Large Language Models (LLMs), the direct application of conventional compression methodologies proves impractical. The computational demands associated with even minimal gradient updates present challenges,…

Machine Learning · Computer Science 2023-12-13 Arnav Chavan , Nahush Lele , Deepak Gupta

In this article, we show that the projection-free, snapshot-based, balanced truncation method can be applied directly to unstable systems. We prove that even for unstable systems, the unmodified balanced proper orthogonal decomposition…

Fluid Dynamics · Physics 2015-08-27 Thibault L. B. Flinois , Aimee S. Morgans , Peter J. Schmid

Predicting stochastic cellular dynamics as emerging from the mechanistic models of molecular interactions is a long-standing challenge in systems biology: low-level chemical reaction network (CRN) models give raise to a highly-dimensional…

Molecular Networks · Quantitative Biology 2020-02-06 Tatjana Petrov , Denis Repin

Managing extensive context remains a critical bottleneck for Large Language Models (LLMs), particularly in applications like long-document question answering and autonomous agents where lengthy inputs incur high computational costs and…

Computation and Language · Computer Science 2026-01-06 Yiqing Zhou , Yu Lei , Shuzheng Si , Qingyan Sun , Wei Wang , Yifei Wu , Hao Wen , Gang Chen , Fanchao Qi , Maosong Sun