English
Related papers

Related papers: A Geometry-Adaptive Deep Variational Framework for…

200 papers

In this work, we investigate the use of data-driven equation discovery for dynamical systems to model and forecast continuous-time dynamics of unconstrained optimization problems. To avoid expensive evaluations of the objective function and…

Optimization and Control · Mathematics 2026-02-19 Grant Norman , Conor Rowan , Kurt Maute , Alireza Doostan

The unexpected emergence of ferroelectricity in HfO2 at reduced dimensions has attracted considerable attention, as it provides a pathway toward the realization of ultrasmall ferroelectric devices. Ab initio calculations suggest that this…

Materials Science · Physics 2025-12-19 Yusuke Tamura , Kairi Masuda , Yu Kumagai

Learning a Markov Decision Process (MDP) from a fixed batch of trajectories is a non-trivial task whose outcome's quality depends on both the amount and the diversity of the sampled regions of the state-action space. Yet, many MDPs are…

Machine Learning · Computer Science 2022-03-08 Giorgio Angelotti , Nicolas Drougard , Caroline P. C. Chanel

The orthogonality constraints, including the hard and soft ones, have been used to normalize the weight matrices of Deep Neural Network (DNN) models, especially the Convolutional Neural Network (CNN) and Vision Transformer (ViT), to reduce…

Computer Vision and Pattern Recognition · Computer Science 2022-12-13 Taoyong Cui , Jianze Li , Yuhan Dong , Li Liu

The rapidly changing landscapes of modern optimization problems require algorithms that can be adapted in real-time. This paper introduces an Adaptive Metaheuristic Framework (AMF) designed for dynamic environments. It is capable of…

Artificial Intelligence · Computer Science 2024-04-19 Bestoun S. Ahmed

Geospatial modeling provides critical solutions for pressing global challenges such as sustainability and climate change. Existing large language model (LLM)-based algorithm discovery frameworks, such as AlphaEvolve, excel at evolving…

Artificial Intelligence · Computer Science 2025-09-29 Peng Luo , Xiayin Lou , Yu Zheng , Zhuo Zheng , Stefano Ermon

We study the dynamical properties of a broad class of high-dimensional random dynamical systems exhibiting chaotic as well as fixed point and periodic attractors. We consider cases in which attractors can co-exists in some regions of the…

Disordered Systems and Neural Networks · Physics 2026-03-02 Samantha J. Fournier , Pierfrancesco Urbani

Prevailing AI training infrastructure assumes reverse-mode automatic differentiation over IEEE-754 arithmetic. The memory overhead of training relative to inference, optimizer complexity, and structural degradation of geometric properties…

Artificial Intelligence · Computer Science 2026-04-21 Houston Haynes

The Earth, a temporal complex system, is witnessing a shift in research on its coordinate system, moving away from conventional static positioning toward embracing dynamic modeling. Early positioning concentrates on static natural…

Geophysics · Physics 2025-05-13 Junfan Yi , Ke-ke Shang , Michael Small

The aerodynamic optimization process of cars requires multiple iterations between aerodynamicists and stylists. Response Surface Modeling and Reduced-Order Modeling are commonly used to eliminate the overhead due to Computational Fluid…

Computational Engineering, Finance, and Science · Computer Science 2022-05-26 Sam Jacob Jacob , Markus Mrosek , Carsten Othmer , Harald Köstler

We solve the problem of 6-DoF localisation and 3D dense reconstruction in spatial environments as approximate Bayesian inference in a deep state-space model. Our approach leverages both learning and domain knowledge from multiple-view…

Machine Learning · Statistics 2021-03-16 Atanas Mirchev , Baris Kayalibay , Patrick van der Smagt , Justin Bayer

Deep generative models and neural operators have demonstrated significant potential for 3D aerodynamic inference. However, they often face inherent challenges in maintaining physical consistency and preserving high-frequency features,…

Numerical Analysis · Mathematics 2026-04-28 Ruiling Jiang , Yong Zhang , Houbiao Li

Neuro-symbolic systems aim to combine the expressive structure of symbolic logic with the flexibility of neural learning; yet, generative models typically lack mechanisms to enforce declarative constraints at generation time. We propose…

Machine Learning · Computer Science 2026-05-26 Ali Baheri

We propose a novel framework, called Markov-Lipschitz deep learning (MLDL), to tackle geometric deterioration caused by collapse, twisting, or crossing in vector-based neural network transformations for manifold-based representation…

Machine Learning · Computer Science 2020-10-01 Stan Z. Li , Zelin Zang , Lirong Wu

Hyperparameter tuning is one of the essential steps to guarantee the convergence of machine learning models. We argue that intuition about the optimal choice of hyperparameters for stochastic gradient descent can be obtained by studying a…

Disordered Systems and Neural Networks · Physics 2025-12-12 Chanju Park , Biagio Lucini , Gert Aarts

Deep learning potentials for complex many-body systems often face challenges of insufficient accuracy and a lack of physical realism. This paper proposes an "Observable-Constrained Variational Framework" (OCVF), a general top-down…

Materials Science · Physics 2026-05-11 Shaoliang Guo , Ziping Yang

Generalizing policies across different domains with dynamics mismatch poses a significant challenge in reinforcement learning. For example, a robot learns the policy in a simulator, but when it is deployed in the real world, the dynamics of…

Machine Learning · Computer Science 2023-10-16 Kang Xu , Chenjia Bai , Xiaoteng Ma , Dong Wang , Bin Zhao , Zhen Wang , Xuelong Li , Wei Li

We propose the Identifiable Variational Dynamic Factor Model (iVDFM), which learns latent factors from multivariate time series with identifiability guarantees. By applying iVAE-style conditioning to the innovation process driving the…

Machine Learning · Computer Science 2026-03-25 Minkey Chang , Jae-Young Kim

We propose an algorithm for an optimal adaptive selection of points from the design domain of input random variables that are needed for an accurate estimation of failure probability and the determination of the boundary between safe and…

Computational Engineering, Finance, and Science · Computer Science 2023-06-30 Aleksei Gerasimov , Miroslav Vořechovský

Cartoon-texture image decomposition is a critical preprocessing problem bottlenecked by the numerical intractability of classical variational or optimization models and the tedious manual tuning of global regularization parameters.We…

Numerical Analysis · Mathematics 2026-01-09 Alessandro Lanza , Serena Morigi , Youwei Wen , Li Yang