English
Related papers

Related papers: Self-Supervised Evolution Operator Learning for Hi…

200 papers

We propose a finite-dimensional control-based method to approximate solution operators for evolutional partial differential equations (PDEs), particularly in high-dimensions. By employing a general reduced-order model, such as a deep neural…

Numerical Analysis · Mathematics 2024-01-22 Nathan Gaby , Xiaojing Ye

Transformers have become the dominant architecture for sequence modeling tasks such as natural language processing or audio processing, and they are now even considered for tasks that are not naturally sequential such as image…

Machine Learning · Computer Science 2024-03-05 Jorg Bornschein , Yazhe Li , Amal Rannen-Triki

The dynamic of complex ordering systems with active rotational degrees of freedom exemplified by protein self-assembly is explored using a machine learning workflow that combines deep learning-based semantic segmentation and rotationally…

Soft Condensed Matter · Physics 2021-04-26 Sergei V. Kalinin , Shuai Zhang , Mani Valleti , Harley Pyles , David Baker , James J. De Yoreo , Maxim Ziatdinov

The number of studies that combine Evolutionary Machine Learning and self-supervised learning has been growing steadily in recent years. Evolutionary Machine Learning has been shown to help automate the design of machine learning algorithms…

Neural and Evolutionary Computing · Computer Science 2025-11-05 Adriano Vinhas , João Correia , Penousal Machado

Supervised learning has become a cornerstone of modern machine learning, yet a comprehensive theory explaining its effectiveness remains elusive. Empirical phenomena, such as neural analogy-making and the linear representation hypothesis,…

Machine Learning · Computer Science 2025-02-26 Patrik Reizinger , Alice Bizeul , Attila Juhos , Julia E. Vogt , Randall Balestriero , Wieland Brendel , David Klindt

Koopman operators and transfer operators represent nonlinear dynamics in state space through its induced action on linear spaces of observables and measures, respectively. This framework enables the use of linear operator theory for…

Dynamical Systems · Mathematics 2025-06-06 Claire Valva , Dimitrios Giannakis

Datasets from single-molecule experiments often reflect a large variety of molecular behaviour. The exploration of such datasets can be challenging, especially if knowledge about the data is limited and a priori assumptions about expected…

Data Analysis, Statistics and Probability · Physics 2020-04-06 Anton Vladyka , Tim Albrecht

Modeling complex spatiotemporal dynamical systems, such as the reaction-diffusion processes, have largely relied on partial differential equations (PDEs). However, due to insufficient prior knowledge on some under-explored dynamical…

Machine Learning · Computer Science 2023-05-23 Chengping Rao , Pu Ren , Qi Wang , Oral Buyukozturk , Hao Sun , Yang Liu

Evolutionary Computation is a branch of computer science with which, traditionally, High Energy Physics has fewer connections. Its methods were investigated in this field, mainly for data analysis tasks. These methods and studies are,…

Data Analysis, Statistics and Probability · Physics 2008-04-03 Liliana Teodorescu

Self-supervision is one of the hallmarks of representation learning in the increasingly popular suite of foundation models including large language models such as BERT and GPT-3, but it has not been pursued in the context of multivariate…

Machine Learning · Computer Science 2024-02-05 Xiao Shou , Dharmashankar Subramanian , Debarun Bhattacharjya , Tian Gao , Kristin P. Bennet

A new model for evolving Evolutionary Algorithms (EAs) is proposed in this paper. The model is based on the Multi Expression Programming (MEP) technique. Each MEP chromosome encodes an evolutionary pattern that is repeatedly used for…

Neural and Evolutionary Computing · Computer Science 2021-10-13 Mihai Oltean

The Koopman operator is a linear but infinite dimensional operator that governs the evolution of scalar observables defined on the state space of an autonomous dynamical system, and is a powerful tool for the analysis and decomposition of…

Dynamical Systems · Mathematics 2015-07-28 Matthew O. Williams , Ioannis G. Kevrekidis , Clarence W. Rowley

We present a framework for the unsupervised learning of neurosymbolic encoders, which are encoders obtained by composing neural networks with symbolic programs from a domain-specific language. Our framework naturally incorporates symbolic…

Machine Learning · Computer Science 2022-12-22 Eric Zhan , Jennifer J. Sun , Ann Kennedy , Yisong Yue , Swarat Chaudhuri

Koopman analysis of a general dynamics system provides a linear Koopman operator and an embedded eigenfunction space, enabling the application of standard techniques from linear analysis. However, in practice, deriving exact operators and…

Systems and Control · Electrical Eng. & Systems 2025-04-29 Alexander Estornell , Leonard Jung , Alenna Spiro , Mario Sznaier , Michael Everett

Dynamic Mode Decomposition (DMD) and its variants, such as extended DMD (EDMD), are broadly used to fit simple linear models to dynamical systems known from observable data. As DMD methods work well in several situations but perform poorly…

Dynamical Systems · Mathematics 2024-08-06 George Haller , Bálint Kaszás

Quantum systems governed by time-dependent Hamiltonians pose significant challenges for the accurate computation of unitary time-evolution operators, which are essential for predicting quantum state dynamics. In this work, we introduce a…

Quantum Physics · Physics 2026-01-21 Antonio Guerra , Daniel Uzcategui-Contreras , Aldo Delgado , Esteban S. Gómez

We discuss time dependent quantum systems on bounded domains. Our work may be viewed as a framework for several models, including linear iterations involved in time dependent density functional theory (TDDFT), the Hartree-Fock model, or…

Dynamical Systems · Mathematics 2013-09-17 Joseph W. Jerome , Eric Polizzi

We address the problem of learning self-supervised representations from unlabeled image collections. Unlike existing approaches that attempt to learn useful features by maximizing similarity between augmented versions of each input image or…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Omiros Pantazis , Gabriel Brostow , Kate Jones , Oisin Mac Aodha

Real-time dynamics of quantum observables provide direct access to excitation spectra and correlation functions in quantum many-body systems, but currently available quantum devices are limited to short evolution times due to decoherence.…

Quantum Physics · Physics 2026-03-17 Jinyang Li , Satoshi Iso , Shunji Matsuura , Lingxiao Wang , Xiaoyang Wang

This paper introduces a novel framework for dynamic classification in high dimensional spaces, addressing the evolving nature of class distributions over time or other index variables. Traditional discriminant analysis techniques are…

Methodology · Statistics 2025-02-18 Wenbo Ouyang , Ruiyang Wu , Ning Hao , Hao Helen Zhang