English
Related papers

Related papers: A short trajectory is all you need: A transformer-…

200 papers

This paper gives an overview on how to develop a dense and deep neural network for making a time series prediction. First, the history and cornerstones in Artificial Intelligence and Machine Learning will be presented. After a short…

Machine Learning · Computer Science 2025-03-11 Bojan Lukić

Developing accurate and computationally inexpensive models for the dynamics of open-quantum systems is critical in designing new qubit platforms by first understanding their mechanisms of decoherence and dephasing. Current models based on…

Disordered Systems and Neural Networks · Physics 2021-09-30 Nima Leclerc

High-fidelity quantum dynamics emulators can be used to predict the time evolution of complex physical systems. Here, we introduce an efficient training framework for constructing machine learning-based emulators. Our approach is based on…

Quantum Physics · Physics 2022-03-22 Yu Yao , Chao Cao , Stephan Haas , Mahak Agarwal , Divyam Khanna , Marcin Abram

We present a representation learning algorithm that learns a low-dimensional latent dynamical system from high-dimensional \textit{sequential} raw data, e.g., video. The framework builds upon recent advances in amortized inference methods…

Machine Learning · Computer Science 2020-01-29 Jung-Su Ha , Young-Jin Park , Hyeok-Joo Chae , Soon-Seo Park , Han-Lim Choi

Modeling brain dynamics to better understand and control complex behaviors underlying various cognitive brain functions are of interests to engineers, mathematicians, and physicists from the last several decades. With a motivation of…

Neurons and Cognition · Quantitative Biology 2019-08-21 Benjamin Plaster , Gautam Kumar

Efficient simulations of the dynamics of open systems is of wide importance for quantum science and tech-nology. Here, we introduce a generalization of the transfer-tensor, or discrete-time memory kernel, formalism to multi-time measurement…

Quantum Physics · Physics 2020-11-09 Mathias R. Jørgensen , Felix A. Pollock

Data driven methods for time series forecasting that quantify uncertainty open new important possibilities for robot tasks with hard real time constraints, allowing the robot system to make decisions that trade off between reaction time and…

Machine Learning · Computer Science 2020-01-08 Sebastian Gomez-Gonzalez , Sergey Prokudin , Bernhard Scholkopf , Jan Peters

The process of training an artificial neural network involves iteratively adapting its parameters so as to minimize the error of the network's prediction, when confronted with a learning task. This iterative change can be naturally…

Machine Learning · Computer Science 2024-04-10 Kaloyan Danovski , Miguel C. Soriano , Lucas Lacasa

This study challenges strictly guaranteeing ``dissipativity'' of a dynamical system represented by neural networks learned from given time-series data. Dissipativity is a crucial indicator for dynamical systems that generalizes stability…

Machine Learning · Computer Science 2024-12-20 Yuji Okamoto , Ryosuke Kojima

In experimentally realistic situations, quantum systems are never perfectly isolated and the coupling to their environment needs to be taken into account. Often, the effect of the environment can be well approximated by a Markovian master…

Quantum Physics · Physics 2019-07-03 Michael J. Hartmann , Giuseppe Carleo

We present an algorithm to learn the relevant latent variables of a large-scale discretized physical system and predict its time evolution using thermodynamically-consistent deep neural networks. Our method relies on sparse autoencoders,…

Computational Engineering, Finance, and Science · Computer Science 2021-03-25 Quercus Hernandez , Alberto Badias , David Gonzalez , Francisco Chinesta , Elias Cueto

Various deep learning models, especially some latest Transformer-based approaches, have greatly improved the state-of-art performance for long-term time series forecasting.However, those transformer-based models suffer a severe…

Machine Learning · Computer Science 2022-06-27 Tian Zhou , Jianqing Zhu , Xue Wang , Ziqing Ma , Qingsong Wen , Liang Sun , Rong Jin

We introduce a method for learning the dynamics of complex nonlinear systems based on deep generative models over temporal segments of states and actions. Unlike dynamics models that operate over individual discrete timesteps, we learn the…

Machine Learning · Computer Science 2017-07-14 Nikhil Mishra , Pieter Abbeel , Igor Mordatch

Model reduction of high-dimensional dynamical systems alleviates computational burdens faced in various tasks from design optimization to model predictive control. One popular model reduction approach is based on projecting the governing…

Dynamical Systems · Mathematics 2018-08-24 Francisco J. Gonzalez , Maciej Balajewicz

Deep neural networks are often applied to medical images to automate the problem of medical diagnosis. However, a more clinically relevant question that practitioners usually face is how to predict the future trajectory of a disease.…

Image and Video Processing · Electrical Eng. & Systems 2023-09-20 Huy Hoang Nguyen , Matthew B. Blaschko , Simo Saarakkala , Aleksei Tiulpin

We present in this paper a model for forecasting short-term power loads based on deep residual networks. The proposed model is able to integrate domain knowledge and researchers' understanding of the task by virtue of different neural…

Machine Learning · Statistics 2018-05-31 Kunjin Chen , Kunlong Chen , Qin Wang , Ziyu He , Jun Hu , Jinliang He

Predicting future physical behavior from limited theoretical simulation data is an emerging research paradigm driven by the integration of artificial intelligence and quantum physics. In this work, charge transport (CT) behavior was…

Chemical Physics · Physics 2025-07-15 Zi-Ran Zhao , Shun-Cai Zhao , Yi-Meng Huang

Neural population activity is theorized to reflect an underlying dynamical structure. This structure can be accurately captured using state space models with explicit dynamics, such as those based on recurrent neural networks (RNNs).…

Neurons and Cognition · Quantitative Biology 2023-07-21 Joel Ye , Chethan Pandarinath

Machine learning has shown significant breakthroughs in quantum science, where in particular deep neural networks exhibited remarkable power in modeling quantum many-body systems. Here, we explore how the capacity of data-driven deep neural…

Quantum Physics · Physics 2024-07-24 Naeimeh Mohseni , Junheng Shi , Tim Byrnes , Michael J. Hartmann

Quantum systems out of equilibrium are presently a subject of active research, both in theoretical and experimental domains. In this work we consider time-periodically modulated quantum systems which are in contact with a stationary…

Quantum Gases · Physics 2017-12-06 V. Volokitin , A. Liniov , I. Meyerov , M. Hartmann , M. Ivanchenko , P. Hänggi , S. Denisov