English
Related papers

Related papers: Temporal-Difference Networks for Dynamical Systems…

200 papers

This paper presents tailor-made neural model structures and two custom fitting criteria for learning dynamical systems. The proposed framework is based on a representation of the system behavior in terms of continuous-time state-space…

Systems and Control · Electrical Eng. & Systems 2021-09-02 Marco Forgione , Dario Piga

Motivated by the emerging use of multi-agent reinforcement learning (MARL) in engineering applications such as networked robotics, swarming drones, and sensor networks, we investigate the policy evaluation problem in a fully decentralized…

Machine Learning · Computer Science 2020-01-31 Jun Sun , Gang Wang , Georgios B. Giannakis , Qinmin Yang , Zaiyue Yang

This article presents a novel approach for learning low-dimensional distributed representations of users in online social networks. Existing methods rely on the network structure formed by the social relationships among users to extract…

Social and Information Networks · Computer Science 2017-10-23 Harvineet Singh , Amitabha Bagchi , Parag Singla

Identifying dynamical systems from experimental data is a notably difficult task. Prior knowledge generally helps, but the extent of this knowledge varies with the application, and customized models are often needed. Neural ordinary…

Systems and Control · Electrical Eng. & Systems 2023-01-13 Mona Buisson-Fenet , Valery Morgenthaler , Sebastian Trimpe , Florent Di Meglio

We propose a method for learning dynamical systems from high-dimensional empirical data that combines variational autoencoders and (spatio-)temporal attention within a framework designed to enforce certain scientifically-motivated…

Machine Learning · Computer Science 2023-06-22 Kai Lagemann , Christian Lagemann , Sach Mukherjee

The advantages of temporal networks in capturing complex dynamics, such as diffusion and contagion, has led to breakthroughs in real world systems across numerous fields. In the case of human behavior, face-to-face interaction networks…

Social and Information Networks · Computer Science 2025-06-06 Nicolò Alessandro Girardini , Antonio Longa , Gaia Trebucchi , Giulia Cencetti , Andrea Passerini , Bruno Lepri

We present a representation learning algorithm that learns a low-dimensional latent dynamical system from high-dimensional \textit{sequential} raw data, e.g., video. The framework builds upon recent advances in amortized inference methods…

Machine Learning · Computer Science 2020-01-29 Jung-Su Ha , Young-Jin Park , Hyeok-Joo Chae , Soon-Seo Park , Han-Lim Choi

This research aimed to develop an intelligent system to evaluate performance and extract behavioral models for children with ASD and neurotypical (TD) children by interacting with a virtual social robot in a music education program using…

Human-Computer Interaction · Computer Science 2026-04-20 Armin Tandiseh , Morteza Memari , Alireza Taheri

We consider the task of learning a dynamical system from high-dimensional time-course data. For instance, we might wish to estimate a gene regulatory network from gene expression data measured at discrete time points. We model the dynamical…

Methodology · Statistics 2016-10-12 Shizhe Chen , Ali Shojaie , Daniela M. Witten

Compared with static knowledge graphs, temporal knowledge graphs (tKG), which can capture the evolution and change of information over time, are more realistic and general. However, due to the complexity that the notion of time introduces…

Computation and Language · Computer Science 2025-04-07 Siheng Xiong , Yuan Yang , Faramarz Fekri , James Clayton Kerce

In reinforcement learning, the TD($\lambda$) algorithm is a fundamental policy evaluation method with an efficient online implementation that is suitable for large-scale problems. One practical drawback of TD($\lambda$) is its sensitivity…

Machine Learning · Statistics 2014-12-23 Aviv Tamar , Panos Toulis , Shie Mannor , Edoardo M. Airoldi

There is significant progress in recognizing traditional human activities from videos focusing on highly distinctive actions involving discriminative body movements, body-object and/or human-human interactions. Driver's activities are…

Computer Vision and Pattern Recognition · Computer Science 2021-01-19 Zachary Wharton , Ardhendu Behera , Yonghuai Liu , Nik Bessis

In this paper we develop a novel Topological Data Analysis (TDA) approach for studying graph representations of time series of dynamical systems. Specifically, we show how persistent homology, a tool from TDA, can be used to yield a…

Chaotic Dynamics · Physics 2020-01-28 Audun Myers , Elizabeth Munch , Firas A. Khasawneh

Reinforcement learning has attracted great attention recently, especially policy gradient algorithms, which have been demonstrated on challenging decision making and control tasks. In this paper, we propose an active multi-step TD algorithm…

Machine Learning · Computer Science 2019-11-28 Gang Chen , Dingcheng Li , Ran Xu

Recently, using neural networks to simulate spatio-temporal dynamics has received a lot of attention. However, most existing methods adopt pure data-driven black-box models, which have limited accuracy and interpretability. By combining…

Machine Learning · Computer Science 2023-07-28 Xiang Huang , Zhuoyuan Li , Hongsheng Liu , Zidong Wang , Hongye Zhou , Bin Dong , Bei Hua

We study the fundamental problem of learning a marginally stable unknown nonlinear dynamical system. We describe an algorithm for this problem, based on the technique of spectral filtering, which learns a mapping from past observations to…

Machine Learning · Computer Science 2025-08-19 Evan Dogariu , Anand Brahmbhatt , Elad Hazan

Reinforcement learning algorithms typically rely on the assumption that the environment dynamics and value function can be expressed in terms of a Markovian state representation. However, when state information is only partially observable,…

Learning continuous-time dynamics on complex networks is crucial for understanding, predicting and controlling complex systems in science and engineering. However, this task is very challenging due to the combinatorial complexities in the…

Social and Information Networks · Computer Science 2020-06-19 Chengxi Zang , Fei Wang

Animals can quickly learn the timing of events with fixed intervals and their rate of acquisition does not depend on the length of the interval. In contrast, recurrent neural networks that use gradient based learning have difficulty…

Machine Learning · Computer Science 2021-06-08 Gabriele Cimolino , Francois Rivest

Predictive models of the future are fundamental for an agent's ability to reason and plan. A common strategy learns a world model and unrolls it step-by-step at inference, where small errors can rapidly compound. Geometric Horizon Models…

Machine Learning · Computer Science 2025-03-14 Jesse Farebrother , Matteo Pirotta , Andrea Tirinzoni , Rémi Munos , Alessandro Lazaric , Ahmed Touati