中文
相关论文

相关论文: Learning long range dependencies through time reve…

200 篇论文

In order to make data-driven models of physical systems interpretable and reliable, it is essential to include prior physical knowledge in the modeling framework. Hamiltonian Neural Networks (HNNs) implement Hamiltonian theory in deep…

系统与控制 · 电气工程与系统科学 2023-05-03 Sarvin Moradi , Nick Jaensson , Roland Tóth , Maarten Schoukens

Substring kernels are classical tools for representing biological sequences or text. However, when large amounts of annotated data are available, models that allow end-to-end training such as neural networks are often preferred. Links…

机器学习 · 统计学 2019-10-18 Dexiong Chen , Laurent Jacob , Julien Mairal

Backpropagation through time (BPTT) is the standard algorithm for training recurrent neural networks (RNNs), which requires separate simulation phases for the forward and backward passes for inference and learning, respectively. Moreover,…

机器学习 · 计算机科学 2023-03-13 Anand Subramoney

We apply reinforcement learning (RL) to robotics tasks. One of the drawbacks of traditional RL algorithms has been their poor sample efficiency. One approach to improve the sample efficiency is model-based RL. In our model-based RL…

机器学习 · 计算机科学 2023-05-16 Adithya Ramesh , Balaraman Ravindran

Port-Hamiltonian neural networks (pHNNs) are emerging as a powerful modeling tool that integrates physical laws with deep learning techniques. While most research has focused on modeling the entire dynamics of interconnected systems, the…

系统与控制 · 电气工程与系统科学 2024-11-11 G. J. E. van Otterdijk , S. Moradi , S. Weiland , R. Tóth , N. O. Jaensson , M. Schoukens

In this paper, we introduces a Pseudo-Symplectic Neural Network (PSNN) for learning general Hamiltonian systems (both separable and non-separable) from data. To address the limitations of existing structure-preserving methods (e.g.,…

数值分析 · 数学 2025-03-07 Xupeng Cheng , Lijin Wang , Yanzhao Cao , Chen Chen

We explore the use of Physics Informed Neural Networks to analyse nonlinear Hamiltonian Dynamical Systems with a first integral of motion. In this work, we propose an architecture which combines existing Hamiltonian Neural Network…

机器学习 · 计算机科学 2023-08-09 Vedanta Thapar

Recurrent neural networks with a gating mechanism such as an LSTM or GRU are powerful tools to model sequential data. In the mechanism, a forget gate, which was introduced to control information flow in a hidden state in the RNN, has…

机器学习 · 统计学 2021-11-08 Kentaro Ohno , Atsutoshi Kumagai

In this study, we focus on learning Hamiltonian systems, which involves predicting the coordinate (q) and momentum (p) variables generated by a symplectic mapping. Based on Chen & Tao (2021), the symplectic mapping is represented by a…

地球与行星天体物理 · 物理学 2023-07-05 Xin Li , Jian Li , Zhihong Jeff Xia , Nikolaos Georgakarakos

Biological neural networks are equipped with an inherent capability to continuously adapt through online learning. This aspect remains in stark contrast to learning with error backpropagation through time (BPTT) applied to recurrent neural…

Deep learning (DL) based unrolled reconstructions have shown state-of-the-art performance for under-sampled magnetic resonance imaging (MRI). Similar to compressed sensing, DL can leverage high-dimensional data (e.g. 3D, 2D+time, 3D+time)…

图像与视频处理 · 电气工程与系统科学 2021-03-09 Ke Wang , Michael Kellman , Christopher M. Sandino , Kevin Zhang , Shreyas S. Vasanawala , Jonathan I. Tamir , Stella X. Yu , Michael Lustig

Deep learning methods for electronic-structure Hamiltonian prediction has offered significant computational efficiency advantages over traditional DFT methods, yet the diversity of atomic types, structural patterns, and the high-dimensional…

机器学习 · 计算机科学 2026-03-03 Shi Yin , Zujian Dai , Xinyang Pan , Lixin He

This work attempts to approximate a linear Gaussian system with a finite-state hidden Markov model (HMM), which is found useful in solving sophisticated event-based state estimation problems. An indirect modeling approach is developed,…

系统与控制 · 电气工程与系统科学 2020-07-10 Kaikai Zheng , Dawei Shi , Ling Shi

Sensor networks increasingly govern modern infrastructure, yet the data they lose are rarely missing in the uniform-random patterns assumed by standard imputation benchmarks. Loop detectors go offline during calibration, roadside cabinets…

机器学习 · 计算机科学 2026-05-19 Keshu Wu , Sixu Li , Zihao Li , Zhiwen Fan , Xiaopeng Li , Yang Zhou

Effective planning in model-based reinforcement learning (MBRL) and model-predictive control (MPC) relies on the accuracy of the learned dynamics model. In many instances of MBRL and MPC, this model is assumed to be stationary and is…

机器学习 · 计算机科学 2026-05-27 Yizhou Huang , Kevin Xie , Homanga Bharadhwaj , Florian Shkurti

Predictive Autoscaling is used to forecast the workloads of servers and prepare the resources in advance to ensure service level objectives (SLOs) in dynamic cloud environments. However, in practice, its prediction task often suffers from…

机器学习 · 计算机科学 2023-09-06 Hongyan Hao , Zhixuan Chu , Shiyi Zhu , Gangwei Jiang , Yan Wang , Caigao Jiang , James Zhang , Wei Jiang , Siqiao Xue , Jun Zhou

In this article, a stochastic gradient based online learning algorithm for Extreme Learning Machines (ELM) is developed (SG-ELM). A stability criterion based on Lyapunov approach is used to prove both asymptotic stability of estimation…

神经与进化计算 · 计算机科学 2015-01-19 Vijay Manikandan Janakiraman , XuanLong Nguyen , Dennis Assanis

Accurate learning of system dynamics is becoming increasingly crucial for advanced control and decision-making in engineering. However, real-world systems often exhibit multiple channels and highly nonlinear transition dynamics, challenging…

机器学习 · 统计学 2025-10-20 Tengjie Zheng , Jilan Mei , Di Wu , Lin Cheng , Shengping Gong

Hierarchical reinforcement learning (HRL) is a promising approach to extend traditional reinforcement learning (RL) methods to solve more complex tasks. Yet, the majority of current HRL methods require careful task-specific design and…

机器学习 · 计算机科学 2018-10-08 Ofir Nachum , Shixiang Gu , Honglak Lee , Sergey Levine

Hamiltonian neural networks (HNNs) are state-of-the-art models that regress the vector field of a dynamical system under the learning bias of Hamilton's equations. A recent observation is that embedding a bias regarding the additive…

机器学习 · 计算机科学 2024-08-16 Zi-Yu Khoo , Dawen Wu , Jonathan Sze Choong Low , Stéphane Bressan