中文
相关论文

相关论文: Almost-Linear RNNs Yield Highly Interpretable Symb…

200 篇论文

Stochastic recurrent neural networks with latent random variables of complex dependency structures have shown to be more successful in modeling sequential data than deterministic deep models. However, the majority of existing methods have…

The reservoir computing networks (RCNs) have been successfully employed as a tool in learning and complex decision-making tasks. Despite their efficiency and low training cost, practical applications of RCNs rely heavily on empirical…

机器学习 · 计算机科学 2021-12-14 Wei Miao , Vignesh Narayanan , Jr-Shin Li

Due to the increasing availability of large-scale observation and simulation datasets, data-driven representations arise as efficient and relevant computation representations of dynamical systems for a wide range of applications, where…

机器学习 · 计算机科学 2017-12-20 Ronan Fablet , Said Ouala , Cedric Herzet

The community is increasingly exploring linear RNNs (LRNNs) as language models, motivated by their expressive power and parallelizability. While prior work establishes the expressivity benefits of LRNNs over transformers, it is unclear what…

机器学习 · 计算机科学 2026-03-06 William Merrill , Hongjian Jiang , Yanhong Li , Anthony Lin , Ashish Sabharwal

Machine learning-based methods have achieved successful applications in machinery fault diagnosis. However, the main limitation that exists for these methods is that they operate as a black box and are generally not interpretable. This…

机器学习 · 计算机科学 2022-04-20 Gang Chen , Yu Lu , Rong Su , Zhaodan Kong

Deep reinforcement learning (DRL) has recently emerged as a promising approach to solve combinatorial optimization problems such as job shop scheduling. However, the policies learned by DRL are typically represented by deep neural networks…

机器学习 · 计算机科学 2026-05-19 Chengpeng Hu , Yingqian Zhang , Hendrik Baier

The ubiquity of neural networks (NNs) in real-world applications, from healthcare to natural language processing, underscores their immense utility in capturing complex relationships within high-dimensional data. However, NNs come with…

机器学习 · 计算机科学 2024-07-08 Chang Yue , Niraj K. Jha

Understanding the time evolution of physical systems is crucial to revealing fundamental characteristics that are hidden in frequency domain. In optical science, high-quality resonance cavities and enhanced interactions with matters are at…

光学 · 物理学 2021-09-22 Yingheng Tang , Jichao Fan , Xinwei Li , Jianzhu Ma , Minghao Qi , Cunxi Yu , Weilu Gao

Discovering governing equations of complex network dynamics is a fundamental challenge in contemporary science with rich data, which can uncover the mysterious patterns and mechanisms of the formation and evolution of complex phenomena in…

人工智能 · 计算机科学 2024-11-12 Jiao Hu , Jiaxu Cui , Bo Yang

Learning a stable Linear Dynamical System (LDS) from data involves creating models that both minimize reconstruction error and enforce stability of the learned representation. We propose a novel algorithm for learning stable LDSs. Using a…

机器学习 · 计算机科学 2020-11-19 Giorgos Mamakoukas , Orest Xherija , T. D. Murphey

Deep reinforcement learning (deep RL) has been successful in learning sophisticated behaviors automatically; however, the learning process requires a huge number of trials. In contrast, animals can learn new tasks in just a few trials,…

人工智能 · 计算机科学 2016-11-11 Yan Duan , John Schulman , Xi Chen , Peter L. Bartlett , Ilya Sutskever , Pieter Abbeel

Data-driven inference of the generative dynamics underlying a set of observed time series is of growing interest in machine learning and the natural sciences. In neuroscience, such methods promise to alleviate the need to handcraft models…

机器学习 · 计算机科学 2024-11-06 Eric Volkmann , Alena Brändle , Daniel Durstewitz , Georgia Koppe

Recurrent networks of spiking neurons (RSNNs) underlie the astounding computing and learning capabilities of the brain. But computing and learning capabilities of RSNN models have remained poor, at least in comparison with artificial neural…

神经与进化计算 · 计算机科学 2018-12-27 Guillaume Bellec , Darjan Salaj , Anand Subramoney , Robert Legenstein , Wolfgang Maass

This study presents a novel unsupervised convolutional Neural Network (NN) architecture with nonlocal interactions for solving Partial Differential Equations (PDEs). The nonlocal Peridynamic Differential Operator (PDDO) is employed as a…

机器学习 · 计算机科学 2023-03-22 A. Mavi , A. C. Bekar , E. Haghighat , E. Madenci

We suggest a universal map capable to recover a behavior of a wide range of dynamical systems given by ODEs. The map is built as an artificial neural network whose weights encode a modeled system. We assume that ODEs are known and prepare…

无序系统与神经网络 · 物理学 2023-05-02 Pavel V. Kuptsov , Anna V. Kuptsova , Nataliya V. Stankevich

Recurrent neural networks (RNNs) are complex dynamical systems, capable of ongoing activity without any driving input. The long-term behavior of free-running RNNs, described by periodic, chaotic and fixed point attractors, is controlled by…

神经元与认知 · 定量生物学 2021-08-06 Claus Metzner , Patrick Krauss

Modeling of turbulent flows is still challenging. One way to deal with the large scale separation due to turbulence is to simulate only the large scales and model the unresolved contributions as done in large-eddy simulation (LES). This…

计算物理 · 物理学 2019-10-03 Mathis Bode , Michael Gauding , Konstantin Kleinheinz , Heinz Pitsch

Advancements in deep learning are revolutionizing science and engineering. The immense success of deep learning is largely due to its ability to extract essential high-dimensional (HD) features from input data and make inference decisions…

机器学习 · 计算机科学 2025-01-30 Md Tauhidul Islam , Lei Xing

Accurately predicting deformable linear object (DLO) dynamics is challenging, especially when the task requires a model that is both human-interpretable and computationally efficient. In this work, we draw inspiration from the pseudo-rigid…

机器人学 · 计算机科学 2024-10-28 Shamil Mamedov , A. René Geist , Jan Swevers , Sebastian Trimpe

It was recently conjectured that every component of a discrete-time rational dynamical system is a solution to an algebraic difference equation that is linear in its highest-shift term (a quasi-linear equation). We prove that the conjecture…

符号计算 · 计算机科学 2024-06-18 Bertrand Teguia Tabuguia , James Worrell