English
Related papers

Related papers: Temperature-Aware Recurrent Neural Operator for Te…

200 papers

Short-term synaptic plasticity (STP) is often regarded as a presynaptic filter of spikes, independent of postsynaptic activity. Recent experiments, however, indicate an associative STP that depends on pre- and postsynaptic coactivation. We…

Neurons and Cognition · Quantitative Biology 2026-05-20 Genki Shimizu , Taro Toyoizumi

Artificial Neural Networks (NNWs) are appealing functions to substitute high dimensional and non-linear history-dependent problems in computational mechanics since they offer the possibility to drastically reduce the computational time.…

Computational Engineering, Finance, and Science · Computer Science 2023-10-11 Ling Wu , Ludovic Noels

The key challenge of sequence representation learning is to capture the long-range temporal dependencies. Typical methods for supervised sequence representation learning are built upon recurrent neural networks to capture temporal…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Wenjie Pei , Xin Feng , Canmiao Fu , Qiong Cao , Guangming Lu , Yu-Wing Tai

Gated recurrent units (GRUs) are specialized memory elements for building recurrent neural networks. Despite their incredible success on various tasks, including extracting dynamics underlying neural data, little is understood about the…

Machine Learning · Computer Science 2021-07-30 Ian D. Jordan , Piotr Aleksander Sokol , Il Memming Park

Modelling long-term dependencies is a challenge for recurrent neural networks. This is primarily due to the fact that gradients vanish during training, as the sequence length increases. Gradients can be attenuated by transition operators…

Neural and Evolutionary Computing · Computer Science 2019-02-19 Sarath Chandar , Chinnadhurai Sankar , Eugene Vorontsov , Samira Ebrahimi Kahou , Yoshua Bengio

Memristors have emerged as a promising technology for efficient neuromorphic architectures owing to their ability to act as programmable synapses, combining processing and memory into a single device. Although they are most commonly used…

Emerging Technologies · Computer Science 2024-04-16 Marco Rasetto , Qingzhou Wan , Himanshu Akolkar , Feng Xiong , Bertram Shi , Ryad Benosman

We present a novel graph-informed transformer operator (GITO) architecture for learning complex partial differential equation systems defined on irregular geometries and non-uniform meshes. GITO consists of two main modules: a hybrid graph…

Machine Learning · Computer Science 2025-06-18 Milad Ramezankhani , Janak M. Patel , Anirudh Deodhar , Dagnachew Birru

The exponential growth of edge artificial intelligence demands material-focused solutions to overcome energy consumption and latency limitations when processing real-time temporal data. Physical reservoir computing (PRC) offers an…

Temporal Graph Neural Networks (TGNNs) are powerful models to capture temporal, structural, and contextual information on temporal graphs. The generated temporal node embeddings outperform other methods in many downstream tasks. Real-world…

Hardware Architecture · Computer Science 2022-03-11 Hongkuan Zhou , Bingyi Zhang , Rajgopal Kannan , Viktor Prasanna , Carl Busart

The industrial application motivating this work is the fatigue computation of aircraft engines' high-pressure turbine blades. The material model involves nonlinear elastoviscoplastic behavior laws, for which the parameters depend on the…

Numerical Analysis · Mathematics 2019-08-12 Fabien Casenave , Nissrine Akkari

Accurate short-term energy consumption forecasting is essential for efficient power grid management, resource allocation, and market stability. Traditional time-series models often fail to capture the complex, non-linear dependencies and…

Computers and Society · Computer Science 2026-01-27 Abhishek Maity , Viraj Tukarul

Resistance Random Access Memory (RRAMTM) device, with its electrically induced nanoscale resistive switching capacity, has been gaining considerable attention as future non-volatile memory device. Here, we propose a mechanism of switching…

Wildfire modelling is an attempt to reproduce fire behaviour. Through active fire analysis, it is possible to reproduce a dynamical process, such as wildfires, with limited duration time series data. Recurrent neural networks (RNNs) can…

Machine Learning · Computer Science 2020-05-28 Rylan Perumal , Terence L van Zyl

Recurrent neural networks (RNNs) and transformers have been shown to be Turing-complete, but this result assumes infinite precision in their hidden representations, positional encodings for transformers, and unbounded computation time in…

Computational Complexity · Computer Science 2023-09-27 Ankur Mali , Alexander Ororbia , Daniel Kifer , Lee Giles

To learn useful dynamics on long time scales, neurons must use plasticity rules that account for long-term, circuit-wide effects of synaptic changes. In other words, neural circuits must solve a credit assignment problem to appropriately…

Neurons and Cognition · Quantitative Biology 2019-05-30 Owen Marschall , Kyunghyun Cho , Cristina Savin

Neural network based models have emerged as a powerful tool in multiscale modeling of materials. One promising approach is to use a neural network based model, trained using data generated from repeated solution of an expensive small scale…

Applied Physics · Physics 2024-02-21 Yupeng Zhang , Kaushik Bhattacharya

Built on the tenets of rational thermodynamics, this article proposes a theory of strain gradient thermo-visco-plasticity for isotropic polycrystalline materials under high strain rates. The effect of micro-inertia, which arises due to…

Materials Science · Physics 2016-01-28 Md M Rahaman , A Pathak , D Roy , J N Reddy

Polymer-based plastics exhibit time-dependent deformation under constant stress, known as creep, which can lead to rupture or static fatigue. A common misconception is that materials under tolerable static loads remain unaffected over time.…

Classical Physics · Physics 2025-10-15 José Geraldo Telles Ribeiro , Americo Cunha

Accurate bearing load monitoring is essential for their Prognostics and Health Management (PHM), enabling damage assessment, wear prediction, and proactive maintenance. While bearing sensors are typically placed on the bearing housing,…

Machine Learning · Computer Science 2025-03-07 Mengjie Zhao , Cees Taal , Stephan Baggerohr , Olga Fink

Many glass products require thermoformed geometry with high precision. However, the traditional approach of developing a thermoforming process through trials and errors can cause large waste of time and resources and often end up with…

Computational Engineering, Finance, and Science · Computer Science 2025-05-07 Yuzhou Zhang , Mohan Hua , Jinan Liu , Haihui Ruan