English
Related papers

Related papers: On reaction network implementations of neural netw…

200 papers

A central challenge in neuroscience is to understand neural computations and circuit mechanisms that underlie the encoding of ethologically relevant, natural stimuli. In multilayered neural circuits, nonlinear processes such as synaptic…

Neurons and Cognition · Quantitative Biology 2017-02-09 Lane T. McIntosh , Niru Maheswaranathan , Aran Nayebi , Surya Ganguli , Stephen A. Baccus

This work addresses multistationarity of fully open reaction networks equipped with mass action kinetics. We improve upon the existing results relating existence of positive feedback loops in a reaction network and multistationarity; and we…

Molecular Networks · Quantitative Biology 2025-11-11 Shenghao Yao , AmirHosein Sadeghimanesh , Matthew England

For any given neural network architecture a permutation of weights and biases results in the same functional network. This implies that optimization algorithms used to `train' or `learn' the network are faced with a very large number (in…

Optimization and Control · Mathematics 2022-02-22 Harbir Antil , Thomas S. Brown , Rainald Löhner , Fumiya Togashi , Deepanshu Verma

Mathematical modelling has traditionally relied on detailed system knowledge to construct mechanistic models. However, the advent of large-scale data collection and advances in machine learning have led to an increasing use of data-driven…

Dynamical Systems · Mathematics 2025-10-17 Torkel E Loman , Ruth E Baker

Information processing relying on biochemical interactions in the cellular environment is essential for biological organisms. The implementation of molecular computational systems holds significant interest and potential in the fields of…

Dynamical Systems · Mathematics 2023-12-01 Yuzhen Fan , Xiaoyu Zhang , Chuanhou Gao , Denis Dochain

Ordinary differential equation (ODE) is widely used in modeling biological and physical processes in science. In this article, we propose a new reproducing kernel-based approach for estimation and inference of ODE given noisy observations.…

Methodology · Statistics 2021-10-26 Xiaowu Dai , Lexin Li

With edge-AI finding an increasing number of real-world applications, especially in industry, the question of functionally safe applications using AI has begun to be asked. In this body of work, we explore the issue of achieving dependable…

Machine Learning · Computer Science 2021-08-06 Hans Dermot Doran , Gianluca Ielpo , David Ganz , Michael Zapke

Machine learning techniques applied to chemical reactions has a long history. The present contribution discusses applications ranging from small molecule reaction dynamics to platforms for reaction planning. ML-based techniques can be of…

Chemical Physics · Physics 2021-01-12 M. Meuwly

Self Normalizing Neural Networks(SNN) proposed on Feed Forward Neural Networks(FNN) outperform regular FNN architectures in various machine learning tasks. Particularly in the domain of Computer Vision, the activation function Scaled…

Computation and Language · Computer Science 2019-05-07 Avinash Madasu , Vijjini Anvesh Rao

The accurate prediction of biological features from genomic data is paramount for precision medicine and sustainable agriculture. For decades, neural network models have been widely popular in fields like computer vision, astrophysics and…

Genomics · Quantitative Biology 2022-03-15 Zhaoyi Zhang , Songyang Cheng , Claudia Solis-Lemus

In spite of finite dimension ReLU neural networks being a consistent factor behind recent deep learning successes, a theory of feature learning in these models remains elusive. Currently, insightful theories still rely on assumptions…

Machine Learning · Computer Science 2025-04-01 Devon Jarvis , Richard Klein , Benjamin Rosman , Andrew M. Saxe

The construction of a reaction network containing all relevant intermediates and elementary reactions is necessary for the accurate description of chemical processes. In the case of a complex chemical reaction (involving, for instance, many…

Chemical Physics · Physics 2017-12-19 Gregor N. Simm , Markus Reiher

Chemical reaction network theory is a powerful framework to describe and analyze chemical systems. While much about the concentration profile in an equilibrium state can be determined in terms of the graph structure, the overall reaction's…

Molecular Networks · Quantitative Biology 2024-02-29 Tomoharu Suda

Thermodynamic constraints on reactions directions are inherent in the structure of a given biochemical network. However, concrete procedures for determining feasible reaction directions for large-scale metabolic networks are not well…

Molecular Networks · Quantitative Biology 2007-05-23 Feng Yang , Feng Qi , Daniel A. Beard

Recurrent Neural Networks (RNNs) are very successful at solving challenging problems with sequential data. However, this observed efficiency is not yet entirely explained by theory. It is known that a certain class of multiplicative RNNs…

Machine Learning · Computer Science 2019-01-31 Valentin Khrulkov , Oleksii Hrinchuk , Ivan Oseledets

We explore the phase diagram of approximation rates for deep neural networks and prove several new theoretical results. In particular, we generalize the existing result on the existence of deep discontinuous phase in ReLU networks to…

Neural and Evolutionary Computing · Computer Science 2021-01-07 Dmitry Yarotsky , Anton Zhevnerchuk

Implicit neural networks have become increasingly attractive in the machine learning community since they can achieve competitive performance but use much less computational resources. Recently, a line of theoretical works established the…

Machine Learning · Computer Science 2022-10-03 Tianxiang Gao , Hongyang Gao

The automated inference of physically interpretable (bio)chemical reaction network models from measured experimental data is a challenging problem whose solution has significant commercial and academic ramifications. It is demonstrated,…

Neural and Evolutionary Computing · Computer Science 2014-12-22 Dominic P. Searson , Mark J. Willis , Allen Wright

We present a Fourier neural network (FNN) that can be mapped directly to the Fourier decomposition. The choice of activation and loss function yields results that replicate a Fourier series expansion closely while preserving a…

Machine Learning · Computer Science 2021-04-30 Marieme Ngom , Oana Marin

Recently, Neural Networks have been proven extremely effective in many natural language processing tasks such as sentiment analysis, question answering, or machine translation. Aiming to exploit such advantages in the Ontology Learning…

Computation and Language · Computer Science 2016-07-15 Giulio Petrucci , Chiara Ghidini , Marco Rospocher