English
Related papers

Related papers: CaMKII activation supports reward-based neural net…

200 papers

Deep Spiking Neural Networks are becoming increasingly powerful tools for cognitive computing platforms. However, most of the existing literature on such computing models are developed with limited insights on the underlying hardware…

Emerging Technologies · Computer Science 2016-08-24 Abhronil Sengupta , Maryam Parsa , Bing Han , Kaushik Roy

This work delves into studying the synchronization in two realistic neuron models using Hodgkin-Huxley dynamics. Unlike simplistic point-like models, excitatory synapses are here randomly distributed along the dendrites, introducing strong…

Neurons and Cognition · Quantitative Biology 2024-09-17 Alessandro Fiasconaro , Michele Migliore

Synaptic plasticity, the dynamic tuning of signal transmission strength between neurons, serves as a fundamental basis for memory and learning in biological organisms. This adaptive nature of synapses is considered one of the key features…

Mesoscale and Nanoscale Physics · Physics 2024-11-11 Yechan Noh , Alex Smolyanitsky

In this work we study, analytically and employing Monte Carlo simulations, the influence of the competition between several activity-dependent synaptic processes, such as short-term synaptic facilitation and depression, on the maximum…

Neurons and Cognition · Quantitative Biology 2010-07-23 Jorge F. Mejias , Joaquin J. Torres

The distinct timescales of synaptic plasticity and neural activity dynamics play an important role in the brain's learning and memory systems. Activity-dependent plasticity reshapes neural circuit architecture, determining spontaneous and…

Neurons and Cognition · Quantitative Biology 2023-06-30 Heather L Cihak , Zachary P Kilpatrick

We consider a classical space-clamped Hodgkin-Huxley model neuron stimulated by synaptic excitation and inhibition with conductances represented by Ornstein-Uhlenbeck processes. Using numerical solutions of the stochastic model system…

Neurons and Cognition · Quantitative Biology 2016-04-19 Henry C. Tuckwell , Susanne Ditlevsen

In this paper, we propose novel learning frameworks to tackle optimal control problems by applying the Pontryagin maximum principle and then solving for a Hamiltonian dynamical system. Applying the Pontryagin maximum principle to the…

Optimization and Control · Mathematics 2024-08-13 Chandrajit Bajaj , Minh Nguyen

Hamilton's equations are fundamental for modeling complex physical systems, where preserving key properties such as energy and momentum is crucial for reliable long-term simulations. Geometric integrators are widely used for this purpose,…

Machine Learning · Computer Science 2026-03-17 Priscilla Canizares , Davide Murari , Carola-Bibiane Schönlieb , Ferdia Sherry , Zakhar Shumaylov

Metaheuristics are stochastic optimization algorithms that mimic natural processes to find optimal solutions to complex problems. The success of metaheuristics largely depends on the ability to effectively explore and exploit the search…

Neural and Evolutionary Computing · Computer Science 2024-11-26 Salar Farahmand-Tabar

Using a realistic model of activity dependent dynamical synapses and a standard integrate and fire neuron model we study, both analytically and numerically, the conditions in which a postsynaptic neuron efficiently detects temporal…

Neurons and Cognition · Quantitative Biology 2007-05-23 Jorge F. Mejias , Joaquin J. Torres

The apparent stochasticity of in-vivo neural circuits has long been hypothesized to represent a signature of ongoing stochastic inference in the brain. More recently, a theoretical framework for neural sampling has been proposed, which…

Neurons and Cognition · Quantitative Biology 2017-03-14 Mihai A. Petrovici , Ilja Bytschok , Johannes Bill , Johannes Schemmel , Karlheinz Meier

The relaxation of stochastic systems after sudden perturbations is constrained by speed limits and often reveals memory effects that hinder attempts to accelerate their dynamics. Here we demonstrate Kovacs-type nonmonotonic relaxation in…

Soft Condensed Matter · Physics 2026-03-16 Miguel Ibáñez , Raúl A. Rica-Alarcón , María L. Jiménez

It is well known that for any finite state Markov decision process (MDP) there is a memoryless deterministic policy that maximizes the expected reward. For partially observable Markov decision processes (POMDPs), optimal memoryless policies…

Optimization and Control · Mathematics 2016-02-16 Guido Montufar , Keyan Ghazi-Zahedi , Nihat Ay

We present a method for enhanced sampling of molecular dynamics simulations using stochastic resetting. Various phenomena, ranging from crystal nucleation to protein folding, occur on timescales that are unreachable in standard simulations.…

Chemical Physics · Physics 2023-02-09 Ofir Blumer , Shlomi Reuveni , Barak Hirshberg

An increasing body of evidence suggests that the trial-to-trial variability of spiking activity in the brain is not mere noise, but rather the reflection of a sampling-based encoding scheme for probabilistic computing. Since the precise…

Neurons in a micro-circuit connected by chemical synapses can have their connectivity affected by the prior activity of the cells. The number of synapses available for releasing neurotransmitter can be decreased by repetitive activation…

Neurons and Cognition · Quantitative Biology 2018-04-09 Elham Bayat Mokhtari , J. Josh Lawrence , Emily F Stone

Molecular dynamics simulations have become essential in many areas of atomistic modelling from drug discovery to materials science. They provide critical atomic-level insights into key dynamical events experiments cannot easily capture.…

Biological Physics · Physics 2024-06-14 Tiejun Wei , Balint Dudas , Edina Rosta

We introduce the Hamiltonian Monte Carlo Particle Swarm Optimizer (HMC-PSO), an optimization algorithm that reaps the benefits of both Exponentially Averaged Momentum PSO and HMC sampling. The coupling of the position and velocity of each…

Machine Learning · Computer Science 2022-06-29 Omatharv Bharat Vaidya , Rithvik Terence DSouza , Snehanshu Saha , Soma Dhavala , Swagatam Das

A new approach for efficiently exploring the configuration space and computing the free energy of large atomic and molecular systems is proposed, motivated by an analogy with reinforcement learning. There are two major components in this…

Chemical Physics · Physics 2018-04-18 Linfeng Zhang , Han Wang , Weinan E

In the mammalian brain, newly acquired memories depend on the hippocampus for maintenance and recall, but over time the neocortex takes over these functions, rendering memories hippocampus-independent. The process responsible for this…

Neurons and Cognition · Quantitative Biology 2021-07-02 Peter Helfer , Thomas R. Shultz