English
Related papers

Related papers: Learning Two-input Linear and Nonlinear Analog Fun…

200 papers

Nonlinear photonic delay systems present interesting implementation platforms for machine learning models. They can be extremely fast, offer great degrees of parallelism and potentially consume far less power than digital processors. So far…

Neural and Evolutionary Computing · Computer Science 2016-03-24 Michiel Hermans , Miguel Soriano , Joni Dambre , Peter Bienstman , Ingo Fischer

The behavior of living systems is based on the experience they gained through their interactions with the environment [1]. This experience is stored in the complex biochemical networks of cells and organisms to provide a relationship…

Soft Condensed Matter · Physics 2022-02-14 Santiago Muiños-Landin , Keyan Ghazi-Zahedi , Frank Cichos

Transformers demonstrate significant advantages as the building block of modern LLMs. In this work, we study the capacities of Transformers in performing unsupervised learning. We show that multi-layered Transformers, given a sufficiently…

Machine Learning · Statistics 2025-01-14 Yihan He , Yuan Cao , Hong-Yu Chen , Dennis Wu , Jianqing Fan , Han Liu

In complex systems, we often observe complex global behavior emerge from a collection of agents interacting with each other in their environment, with each individual agent acting only on locally available information, without knowing the…

Neural and Evolutionary Computing · Computer Science 2021-09-30 Yujin Tang , David Ha

Recent technological advances allow us to view chemical mass-action systems as analog computers. In this context, the inputs to a computation are encoded as initial values of certain chemical species while the outputs are the limiting…

Dynamical Systems · Mathematics 2024-11-21 David F. Anderson , Badal Joshi

Dynamical systems can autonomously adapt their organization so that the required target dynamics is reproduced. In the previous Rapid Communication [Phys. Rev. E 90,030901(R) (2014)], it was shown how such systems can be designed using…

Adaptation and Self-Organizing Systems · Physics 2016-11-04 Pablo Kaluza , Alexander S. Mikhailov

On-line and batch learning of a perceptron in a discrete weight space, where each weight can take $2 L+1$ different values, are examined analytically and numerically. The learning algorithm is based on the training of the continuous…

Statistical Mechanics · Physics 2009-11-07 Michal Rosen-Zvi , Ido Kanter

This paper exhibits the closed-loop design constraints using the non-analytic function theory. First, the paper generalizes the sensitivity integral for linear feedback systems with the non-analytic sensitivity function. Sensitivity…

Optimization and Control · Mathematics 2019-11-19 Shaival Nagarsheth , Shambhu Nath Sharma

This work proposes a new method for simultaneous probabilistic identification and control of an observable, fully-actuated mechanical system. Identification is achieved by conditioning stochastic process priors on observations of…

Machine Learning · Computer Science 2014-04-02 Jan-Peter Calliess , Antonis Papachristodoulou , Stephen J. Roberts

Machine learning algorithms, and more in particular neural networks, arguably experience a revolution in terms of performance. Currently, the best systems we have for speech recognition, computer vision and similar problems are based on…

Neural and Evolutionary Computing · Computer Science 2015-10-07 Michiel Hermans , Michaël Burm , Joni Dambre , Peter Bienstman

This paper explores learning emulators for parameter estimation with uncertainty estimation of high-dimensional dynamical systems. We assume access to a computationally complex simulator that inputs a candidate parameter and outputs a…

Machine Learning · Computer Science 2022-11-04 Ruoxi Jiang , Rebecca Willett

Model-based Reinforcement Learning and Control have demonstrated great potential in various sequential decision making problem domains, including in robotics settings. However, real-world robotics systems often present challenges that limit…

Machine Learning · Computer Science 2023-10-24 Achkan Salehi , Steffen Rühl , Stephane Doncieux

We present the perceptor gradients algorithm -- a novel approach to learning symbolic representations based on the idea of decomposing an agent's policy into i) a perceptor network extracting symbols from raw observation data and ii) a task…

Machine Learning · Computer Science 2019-05-06 Svetlin Penkov , Subramanian Ramamoorthy

While learning from synthetic training data has recently gained an increased attention, in real-world robotic applications, there are still performance deficiencies due to the so-called Sim-to-Real gap. In practice, this gap is hard to…

Robotics · Computer Science 2022-08-02 Jianxiang Feng , Jongseok Lee , Maximilian Durner , Rudolph Triebel

We design and model a single-layer, passive, all-optical silicon photonics neural network to mitigate optical link nonlinearities. The network nodes are formed by silicon microring resonators whose transfer function has been experimentally…

Signal Processing · Electrical Eng. & Systems 2021-03-01 Mattia Mancinelli , Paolo Bettotti , Lorenzo Pavesi

We demonstrate that it is possible to implement a quantum perceptron with a sigmoid activation function as an efficient, reversible many-body unitary operation. When inserted in a neural network, the perceptron's response is parameterized…

Quantum Physics · Physics 2019-03-20 E. Torrontegui , J. J. Garcia-Ripoll

Analogy is a central faculty of human intelligence, enabling abstract patterns discovered in one domain to be applied to another. Despite its central role in cognition, the mechanisms by which Transformers acquire and implement analogical…

Artificial Intelligence · Computer Science 2026-05-28 Gouki Minegishi , Jingyuan Feng , Hiroki Furuta , Takeshi Kojima , Yusuke Iwasawa , Yutaka Matsuo

The behavior of an atom in a molecule, liquid or solid is governed by the force it experiences. If the dependence of this vectorial force on the atomic chemical environment can be $learned$ efficiently with high-fidelity from benchmark…

Materials Science · Physics 2015-10-28 Venkatesh Botu , Rampi Ramprasad

The concept of a recently proposed Forward-Forward learning algorithm for fully connected artificial neural networks is applied to a single multi output perceptron for classification. The parameters of the system are trained with respect to…

Machine Learning · Computer Science 2023-04-07 K. Fredrik Karlsson

The thermal cis-trans isomerization around the C$_{13}$=C$_{14}$ double bond of retinal is a prototypical high-barrier reaction whose mechanism hinges on subtle out-of-plane bending motions. We apply Artificial Intelligence for Molecular…