English
Related papers

Related papers: Spectral Selection in Symmetric Self-Attention Dyn…

200 papers

We analyze networked heterogeneous nonlinear systems, with diffusive coupling and interconnected over a generic static directed graph. Due to the network's hetereogeneity, complete synchronization is impossible, in general, but an emergent…

Optimization and Control · Mathematics 2022-06-01 Mohamed Maghenem , Elena Panteley , Antonio Loria

Exactly solvable neural network models with asymmetric weights are rare, and exact solutions are available only in some mean-field approaches. In this article we find exact analytical solutions of an asymmetric spin-glass-like model of…

Neurons and Cognition · Quantitative Biology 2017-02-16 Diego Fasoli , Anna Cattani , Stefano Panzeri

We study a continuum model of overdamped self-propelled particles with an aligning interaction in two dimensions. By combining analytical and numerical work, we map out the phase diagram for generic parameters. We find that the system…

Biological Physics · Physics 2011-12-30 Arvind Gopinath , Michael F. Hagan , M. Cristina Marchetti , Aparna Baskaran

Stability of self-similar solutions for gravitational collapse is an important problem to be investigated from the perspectives of their nature as an attractor, critical phenomena and instability of a naked singularity. In this paper we…

General Relativity and Quantum Cosmology · Physics 2007-05-23 Eiji Mitsuda , Akira Tomimatsu

Large language models hallucinate in predictable ways: attention routing fails by over-concentrating on a narrow set of positions, or by spreading so diffusely that relevance is diluted, and the shape of the failure carries diagnostic…

Machine Learning · Computer Science 2026-05-07 Dominik Dahlem , Diego Maniloff , Mac Misiura

Many biological and synthetic systems are suspensions of oriented, actively-moving components. Unlike in passive suspensions, the interplay between orientational order, active flows, and interactions with boundaries gives rise to…

Soft Condensed Matter · Physics 2024-11-25 Alejandro Martinez-Calvo , Sujit S. Datta

Shape Dynamics is a 3D conformally invariant theory of gravity which possesses a large set of solutions in common with General Relativity. When looked closely, these solutions are found to behave in surprising ways, so in order to probe the…

General Relativity and Quantum Cosmology · Physics 2016-09-14 Daniel C. Guariento , Flavio Mercati

Models of active nematics in biological systems normally require complexity arising from the hydrodynamics involved at the microscopic level as well as the viscoelastic nature of the system. Here we show that a minimal, space-independent,…

Soft Condensed Matter · Physics 2022-06-27 Emmanuel L. C. VI M. Plan , Huong Le Thi , Julia M. Yeomans , Amin Doostmohammadi

Self-attention is a method of encoding sequences of vectors by relating these vectors to each-other based on pairwise similarities. These models have recently shown promising results for modeling discrete sequences, but they are non-trivial…

Computation and Language · Computer Science 2018-06-19 Matthias Sperber , Jan Niehues , Graham Neubig , Sebastian Stüker , Alex Waibel

The symmetric low-rank matrix factorization serves as a building block in many learning tasks, including matrix recovery and training of neural networks. However, despite a flurry of recent research, the dynamics of its training via…

Machine Learning · Computer Science 2024-11-26 Hesameddin Mohammadi , Mohammad Tinati , Stephen Tu , Mahdi Soltanolkotabi , Mihailo R. Jovanović

We study the dynamics of synthetic molecules whose architectures are generated by space transformations from a point group acting on seed resonators. We show that the dynamical matrix of any such molecule can be reproduced as the left…

Mathematical Physics · Physics 2024-11-19 Yuming Zhu , Emil Prodan

We prove an asymptotic stability result for the water wave equations linearized around small solitary waves. The equations we consider govern irrotational flow of a fluid with constant density bounded below by a rigid horizontal bottom and…

Analysis of PDEs · Mathematics 2010-09-03 Robert L. Pego , Shu-Ming Sun

We study the symmetry properties of autonomous integrating factors from an algebraic point of view. The symmetries are delineated for the resulting integrals treated as equations and symmetries of the integrals treated as functions or…

Exactly Solvable and Integrable Systems · Physics 2008-04-24 Sibusiso Moyo , P. G. L. Leach

Biomolecular condensates help organize the cell cytoplasm and nucleoplasm into spatial compartments with different chemical compositions. A key feature of such compositional patterning is the local enrichment of enzymatically active…

Biological Physics · Physics 2024-08-06 Andriy Goychuk , Leonardo Demarchi , Ivan Maryshev , Erwin Frey

The autocorrelation function of pattern fluctuation is used to study soft-mode turbulence (SMT), a spatiotemporal chaos observed in homeotropic nematics. We show that relaxation near the electroconvection threshold deviates from the…

Soft Condensed Matter · Physics 2012-03-27 Fahrudin Nugroho , Takayuki Narumi , Yoshiki Hidaka , Junichi Yoshitani , Masaru Suzuki , Shoichi Kai

The self-attention mechanism (SAM) is widely used in various fields of artificial intelligence and has successfully boosted the performance of different models. However, current explanations of this mechanism are mainly based on intuitions…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Zhongzhan Huang , Mingfu Liang , Jinghui Qin , Shanshan Zhong , Liang Lin

This is a review paper outlining recent progress in the spectral analysis of first order systems. We work on a closed manifold and study an elliptic self-adjoint first order system of linear partial differential equations. The aim is to…

Spectral Theory · Mathematics 2016-12-13 Zhirayr Avetisyan , Yan-Long Fang , Dmitri Vassiliev

In this paper, we consider the spectrum of a model in quantum electrodynamics with a spatial cutoff. It is proven that (1) the Hamiltonian is self-adjoint; (2) under the infrared regularity condition, the Hamiltonian has a unique ground…

Mathematical Physics · Physics 2015-05-13 Toshimitsu Takaesu

In this paper we study a family of controllers that guarantees attitude synchronization for a network of elements in the unit sphere domain, i.e. $\mathcal{S}^2$. We propose distributed continuous controllers for elements whose dynamics are…

Systems and Control · Computer Science 2016-07-07 Pedro O. Pereira , Dimos V. Dimarogonas

We study, analytically and numerically, a simple $\mathcal{PT}$-symmetric tight-binding ring with an onsite energy $a$ at the gain and loss sites. We show that if $a\neq 0$, the system generically exhibits an unbroken…

Quantum Physics · Physics 2021-12-21 Adrian Ortega , Luis Benet , Hernán Larralde