相关论文: Kuramoto Oscillatory Phase Encoding: Neuro-inspire…

Positional encodings are essential to transformer-based generative models, yet their behavior in multimodal and attention-sharing settings is not fully understood. In this work, we present a principled analysis of Rotary Positional…

The Kuramoto model of coupled phase oscillators is often used to describe synchronization phenomena in nature. Some applications, e.g., quantum synchronization and rigid-body attitude synchronization, involve high-dimensional Kuramoto…

Position encoding recently has shown effective in the transformer architecture. It enables valuable supervision for dependency modeling between elements at different positions of the sequence. In this paper, we first investigate various…

Models of learning typically focus on synaptic plasticity. However, learning is the result of both synaptic and myelin plasticity. Specifically, synaptic changes often co-occur and interact with myelin changes, leading to complex dynamic…

Accurately estimating the phase of oscillatory systems is essential for analyzing cyclic activities such as repetitive gestures in human motion. In this work we introduce a learning-based approach for online phase estimation in…

Human language processing relies on the brain's capacity for predictive inference. We present a machine learning framework for decoding neural (EEG) responses to dynamic visual language stimuli in Deaf signers. Using coherence between…

The Transformer architecture has become the foundation of modern deep learning, yet its core self-attention mechanism suffers from quadratic computational complexity and lacks grounding in biological neural computation. We propose Selective…

Rotary Positional Encoding (RoPE) is widely used in modern large language models. However, when sequences are extended beyond the range seen during training, rotary phases can enter out-of-distribution regimes, leading to spurious…

Neurons in the brain communicate information via punctual events called spikes. The timing of spikes is thought to carry rich information, but it is not clear how to leverage this in digital systems. We demonstrate that event-based encoding…

Collective synchronization in a large population of self-sustained units appears both in natural and engineered systems. Sometimes this effect is in demand, while in some cases, it is undesirable, which calls for control techniques. In this…

In this paper, we examined a possibility of preservation of a substantially multimode radiation in a single cell of quantum memory. As a light source we considered a synchronously pumped optical parametric oscillator (SPOPO). As it was…

A class of adaptation functions is found for which a synchronous oscillation mode exists in the network of phase oscillators with triadic couplings. It is shown that the destruction of the synchronous mode occurs differently for networks…

We investigate a generalized Kuramoto phase-oscillator model with Hebb-like couplings that evolve according to a stochastic differential equation on various topologies. Numerical simulations show that even with identical oscillators, there…

The circadian oscillator exhibits remarkably high temporal precision, despite its exposure to several fluctuations. The central mechanism that protects the oscillator from fluctuations is a collective enhancement of precision, where a…

Many motion-centric video analysis tasks, such as atomic actions, detecting atypical motor behavior in individuals with autism, or analyzing articulatory motion in real-time MRI of human speech, require efficient and interpretable temporal…

Federated learning on heterogeneous (non-IID) client data experiences slow convergence due to client drift. To address this challenge, we propose Kuramoto-FedAvg, a federated optimization algorithm that reframes the weight aggregation step…

We study the local synchronization of phases and frequencies for the Kuramoto model driven by rough noise. In particular, we prove exponential convergence towards synchronization and we give the explicit rate of convergence and quantify the…

The sectoral synchronization observed for the Japanese business cycle in the Indices of Industrial Production data is an example of synchronization. The stability of this synchronization under a shock, e.g., fluctuation of supply or demand,…

A wide variety of engineered and natural systems are modelled as networks of coupled nonlinear oscillators. In nature, the intrinsic frequencies of these oscillators are not constant in time. Here, we probe the effect of such a temporal…

An interesting problem in synchronization is the study of coupled oscillators, wherein oscillators with different natural frequencies synchronize to a common frequency and equilibrium phase difference. In this paper, we investigate the…