相关论文: Sound and motion in the De Generatione Sonorum, a …

To investigate how the auditory system processes natural speech, models have been created to relate the electroencephalography (EEG) signal of a person listening to speech to various representations of the speech. Mainly the speech envelope…

Simulation of human motion is the subject of study in a number of disciplines: Biomechanics, Robotics, Computer Animation, Control Theory, Neurophysiology, Medicine, Ergonomics. Since the author has never visited any of these fields, this…

Unlike phoneme sequences, movements of speech articulators (lips, tongue, jaw, velum) and the resultant acoustic signal are known to encode not only the linguistic message but also carry para-linguistic information. While several works…

We are interested in stationary "fluid" random evolutions with independent increments. Under some mild assumptions, we show they are solutions of a stochastic differential equation (SDE). There are situations where these evolutions are not…

Grammatical forms are said to evolve via two main mechanisms. These are, respectively, the `descent' mechanism, where current forms can be seen to have descended (albeit with occasional modifications) from their roots in ancient languages,…

Recent motion-language models unify tasks like comprehension and generation but operate at a coarse granularity, lacking fine-grained understanding and nuanced control over body parts needed for animation or interaction. This stems from…

This paper consider the functional mechanics as one of modern approaches to a problem of the correspondence between classical mechanics and the statistical physics. Deviations from classical trajectories are calculated and evolution of the…

Generation of non-Gaussian quantum states of macroscopic mechanical objects is key to a number of challenges in quantum information science, ranging from fundamental tests of decoherence to quantum communication and sensing. Heralded…

Motion simulators are widely employed in basic and applied research to study the neural mechanisms of perception and action under inertial stimulations. In these studies, uncontrolled simulator-introduced noise inevitably leads to a…

Motion, speech, and sound effects are fundamental elements of human-centric videos, yet their heterogeneous temporal characteristics make joint generation highly challenging. Existing audio-video generation models often fail to maintain…

Negotiations are a formalism for describing multiparty distributed cooperation. Alternatively, they can be seen as a model of concurrency with synchronized choice as communication primitive. Well-designed negotiations must be sound, meaning…

The spring-mass system studied in undergraduate physics laboratories may show complex dynamics due to the simultaneous action of gravitational, elastic, and torsional forces, in addition to air friction. In this paper, we describe a…

The images and sounds that we perceive undergo subtle but geometrically consistent changes as we rotate our heads. In this paper, we use these cues to solve a problem we call Sound Localization from Motion (SLfM): jointly estimating camera…

Phonology is the systematic study of the sounds used in language, their internal structure, and their composition into syllables, words and phrases. Computational phonology is the application of formal and computational techniques to the…

Recent advances in machine learning and the availability of articulatory datasets allow vocal tract synthesis to be conditioned on phonetic sequences, a primary task of articulatory speech synthesis. However, quality assessment needs a…

This article provides a gentle introduction for a general mathematical audience to the factorization theory of motion polynomials and its application in mechanism science. This theory connects in a rather unexpected way a seemingly abstract…

In the present paper, we investigate the properties of the sound generated by rubbing two objects. It is clear that the sound is generated because of the rubbing between the contacting rough surfaces of the objects. A model is presented to…

Rowmotion is a simple cyclic action on the distributive lattice of order ideals of a poset: it sends the order ideal x to the order ideal generated by the minimal elements not in x. It can also be computed in "slow motion" as a sequence of…

Recent advances in interactive technologies have highlighted the prominence of audio signals for semantic encoding. This paper explores a new task, where audio signals are used as conditioning inputs to generate motions that align with the…

In this article indicators to describe the "beauty" of noises are proposed. Rhythmic, tonal and harmonic suavity are introduced. They give a characterization of a noise in terms of rhythmic regularity (rhythmic suavity), of auditory…