Related papers: PIXHELL: When Pixels Learn to Scream
CLIP is a discriminative model trained to align images and text in a shared embedding space. Due to its multimodal structure, it serves as the backbone of many generative pipelines, where a decoder is trained to map from the shared space…
It has been recently observed that synthetic materials subjected to an external elastic stress give rise to scaling phenomena in the acoustic emission signal. Motivated by this experimental finding we develop a mesoscopic model in order to…
Existing video generation models excel at producing photo-realistic videos from text or images, but often lack physical plausibility and 3D controllability. To overcome these limitations, we introduce PhysCtrl, a novel framework for…
This paper proposes a new research direction for the large family of instrumental musical interfaces where sound is generated using digital granular synthesis, and where interaction and control involve the (fine) operation of stiff, flat…
CVD diamond is an attractive material option for LHC vertex detectors because of its strong radiation-hardness causal to its large band gap and strong lattice. In particular, pixel detectors operating close to the interaction point profit…
Data-driven approaches hold promise for audio captioning. However, the development of audio captioning methods can be biased due to the limited availability and quality of text-audio data. This paper proposes a SynthAC framework, which…
Sonic crystal acoustic screens have been in progressive research and development in the last two decades as a technical solution for mitigating traffic noise. Their behaviour is quite different from that observed in classical barriers, with…
This paper introduces a system that learns to sing new tunes by listening to examples. It extracts sequencing rules from input music and uses these rules to generate new tunes, which are sung by a vocal synthesiser. We developed a method to…
We introduce multilayer structures based on phase-change materials for reconfigurable structural color generation. These structures can produce multiple distinct colors within a single pixel. Specifically, we design structures that generate…
We suggest a rasterization pipeline tailored towards the need of head-mounted displays (HMD), where latency and field-of-view requirements pose new challenges beyond those of traditional desktop displays. Instead of rendering and warping…
Latent representation learning has been an active field of study for decades in numerous applications. Inspired among others by the tokenization from Natural Language Processing and motivated by the research of a simple data representation,…
We experimentally demonstrate the use of a novel liquid state, whispering-gallery-mode optical resonator as a highly sensitive humidity sensor. The optical resonator used consists of a droplet made of glycerol, a transparent liquid that…
Nearly all 3D displays need calibration for correct rendering. More often than not, the optical elements in a 3D display are misaligned from the designed parameter setting. As a result, 3D magic does not perform well as intended. The…
Current vision systems are trained on huge datasets, and these datasets come with costs: curation is expensive, they inherit human biases, and there are concerns over privacy and usage rights. To counter these costs, interest has surged in…
Foley sound generation, the art of creating audio for multimedia, has recently seen notable advancements through text-conditioned latent diffusion models. These systems use multimodal text-audio representation models, such as Contrastive…
Event cameras are a new type of sensors that are different from traditional cameras. Each pixel is triggered asynchronously by event. The trigger event is the change of the brightness irradiated on the pixel. If the increment or decrement…
The safety of children in children home has become an increasing social concern, and the purpose of this experiment is to use machine learning applied to detect the scenarios of child abuse to increase the safety of children. This…
Speaker recognition is a biometric modality that uses underlying speech information to determine the identity of the speaker. Speaker Identification (SID) under noisy conditions is one of the challenging topics in the field of speech…
Realistic simulation is critical for applications ranging from robotics to animation. Traditional analytic simulators sometimes struggle to capture sufficiently realistic simulation which can lead to problems including the well known…
Acoustic levitation provides a unique method for manipulating small particles as it completely evades effects from gravity, container walls, or physical handling. These advantages make it a tantalizing platform for studying complex…