English
Related papers

Related papers: Diff-E: Diffusion-based Learning for Decoding Imag…

200 papers

In this work, we propose a denoising diffusion generative model (DDGM) trained with healthy electrocardiogram (ECG) data that focuses on ECG morphology and inter-lead dependence. Our results show that this innovative generative model can…

Signal Processing · Electrical Eng. & Systems 2024-01-12 Gabriel V. Cardoso , Lisa Bedin , Josselin Duchateau , Rémi Dubois , Eric Moulines

Diffusion-based generative speech enhancement (SE) has recently received attention, but reverse diffusion remains time-consuming. One solution is to initialize the reverse diffusion process with enhanced features estimated by a predictive…

To investigate how speech is processed in the brain, we can model the relation between features of a natural speech signal and the corresponding recorded electroencephalogram (EEG). Usually, linear models are used in regression tasks.…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-25 Corentin Puffay , Jana Van Canneyt , Jonas Vanthornhout , Hugo Van Hamme , Tom Francart

In this study, we examine the representation learning abilities of Denoising Diffusion Models (DDM) that were originally purposed for image generation. Our philosophy is to deconstruct a DDM, gradually transforming it into a classical…

Computer Vision and Pattern Recognition · Computer Science 2024-01-26 Xinlei Chen , Zhuang Liu , Saining Xie , Kaiming He

Restoring speech communication from neural signals is a central goal of brain-computer interface research, yet EEG-based speech reconstruction remains challenging due to limited spatial resolution, susceptibility to noise, and the absence…

Signal Processing · Electrical Eng. & Systems 2025-12-30 Hanbeot Park , Yunjeong Cho , Hunhee Kim

Light microscopy is a widespread and inexpensive imaging technique facilitating biomedical discovery and diagnostics. However, light diffraction barrier and imperfections in optics limit the level of detail of the acquired images. The…

Quantitative Methods · Quantitative Biology 2026-03-24 Rui Li , Gabriel della Maggiora , Vardan Andriasyan , Anthony Petkidis , Artsemi Yushkevich , Mikhail Kudryashev , Artur Yakimovich

Diffusion Probabilistic Models (DPMs) are powerful generative models that have achieved unparalleled success in a number of generative tasks. In this work, we aim to build inductive biases into the training and sampling of diffusion models…

Machine Learning · Computer Science 2025-03-14 Thomas Jiralerspong , Berton Earnshaw , Jason Hartford , Yoshua Bengio , Luca Scimeca

Token-based language modeling is a prominent approach for speech generation, where tokens are obtained by quantizing features from self-supervised learning (SSL) models and extracting codes from neural speech codecs, generally referred to…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-30 Yang Yang , Yunpeng Li , George Sung , Shao-Fu Shih , Craig Dooley , Alessio Centazzo , Ramanan Rajeswaran

The embedded topic model (ETM) is a widely used approach that assumes the sampled document-topic distribution conforms to the logistic normal distribution for easier optimization. However, this assumption oversimplifies the real…

Computation and Language · Computer Science 2025-01-03 Wei Shao , Mingyang Liu , Linqi Song

Electroencephalography (EEG) decoding is a challenging task due to the limited availability of labelled data. While transfer learning is a promising technique to address this challenge, it assumes that transferable data domains and task are…

Signal Processing · Electrical Eng. & Systems 2023-08-07 Bruno Aristimunha , Raphael Y. de Camargo , Walter H. Lopez Pinaya , Sylvain Chevallier , Alexandre Gramfort , Cedric Rommel

Text-to-image diffusion models have shown powerful ability on conditional image synthesis. With large-scale vision-language pre-training, diffusion models are able to generate high-quality images with rich texture and reasonable structure…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Hefeng Wang , Jiale Cao , Jin Xie , Aiping Yang , Yanwei Pang

An asynchronous Brain--Computer Interface (BCI) based on imagined speech is a tool that allows to control an external device or to emit a message at the moment the user desires to by decoding EEG signals of imagined speech. In order to…

Human-Computer Interaction · Computer Science 2021-05-11 Tonatiuh Hernández-Del-Toro , Carlos A. Reyes-García , Luis Villaseñor-Pineda

Recently, many efforts have been made to explore how the brain processes speech using electroencephalographic (EEG) signals, where deep learning-based approaches were shown to be applicable in this field. In order to decode speech signals…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-24 Qiushi Zhu , Xiaoying Zhao , Jie Zhang , Yu Gu , Chao Weng , Yuchen Hu

Multi-channel EEG signals are commonly used for the diagnosis and assessment of diseases such as epilepsy. Currently, various EEG diagnostic algorithms based on deep learning have been developed. However, most research efforts focus solely…

Signal Processing · Electrical Eng. & Systems 2024-10-24 Zekun Jiang , Wei Dai , Qu Wei , Ziyuan Qin , Kang Li , Le Zhang

Electroencephalographic (EEG) signals are fundamental to neuroscience research and clinical applications such as brain-computer interfaces and neurological disorder diagnosis. These signals are typically a combination of neurological…

Machine Learning · Computer Science 2023-10-27 Matteo Gabardi , Aurora Saibene , Francesca Gasparini , Daniele Rizzo , Fabio Antonio Stella

Diffusion probabilistic models have been shown to generate state-of-the-art results on several competitive image synthesis benchmarks but lack a low-dimensional, interpretable latent space, and are slow at generation. On the other hand,…

Machine Learning · Computer Science 2022-11-30 Kushagra Pandey , Avideep Mukherjee , Piyush Rai , Abhishek Kumar

Deep learning image processing models have had remarkable success in recent years in generating high quality images. Particularly, the Improved Denoising Diffusion Probabilistic Models (DDPM) have shown superiority in image quality to the…

Signal Processing · Electrical Eng. & Systems 2023-05-23 Edmond Adib , Amanda Fernandez , Fatemeh Afghah , John Jeff Prevost

Endoscopic Submucosal Dissection (ESD) is a well-established technique for removing epithelial lesions. Predicting dissection trajectories in ESD videos offers significant potential for enhancing surgical skill training and simplifying the…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Hongyu Wang , Yonghao Long , Yueyao Chen , Hon-Chi Yip , Markus Scheppach , Philip Wai-Yan Chiu , Yeung Yam , Helen Mei-Ling Meng , Qi Dou

Based on the Denoising Diffusion Probabilistic Model (DDPM), medical image segmentation can be described as a conditional image generation task, which allows to compute pixel-wise uncertainty maps of the segmentation and allows an implicit…

Image and Video Processing · Electrical Eng. & Systems 2022-11-01 Xutao Guo , Yanwu Yang , Chenfei Ye , Shang Lu , Yang Xiang , Ting Ma

The generation of emotional talking faces from a single portrait image remains a significant challenge. The simultaneous achievement of expressive emotional talking and accurate lip-sync is particularly difficult, as expressiveness is often…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Chenxu Zhang , Chao Wang , Jianfeng Zhang , Hongyi Xu , Guoxian Song , You Xie , Linjie Luo , Yapeng Tian , Xiaohu Guo , Jiashi Feng