English
Related papers

Related papers: SIREM: Speech-Informed MRI Reconstruction with Lea…

200 papers

Perfusion-weighted magnetic resonance imaging (MRI) is an imaging technique that allows one to measure tissue perfusion in an organ of interest through the injection of an intravascular paramagnetic contrast agent (CA). Due to a preference…

Computer Vision and Pattern Recognition · Computer Science 2017-08-28 Cagdas Ulas , Christine Preibisch , Jonathan Sperl , Thomas Pyka , Jayashree Kalpathy-Cramer , Bjoern Menze

Multi-speaker automatic speech recognition (ASR) aims to transcribe conversational speech involving multiple speakers, requiring the model to capture not only what was said, but also who said it and sometimes when it was spoken. Recent…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-27 Li Li , Ming Cheng , Weixin Zhu , Yannan Wang , Juan Liu , Ming Li

Automatic speech recognition (ASR) on multi-talker recordings is challenging. Current methods using 3D spatial data from multi-channel audio and visual cues focus mainly on direct waves from the target speaker, overlooking reflection wave…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-13 Yiwen Shao , Shi-Xiong Zhang , Dong Yu

Ultrasound (US) is a widely used medical imaging modality due to its real-time capabilities, non-invasive nature, and cost-effectiveness. Robotic ultrasound can further enhance its utility by reducing operator dependence and improving…

Multi-contrast Magnetic Resonance Imaging super-resolution (MC-MRI SR) aims to enhance low-resolution (LR) contrasts leveraging high-resolution (HR) references, shortening acquisition time and improving imaging efficiency while preserving…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Xiaoman Wu , Lubin Gan , Siying Wu , Jing Zhang , Yunwei Ou , Xiaoyan Sun

Non-invasive decoding of imagined speech remains challenging due to weak, distributed signals and limited labeled data. Our paper introduces an image-based approach that transforms magnetoencephalography (MEG) signals into time-frequency…

Computation and Language · Computer Science 2026-01-23 Soufiane Jhilal , Stéphanie Martin , Anne-Lise Giraud

Diffusion magnetic resonance imaging (dMRI) enables non-invasive investigation of tissue microstructure. The Standard Model (SM) of white matter aims to disentangle dMRI signal contributions from intra- and extra-axonal water compartments.…

Image and Video Processing · Electrical Eng. & Systems 2026-04-15 Tom Hendriks , Gerrit Arends , Edwin Versteeg , Anna Vilanova , Maxime Chamberland , Chantal M. W. Tax

The reconstruction of 3D cine-MRI is challenged by highly undersampled k-space data in each cine frame, due to the slow speed of MR signal acquisition. We proposed a machine learning-based framework, spatial and temporal implicit neural…

Medical Physics · Physics 2023-08-22 Hua-Chieh Shao , Tielige Mengke , Jie Deng , You Zhang

Multi-site MRI studies often suffer from site-specific variations arising from differences in methodology, hardware, and acquisition protocols, thereby compromising accuracy and reliability in clinical AI/ML tasks. We present PRISM…

Image and Video Processing · Electrical Eng. & Systems 2024-11-12 Sarang Galada , Tanurima Halder , Kunal Deo , Ram P Krish , Kshitij Jadhav

Recent advances in speech-aware language models have coupled strong acoustic encoders with large language models, enabling systems that move beyond transcription to produce richer outputs. Among these, word-level timestamp prediction is…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-28 Xulin Fan , Vishal Sunder , Samuel Thomas , Mark Hasegawa-Johnson , Brian Kingsbury , George Saon

In this paper, we present EH-MAM (Easy-to-Hard adaptive Masked Acoustic Modeling), a novel self-supervised learning approach for speech representation learning. In contrast to the prior methods that use random masking schemes for Masked…

Sound · Computer Science 2024-10-18 Ashish Seth , Ramaneswaran Selvakumar , S Sakshi , Sonal Kumar , Sreyan Ghosh , Dinesh Manocha

Supervised learning methods have shown effectiveness in estimating spatial acoustic parameters such as time difference of arrival, direct-to-reverberant ratio and reverberation time. However, they still suffer from the simulation-to-reality…

Sound · Computer Science 2024-09-10 Bing Yang , Xiaofei Li

Undersampling is a common method in Magnetic Resonance Imaging (MRI) to subsample the number of data points in k-space, reducing acquisition times at the cost of decreased image quality. A popular approach is to employ undersampling…

Image and Video Processing · Electrical Eng. & Systems 2023-08-23 Tobias Weber , Michael Ingrisch , Bernd Bischl , David Rügamer

The tongue's intricate 3D structure, comprising localized functional units, plays a crucial role in the production of speech. When measured using tagged MRI, these functional units exhibit cohesive displacements and derived quantities that…

Medical vision-language pre-training shows great potential in learning representative features from massive paired radiographs and reports. However, in computed tomography (CT) scans, the distribution of lesions which contain intricate…

Computer Vision and Pattern Recognition · Computer Science 2025-09-11 Rongsheng Wang , Fenghe Tang , Qingsong Yao , Rui Yan , Xu Zhang , Zhen Huang , Haoran Lai , Zhiyang He , Xiaodong Tao , Zihang Jiang , Shaohua Kevin Zhou

The diverse perceptual consequences of hearing loss severely impede speech communication, but standard clinical audiometry, which is focused on threshold-based frequency sensitivity, does not adequately capture deficits in frequency and…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-31 Xiajie Zhou , Candy Olivia Mawalim , Masashi Unoki

Automatic speech recognition (ASR) systems normally consist of an acoustic model (AM) and a language model (LM). The acoustic model estimates the probability distribution of text given the input speech, while the language model calibrates…

Computation and Language · Computer Science 2025-06-17 Qingliang Meng , Pengju Ren , Tian Li , Changsong Dai , Huizhi Liang

Summary: SAMRI is an MRI-specialized adaptation of the Segment Anything Model achieving superior whole-body MRI segmentation, particularly for small and clinically critical structures, through box and point prompts for rapid annotation.…

Image and Video Processing · Electrical Eng. & Systems 2026-05-19 Zhao Wang , Wei Dai , Thuy Thanh Dao , Steffen Bollmann , Hongfu Sun , Craig Engstrom , Shekhar S. Chandra

Multimodal Large Language Models (MLLMs) have shown remarkable success in comprehension tasks such as visual description and visual question answering. However, their direct application to embedding-based tasks like retrieval remains…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Lihao Liu , Yan Wang , Biao Yang , Da Li , Jiangxia Cao , Yuxiao Luo , Xiang Chen , Xiangyu Wu , Wei Yuan , Fan Yang , Guiguang Ding , Tingting Gao , Guorui Zhou

The recent development of deep learning combined with compressed sensing enables fast reconstruction of undersampled MR images and has achieved state-of-the-art performance for Cartesian k-space trajectories. However, non-Cartesian…

Image and Video Processing · Electrical Eng. & Systems 2022-07-26 Chang Gao , Shu-Fu Shih , J. Paul Finn , Xiaodong Zhong