English
Related papers

Related papers: Multimodal Deep Learning Method for Real-Time Spat…

200 papers

Recent work shows that reinforcement learning(RL) can markedly sharpen the reasoning ability of large language models (LLMs) by prompting them to "think before answering." Yet whether and how these gains transfer to audio-language reasoning…

Computation and Language · Computer Science 2025-04-30 Cheng Wen , Tingwei Guo , Shuaijiang Zhao , Wei Zou , Xiangang Li

Prediction of room impulse responses (RIRs) is essential for room acoustics, spatial audio, and immersive applications, yet conventional simulations and measurements remain computationally expensive and time-consuming. This work proposes a…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-30 Imran Muhammad , Gerald Schuller

Diffusion magnetic resonance imaging (dMRI) often suffers from low spatial and angular resolution due to inherent limitations in imaging hardware and system noise, adversely affecting the accurate estimation of microstructural parameters…

Image and Video Processing · Electrical Eng. & Systems 2025-01-28 Ruoyou Wu , Jian Cheng , Cheng Li , Juan Zou , Wenxin Fan , Hua Guo , Yong Liang , Shanshan Wang

Can machines recording an audio-visual scene produce realistic, matching audio-visual experiences at novel positions and novel view directions? We answer it by studying a new task -- real-world audio-visual scene synthesis -- and a…

Computer Vision and Pattern Recognition · Computer Science 2023-10-17 Susan Liang , Chao Huang , Yapeng Tian , Anurag Kumar , Chenliang Xu

This article discusses a newly developed online manifold learning method, subspace iteration using reduced models (SIRM), for the dimensionality reduction of dynamical systems. This method may be viewed as subspace iteration combined with a…

Dynamical Systems · Mathematics 2014-07-24 Liqian Peng , Kamran Mohseni

An environment acoustic model represents how sound is transformed by the physical characteristics of an indoor environment, for any given source/receiver location. Traditional methods for constructing acoustic models involve expensive and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Arjun Somayazulu , Sagnik Majumder , Changan Chen , Kristen Grauman

We present a novel neural surface reconstruction method called NeuralRoom for reconstructing room-sized indoor scenes directly from a set of 2D images. Recently, implicit neural representations have become a promising way to reconstruct…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Yusen Wang , Zongcheng Li , Yu Jiang , Kaixuan Zhou , Tuo Cao , Yanping Fu , Chunxia Xiao

In this work, we investigate the use of spatio-temporalImplicit Neural Representations (INRs) for dynamic X-ray computed tomography (XCT) reconstruction under interlaced acquisition schemes. The proposed approach combines ADMM-based…

Image and Video Processing · Electrical Eng. & Systems 2025-10-13 Mathias Boulanger , Ericmoore Jossou

We introduce an Invertible Symbolic Regression (ISR) method. It is a machine learning technique that generates analytical relationships between inputs and outputs of a given dataset via invertible maps (or architectures). The proposed ISR…

Machine Learning · Computer Science 2024-05-14 Tony Tohme , Mohammad Javad Khojasteh , Mohsen Sadr , Florian Meyer , Kamal Youcef-Toumi

Parallel imaging is a widely-used technique to accelerate magnetic resonance imaging (MRI). However, current methods still perform poorly in reconstructing artifact-free MRI images from highly undersampled k-space data. Recently, implicit…

Image and Video Processing · Electrical Eng. & Systems 2022-10-20 Ruimin Feng , Qing Wu , Yuyao Zhang , Hongjiang Wei

Learned Sparse Retrieval (LSR) is a group of neural methods designed to encode queries and documents into sparse lexical vectors. These vectors can be efficiently indexed and retrieved using an inverted index. While LSR has shown promise in…

Information Retrieval · Computer Science 2024-02-13 Thong Nguyen , Mariya Hendriksen , Andrew Yates

Deep learning models have a risk of utilizing spurious clues to make predictions, such as recognizing actions based on the background scene. This issue can severely degrade the open-set action recognition performance when the testing…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Yuanhao Zhai , Ziyi Liu , Zhenyu Wu , Yi Wu , Chunluan Zhou , David Doermann , Junsong Yuan , Gang Hua

Super-resolution (SR) models in cosmological simulations use deep learning (DL) to rapidly enhance low-resolution (LR) runs with statistically correct fine details. These models preserves large-scale structures by conditioning on an LR…

Cosmology and Nongalactic Astrophysics · Physics 2025-02-13 Xiaowen Zhang , Patrick Lachance , Ankita Dasgupta , Rupert A. C. Croft , Tiziana Di Matteo , Yueying Ni , Simeon Bird , Yin Li

The use of spatial information with multiple microphones can improve far-field automatic speech recognition (ASR) accuracy. However, conventional microphone array techniques degrade speech enhancement performance when there is an array…

Audio and Speech Processing · Electrical Eng. & Systems 2021-12-23 Kenichi Kumatani , Minhua Wu , Shiva Sundaram , Nikko Strom , Bjorn Hoffmeister

Despite the remarkable progresses made in deep-learning based depth map super-resolution (DSR), how to tackle real-world degradation in low-resolution (LR) depth maps remains a major challenge. Existing DSR model is generally trained and…

Computer Vision and Pattern Recognition · Computer Science 2020-06-03 Xibin Song , Yuchao Dai , Dingfu Zhou , Liu Liu , Wei Li , Hongdng Li , Ruigang Yang

Diffusion magnetic resonance imaging (dMRI) enables non-invasive investigation of tissue microstructure. The Standard Model (SM) of white matter aims to disentangle dMRI signal contributions from intra- and extra-axonal water compartments.…

Image and Video Processing · Electrical Eng. & Systems 2026-04-15 Tom Hendriks , Gerrit Arends , Edwin Versteeg , Anna Vilanova , Maxime Chamberland , Chantal M. W. Tax

In this paper, we present a deep learning-based reduced-order model (DL-ROM) for the stability prediction of unsteady 3D fluid-structure interaction systems. The proposed DL-ROM has the format of a nonlinear state-space model and employs a…

Fluid Dynamics · Physics 2021-12-21 A. Chizfahm , R. Jaiman

We propose SIR, an efficient method to decompose differentiable shadows for inverse rendering on indoor scenes using multi-view data, addressing the challenges in accurately decomposing the materials and lighting conditions. Unlike previous…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Xiaokang Wei , Zhuoman Liu , Ping Li , Yan Luximon

Diffusion-weighted magnetic resonance imaging (DW-MRI) can be used to characterise the microstructure of the nervous tissue, e.g. to delineate brain white matter connections in a non-invasive manner via fibre tracking. Magnetic Resonance…

Sound event localization and detection (SELD) is an important task in machine listening. Major advancements rely on simulated data with sound events in specific rooms and strong spatio-temporal labels. SELD data is simulated by convolving…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-24 Iran R. Roman , Christopher Ick , Sivan Ding , Adrian S. Roman , Brian McFee , Juan P. Bello