English
Related papers

Related papers: Room Impulse Response Generation Conditioned on Ac…

200 papers

Pre-defined 3D object templates are widely used in 3D reconstruction of hand-object interactions. However, they often require substantial manual efforts to capture or source, and inherently restrict the adaptability of models to…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Yiyao Huang , Zhedong Zheng , Yu Ziwei , Yaxiong Wang , Tze Ho Elden Tse , Angela Yao

In recent years, image generation has shown a great leap in performance, where diffusion models play a central role. Although generating high-quality images, such models are mainly conditioned on textual descriptions. This begs the…

Sound · Computer Science 2023-05-23 Guy Yariv , Itai Gat , Lior Wolf , Yossi Adi , Idan Schwartz

Generative diffusion models (DM) have been extensively utilized in image super-resolution (ISR). Most of the existing methods adopt the denoising loss from DDPMs for model optimization. We posit that introducing reward feedback learning to…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Xiaopeng Sun , Qinwei Lin , Yu Gao , Yujie Zhong , Chengjian Feng , Dengjie Li , Zheng Zhao , Jie Hu , Lin Ma

In this work, we consider the problem of jointly estimating a set of room impulse responses (RIRs) corresponding to closely spaced microphones. The accurate estimation of RIRs is crucial in acoustic applications such as speech enhancement,…

Audio and Speech Processing · Electrical Eng. & Systems 2025-03-19 Rumeshika Pallewela , Yuyang Liu , Filip Elvander

Quick simulations for iterative evaluations of multi-design variables and boundary conditions are essential to find the optimal acoustic conditions in building design. We propose to use the reduced basis method (RBM) for realistic room…

Computational Engineering, Finance, and Science · Computer Science 2023-02-01 Hermes Sampedro Llopis , Cheol-Ho Jeong , Allan P. Engsig-Karup

Implicit Neural Representations (INRs) have revolutionized signal processing and computer vision by modeling signals as continuous, differentiable functions parameterized by neural networks. However, INRs are prone to the spectral bias…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Ali Haider , Muhammad Salman Ali , Maryam Qamar , Tahir Khalil , Soo Ye Kim , Jihyong Oh , Enzo Tartaglione , Sung-Ho Bae

Auto-regressive models have achieved impressive results in 2D image generation by modeling joint distributions in grid space. In this paper, we extend auto-regressive models to 3D domains, and seek a stronger ability of 3D shape generation…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Xuelin Qian , Yu Wang , Simian Luo , Yinda Zhang , Ying Tai , Zhenyu Zhang , Chengjie Wang , Xiangyang Xue , Bo Zhao , Tiejun Huang , Yunsheng Wu , Yanwei Fu

Deep generative neural networks have proven effective at both conditional and unconditional modeling of complex data distributions. Conditional generation enables interactive control, but creating new controls often requires expensive…

Machine Learning · Computer Science 2017-12-25 Jesse Engel , Matthew Hoffman , Adam Roberts

In realistic environments, speech is usually interfered by various noise and reverberation, which dramatically degrades the performance of automatic speech recognition (ASR) systems. To alleviate this issue, the commonest way is to use a…

Sound · Computer Science 2018-05-04 Bin Liu , Shuai Nie , Yaping Zhang , Dengfeng Ke , Shan Liang , Wenju Liu1

Enhancing speech signal quality in adverse acoustic environments is a persistent challenge in speech processing. Existing deep learning based enhancement methods often struggle to effectively remove background noise and reverberation in…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-19 Heming Wang , Meng Yu , Hao Zhang , Chunlei Zhang , Zhongweiyang Xu , Muqiao Yang , Yixuan Zhang , Dong Yu

One of the challenges in computational acoustics is the identification of models that can simulate and predict the physical behavior of a system generating an acoustic signal. Whenever such models are used for commercial applications an…

Conditioning image generation on specific features of the desired output is a key ingredient of modern generative models. However, existing approaches lack a general and unified way of representing structural and semantic conditioning at…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Luca Butera , Andrea Cini , Alberto Ferrante , Cesare Alippi

Existing generative models, such as diffusion and auto-regressive networks, are inherently static, relying on a fixed set of pretrained parameters to handle all inputs. In contrast, humans flexibly adapt their internal generative…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Minh-Tuan Tran , Xuan-May Le , Quan Hung Tran , Mehrtash Harandi , Dinh Phung , Trung Le

A deep learning approach has been widely applied in sequence modeling problems. In terms of automatic speech recognition (ASR), its performance has significantly been improved by increasing large speech corpus and deeper neural network.…

Computation and Language · Computer Science 2016-12-28 Zewang Zhang , Zheng Sun , Jiaqi Liu , Jingwen Chen , Zhao Huo , Xiao Zhang

Recent improvements in conditional generative modeling have made it possible to generate high-quality images from language descriptions alone. We investigate whether these methods can directly address the problem of sequential…

Machine Learning · Computer Science 2023-07-11 Anurag Ajay , Yilun Du , Abhi Gupta , Joshua Tenenbaum , Tommi Jaakkola , Pulkit Agrawal

Latest advances in deep spatial filtering for Ambisonics demonstrate strong performance in stationary multi-speaker scenarios by rotating the sound field toward a target speaker prior to multi-channel enhancement. For applicability in…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-22 Jakob Kienegger , Timo Gerkmann

We study question answering in the domain of radio regulations, a legally sensitive and high-stakes area. We propose a telecom-specific Retrieval-Augmented Generation (RAG) pipeline and introduce, to our knowledge, the first multiple-choice…

Information Retrieval · Computer Science 2025-11-14 Zakaria El Kassimi , Fares Fourati , Mohamed-Slim Alouini

Recurrent neural networks (RNNs) have demonstrated impressive results for virtual analog modeling of audio effects. These networks process time-domain audio signals using a series of matrix multiplication and nonlinear activation functions…

Sound · Computer Science 2024-08-12 Yen-Tung Yeh , Wen-Yi Hsiao , Yi-Hsuan Yang

Speaker extraction aims to extract target speech signal from a multi-talker environment with interference speakers and surrounding noise, given the target speaker's reference information. Most speaker extraction systems achieve satisfactory…

Audio and Speech Processing · Electrical Eng. & Systems 2022-08-12 Chengyun Deng , Shiqian Ma , Yi Zhang , Yongtao Sha , Hui Zhang , Hui Song , Xiangang Li

Conditional image generation has paved the way for several breakthroughs in image editing, generating stock photos and 3-D object generation. This continues to be a significant area of interest with the rise of new state-of-the-art methods…

Computer Vision and Pattern Recognition · Computer Science 2022-05-10 Vedant Singh , Surgan Jandial , Ayush Chopra , Siddharth Ramesh , Balaji Krishnamurthy , Vineeth N. Balasubramanian