English
Related papers

Related papers: Towards High-Fidelity and Controllable Bioacoustic…

200 papers

In the visual generative area, discrete diffusion models are gaining traction for their efficiency and compatibility. However, pioneered attempts still fall behind their continuous counterparts, which we attribute to noise (absorbing state)…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Tianren Ma , Xiaosong Zhang , Boyu Yang , Junlan Feng , Qixiang Ye

Recent advancements in music generation have garnered significant attention, yet existing approaches face critical limitations. Some current generative models can only synthesize either the vocal track or the accompaniment track. While some…

Audio and Speech Processing · Electrical Eng. & Systems 2025-03-04 Ziqian Ning , Huakang Chen , Yuepeng Jiang , Chunbo Hao , Guobin Ma , Shuai Wang , Jixun Yao , Lei Xie

Passive Acoustic Monitoring is a key tool for biodiversity conservation, but the large volumes of unsupervised audio it generates present major challenges for extracting meaningful information. Deep Learning offers promising solutions.…

Recent advancements in deep generative models present new opportunities for music production but also pose challenges, such as high computational demands and limited audio quality. Moreover, current systems frequently rely solely on text…

Sound · Computer Science 2024-10-31 Javier Nistal , Marco Pasini , Cyran Aouameur , Maarten Grachten , Stefan Lattner

Most 3D generation research focuses on up-projecting 2D foundation models into the 3D space, either by minimizing 2D Score Distillation Sampling (SDS) loss or fine-tuning on multi-view datasets. Without explicit 3D priors, these methods…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Lihe Ding , Shaocong Dong , Zhanpeng Huang , Zibin Wang , Yiyuan Zhang , Kaixiong Gong , Dan Xu , Tianfan Xue

Automated bioacoustic analysis aids understanding and protection of both marine and terrestrial animals and their habitats across extensive spatiotemporal scales, and typically involves analyzing vast collections of acoustic data. With the…

Audio and Speech Processing · Electrical Eng. & Systems 2023-12-22 Burooj Ghani , Tom Denton , Stefan Kahl , Holger Klinck

The latest advances in artificial intelligence (AI) present many unprecedented opportunities to achieve much improved bandwidth saving in communications. Unlike conventional communication systems focusing on packet transport, rich datasets…

Machine Learning · Computer Science 2023-12-07 Achintha Wijesinghe , Songyang Zhang , Suchinthaka Wanninayaka , Weiwei Wang , Zhi Ding

Traditional speech enhancement methods often oversimplify the task of restoration by focusing on a single type of distortion. Generative models that handle multiple distortions frequently struggle with phone reconstruction and…

Sound · Computer Science 2025-02-11 Tushar Dhyani , Florian Lux , Michele Mancusi , Giorgio Fabbro , Fritz Hohl , Ngoc Thang Vu

The convergence of IoT sensing, edge computing, and machine learning is transforming precision livestock farming. Yet bioacoustic data streams remain underused because of computational complexity and ecological validity challenges. We…

Sound · Computer Science 2025-10-17 Mayuri Kate , Suresh Neethirajan

Automated detection and classification of marine mammals vocalizations is critical for conservation and management efforts but is hindered by limited annotated datasets and the acoustic complexity of real-world marine environments. Data…

Sound · Computer Science 2025-12-01 Bruno Padovese , Fabio Frazao , Michael Dowd , Ruth Joy

Generative adversarial network (GAN) models can synthesize highquality audio signals while ensuring fast sample generation. However, they are difficult to train and are prone to several issues including mode collapse and divergence. In this…

Sound · Computer Science 2024-02-06 Teysir Baoueb , Haocheng Liu , Mathieu Fontaine , Jonathan Le Roux , Gael Richard

This paper focuses on wireless multiple-input multiple-output (MIMO)-orthogonal frequency division multiplex (OFDM) receivers. Traditional wireless receivers have relied on mathematical modeling and Bayesian inference, achieving remarkable…

Signal Processing · Electrical Eng. & Systems 2026-01-30 Yuzhi Yang , Omar Alhussein , Atefeh Arani , Zhaoyang Zhang , Mérouane Debbah

Machine learning tasks involving biomedical signals frequently grapple with issues such as limited data availability, imbalanced datasets, labeling complexities, and the interference of measurement noise. These challenges often hinder the…

Signal Processing · Electrical Eng. & Systems 2024-01-30 Xiaomin Li , Mykhailo Sakevych , Gentry Atkinson , Vangelis Metsis

We present VoiceDiT, a multi-modal generative model for producing environment-aware speech and audio from text and visual prompts. While aligning speech with text is crucial for intelligible speech, achieving this alignment in noisy…

Audio and Speech Processing · Electrical Eng. & Systems 2024-12-30 Jaemin Jung , Junseok Ahn , Chaeyoung Jung , Tan Dat Nguyen , Youngjoon Jang , Joon Son Chung

With the development of audio playback devices and fast data transmission, the demand for high sound quality is rising for both entertainment and communications. In this quest for better sound quality, challenges emerge from distortions and…

Audio and Speech Processing · Electrical Eng. & Systems 2024-11-12 Jean-Marie Lemercier , Julius Richter , Simon Welker , Eloi Moliner , Vesa Välimäki , Timo Gerkmann

The harnessing of machine learning, especially deep generative models, has opened up promising avenues in the field of synthetic DNA sequence generation. Whilst Generative Adversarial Networks (GANs) have gained traction for this…

Machine Learning · Computer Science 2023-12-27 Zehui Li , Yuhao Ni , Tim August B. Huygelen , Akashaditya Das , Guoxuan Xia , Guy-Bart Stan , Yiren Zhao

Generative models, particularly diffusion models, have made significant success in data synthesis across various modalities, including images, videos, and 3D assets. However, current diffusion models are computationally intensive, often…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Yuanzhi Zhu , Hanshu Yan , Huan Yang , Kai Zhang , Junnan Li

Low-field to high-field MRI synthesis has emerged as a cost-effective strategy to enhance image quality under hardware and acquisition constraints, particularly in scenarios where access to high-field scanners is limited or impractical.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Zhenxuan Zhang , Peiyuan Jing , Ruicheng Yuan , Liwei Hu , Anbang Wang , Fanwen Wang , Yinzhe Wu , Kh Tohidul Islam , Zhaolin Chen , Zi Wang , Peter Lally , Guang Yang

Although recent speech processing technologies have achieved significant improvements in objective metrics, there still remains a gap in human perceptual quality. This paper proposes Diffiner, a novel solution that utilizes the powerful…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-11 Masato Hirano , Ryosuke Sawata , Naoki Murata , Shusuke Takahashi , Yuki Mitsufuji

It is easier to hear birds than see them, however, they still play an essential role in nature and they are excellent indicators of deteriorating environmental quality and pollution. Recent advances in Machine Learning and Convolutional…

Sound · Computer Science 2021-07-13 Marcos V. Conde , Kumar Shubham , Prateek Agnihotri , Nitin D. Movva , Szilard Bessenyei