中文
相关论文

相关论文: Exploring Pre-trained General-purpose Audio Repres…

200 篇论文

Standard fine-tuning of pre-trained audio models couples representation learning with classifier training, which can obscure the true quality of the learned representations. In this work, we advocate for a disentangled two-stage framework…

声音 · 计算机科学 2025-09-23 Yang Wang , Qibin Liang , Chenghao Xiao , Yizhi Li , Noura Al Moubayed , Chenghua Lin

Recent research highlights that the Directed Accumulator (DA), through its parametrization of geometric priors into neural networks, has notably improved the performance of medical image recognition, particularly with small and imbalanced…

计算机视觉与模式识别 · 计算机科学 2023-06-06 Hang Zhang , Renjiu Hu , Xiang Chen , Rongguang Wang , Jinwei Zhang , Jiahao Li

Deep neural networks have shown promising potential for ultrasound-to-speech conversion task towards Silent Speech Interfaces. In this work, we applied two Conformer-based DNN architectures (Base and one with bi-LSTM) for this task.…

声音 · 计算机科学 2025-06-05 Ibrahim Ibrahimov , Zainkó Csaba , Gábor Gosztolya

This paper investigates continuous representations of steering vectors over frequency and microphone/source positions for augmented listening (e.g., spatial filtering and binaural rendering), enabling user-parameterized control of the…

音频与语音处理 · 电气工程与系统科学 2026-04-17 Diego Di Carlo , Shoichi Koyama , Nugraha Aditya Arie , Fontaine Mathieu , Bando Yoshiaki , Yoshii Kazuyoshi

Deep learning on an edge device requires energy efficient operation due to ever diminishing power budget. Intentional low quality data during the data acquisition for longer battery life, and natural noise from the low cost sensor degrade…

机器学习 · 计算机科学 2019-04-30 Taesik Na , Minah Lee , Burhan A. Mudassar , Priyabrata Saha , Jong Hwan Ko , Saibal Mukhopadhyay

Deep learning based computed tomography (CT) reconstruction has demonstrated outstanding performance on simulated 2D low-dose CT data. This applies in particular to domain adapted neural networks, which incorporate a handcrafted physics…

图像与视频处理 · 电气工程与系统科学 2023-11-30 Jevgenija Rudzusika , Buda Bajić , Thomas Koehler , Ozan Öktem

As gravitational wave detectors become more advanced and sensitive, the number of signals recorded by Advanced LIGO and Virgo from merging compact objects is expected to rise dramatically. This surge in detection rates necessitates the…

广义相对论与量子宇宙学 · 物理学 2025-08-05 Chayan Chatterjee , Abigail Petulante , Karan Jani , Jesse Spencer-Smith , Yang Hu , Roy Lau , Haowei Fu , Trang Hoang , Stephen Chong Zhao , Suyash Deshmukh

In response to the increasingly critical demand for accurate prediction of GPU memory resources in deep learning tasks, this paper deeply analyzes the current research status and innovatively proposes a deep learning model that integrates…

机器学习 · 计算机科学 2025-10-27 Chao Wang , Zhizhao Wen , Ruoxin Zhang , Puyang Xu , Yifan Jiang

The purpose of this paper is to compare different learnable frontends in medical acoustics tasks. A framework has been implemented to classify human respiratory sounds and heartbeats in two categories, i.e. healthy or affected by…

声音 · 计算机科学 2026-01-21 Alessandro Maria Poirè , Federico Simonetta , Stavros Ntalampiras

The adoption of advanced deep learning architectures in stuttering detection (SD) tasks is challenging due to the limited size of the available datasets. To this end, this work introduces the application of speech embeddings extracted from…

声音 · 计算机科学 2023-06-02 Shakeel A. Sheikh , Md Sahidullah , Fabrice Hirsch , Slim Ouni

Ultrasound is an adjunct tool to mammography that can quickly and safely aid physicians with diagnosing breast abnormalities. Clinical ultrasound often assumes a constant sound speed to form B-mode images for diagnosis. However, the various…

计算机视觉与模式识别 · 计算机科学 2023-02-08 Walter A. Simson , Magdalini Paschali , Vasiliki Sideri-Lampretsa , Nassir Navab , Jeremy J. Dahl

Transfer learning is critical for efficient information transfer across multiple related learning problems. A simple, yet effective transfer learning approach utilizes deep neural networks trained on a large-scale task for feature…

声音 · 计算机科学 2021-06-23 Anurag Kumar , Yun Wang , Vamsi Krishna Ithapu , Christian Fuegen

Improving the interpretability of deep neural networks has recently gained increased attention, especially when the power of deep learning is leveraged to solve problems in physics. Interpretability helps us understand a model's ability to…

声音 · 计算机科学 2023-10-12 Karim Helwani , Erfan Soltanmohammadi , Michael M. Goodwin

In this paper we address the memory demands that come with the processing of 3-dimensional, high-resolution, multi-channeled medical images in deep learning. We exploit memory-efficient backpropagation techniques, to reduce the memory…

计算机视觉与模式识别 · 计算机科学 2018-08-17 Stefano B. Blumberg , Ryutaro Tanno , Iasonas Kokkinos , Daniel C. Alexander

Humans possess a remarkable ability to integrate auditory and visual information, enabling a deeper understanding of the surrounding environment. This early fusion of audio and visual cues, demonstrated through cognitive psychology and…

计算机视觉与模式识别 · 计算机科学 2023-12-05 Shentong Mo , Pedro Morgado

In this work, we investigate the application of deep learning methods for computed tomography in the context of having a low-data regime. As motivation, we review some of the existing approaches and obtain quantitative results after…

图像与视频处理 · 电气工程与系统科学 2021-04-20 Daniel Otero Baguer , Johannes Leuschner , Maximilian Schmidt

Underwater automatic target recognition (UATR) has been a challenging research topic in ocean engineering. Although deep learning brings opportunities for target recognition on land and in the air, underwater target recognition techniques…

计算机视觉与模式识别 · 计算机科学 2022-11-11 Xiaoteng Zhou , Changli Yu , Shihao Yuan , Xin Yuan , Hangchi Yu , Citong Luo

Given the recent surge in developments of deep learning, this article provides a review of the state-of-the-art deep learning techniques for audio signal processing. Speech, music, and environmental sound processing are considered…

声音 · 计算机科学 2019-05-28 Hendrik Purwins , Bo Li , Tuomas Virtanen , Jan Schlüter , Shuo-yiin Chang , Tara Sainath

Lifelong audio feature extraction involves learning new sound classes incrementally, which is essential for adapting to new data distributions over time. However, optimizing the model only on new data can lead to catastrophic forgetting of…

音频与语音处理 · 电气工程与系统科学 2024-02-08 Xilin Jiang , Yinghao Aaron Li , Nima Mesgarani

Traditionally, research in automated speech recognition has focused on local-first encoding of audio representations to predict the spoken phonemes in an utterance. Unfortunately, approaches relying on such hyper-local information tend to…

音频与语音处理 · 电气工程与系统科学 2022-09-19 David M. Chan , Shalini Ghosh , Debmalya Chakrabarty , Björn Hoffmeister