中文
相关论文

相关论文: Few-shot Acoustic Synthesis with Multimodal Flow M…

200 篇论文

Flow matching has recently emerged as a powerful alternative to diffusion models, providing a continuous-time formulation for generative modeling and representation learning. Yet, we show that this framework suffers from a fundamental…

机器学习 · 计算机科学 2025-09-26 Weili Zeng , Yichao Yan

Multiply-accumulation (MAC) is a crucial computing operation in signal processing, numerical simulations, and machine learning. This work presents a scalable, programmable, frequency-domain parallel computing leveraging gigahertz…

应用物理 · 物理学 2024-09-18 Jun Ji , Zichen Xi , Bernadeta R. Srijanto , Ivan I. Kravchenko , Ming Jin , Wenjie Xiong , Linbo Shao

Normalizing flows (NFs) provide exact likelihoods and deterministic invertible sampling, but have historically lagged behind diffusion models for large-scale image generation. We identify a key obstacle: NFs are required to learn a single…

计算机视觉与模式识别 · 计算机科学 2026-05-26 Longtao Jiang , Jianmin Bao , Zhendong Wang , Xin Tao , Pengfei Wan , Zhihui Li , Xiaojun Chang

We introduce FLEURS, the Few-shot Learning Evaluation of Universal Representations of Speech benchmark. FLEURS is an n-way parallel speech dataset in 102 languages built on top of the machine translation FLoRes-101 benchmark, with…

计算与语言 · 计算机科学 2022-05-26 Alexis Conneau , Min Ma , Simran Khanuja , Yu Zhang , Vera Axelrod , Siddharth Dalmia , Jason Riesa , Clara Rivera , Ankur Bapna

Few-shot segmentation (FSS) aims to rapidly learn novel class concepts from limited examples to segment specific targets in unseen images, and has been widely applied in areas such as medical diagnosis and industrial inspection. However,…

计算机视觉与模式识别 · 计算机科学 2026-03-31 Qianyu Guo , Jingrong Wu , Jieji Ren , Weifeng Ge , Wenqiang Zhang

Few-shot learning (FSL) aims to enable models to recognize novel objects or classes with limited labelled data. Feature generators, which synthesize new data points to augment limited datasets, have emerged as a promising solution to this…

计算机视觉与模式识别 · 计算机科学 2024-10-14 Heethanjan Kanagalingam , Thenukan Pathmanathan , Navaneethan Ketheeswaran , Mokeeshan Vathanakumar , Mohamed Afham , Ranga Rodrigo

A key challenge in synthesizing audios from silent videos is the inherent trade-off between synthesis quality and inference efficiency in existing methods. For instance, flow matching based models rely on modeling instantaneous velocity,…

声音 · 计算机科学 2025-09-09 Xiaoran Yang , Jianxuan Yang , Xinyue Guo , Haoyu Wang , Ningning Pan , Gongping Huang

Few-shot audio classification is an emerging topic that attracts more and more attention from the research community. Most existing work ignores the specificity of the form of the audio spectrogram and focuses largely on the embedding space…

声音 · 计算机科学 2023-03-01 Zhongjie Yu , Shuyang Wang , Lin Chen , Zhongwei Cheng

Audio super-resolution aims to recover missing high-frequency details from bandwidth-limited low-resolution audio, thereby improving the naturalness and perceptual quality of the reconstructed signal. However, most existing methods directly…

声音 · 计算机科学 2026-04-13 Fei Liu , Yang Ai , Hui-Peng Du , Yu-Fei Shi , Zhen-Hua Ling

Few-shot speaker adaptation is a specific Text-to-Speech (TTS) system that aims to reproduce a novel speaker's voice with a few training data. While numerous attempts have been made to the few-shot speaker adaptation system, there is still…

音频与语音处理 · 电气工程与系统科学 2021-08-17 Ji-Hoon Kim , Sang-Hoon Lee , Ji-Hyun Lee , Hong-Gyu Jung , Seong-Whan Lee

Novel view acoustic synthesis (NVAS) aims to render binaural audio at any target viewpoint, given a mono audio emitted by a sound source at a 3D scene. Existing methods have proposed NeRF-based implicit models to exploit visual cues as a…

声音 · 计算机科学 2025-03-18 Swapnil Bhosale , Haosen Yang , Diptesh Kanojia , Jiankang Deng , Xiatian Zhu

Industrial anomaly classification (AC) is an indispensable task in industrial manufacturing, which guarantees quality and safety of various product. To address the scarcity of data in industrial scenarios, lots of few-shot anomaly detection…

计算机视觉与模式识别 · 计算机科学 2024-12-06 Zuo Zuo , Jiahao Dong , Yao Wu , Yanyun Qu , Zongze Wu

Enhancing RAW images captured under low light conditions is a challenging task. Recent deep learning based RAW enhancement methods have shifted from using real paired data to relying on synthetic datasets. These synthetic datasets are…

图像与视频处理 · 电气工程与系统科学 2025-09-11 Juntai Zeng

Few-shot video classification aims to learn new video categories with only a few labeled examples, alleviating the burden of costly annotation in real-world applications. However, it is particularly challenging to learn a class-invariant…

计算机视觉与模式识别 · 计算机科学 2021-05-12 Songyang Zhang , Jiale Zhou , Xuming He

Approximate computing is an effective computing paradigm for improving the energy efficiency of error-tolerant applications. Approximate logic synthesis (ALS) is an automatic process to generate approximate circuits with reduced area,…

新兴技术 · 计算机科学 2026-01-22 Chang Meng , Weikang Qian , Giovanni De Micheli

Recent advancements in music generation have garnered significant attention, yet existing approaches face critical limitations. Some current generative models can only synthesize either the vocal track or the accompaniment track. While some…

音频与语音处理 · 电气工程与系统科学 2025-03-04 Ziqian Ning , Huakang Chen , Yuepeng Jiang , Chunbo Hao , Guobin Ma , Shuai Wang , Jixun Yao , Lei Xie

We propose a methodology for training foundation models that enhances their in-context learning capabilities within the domain of bioacoustic signal processing. We use synthetically generated training data, introducing a…

We introduce a diffusion-based approach for generating privacy-preserving digital twins of multi-room indoor environments from depth images only. Central to our approach is a novel Multi-view Overlapped Scene Alignment with Implicit…

计算机视觉与模式识别 · 计算机科学 2025-11-10 Zhixuan Liu , Haokun Zhu , Rui Chen , Jonathan Francis , Soonmin Hwang , Ji Zhang , Jean Oh

Iterative generative policies, such as diffusion models and flow matching, offer superior expressivity for continuous control but complicate Maximum Entropy Reinforcement Learning because their action log-densities are not directly…

机器学习 · 计算机科学 2026-02-16 Lei Lv , Yunfei Li , Yu Luo , Fuchun Sun , Xiao Ma

The generation of room impulse responses (RIRs) using deep neural networks has attracted growing research interest due to its applications in virtual and augmented reality, audio postproduction, and related fields. Most existing approaches…

声音 · 计算机科学 2025-07-17 Silvia Arellano , Chunghsin Yeh , Gautam Bhattacharya , Daniel Arteaga