中文
相关论文

相关论文: Audio-text Retrieval with Transformer-based Hierar…

200 篇论文

Cross-domain recommendation (CDR) aims to alleviate the data sparsity by transferring knowledge across domains. Disentangled representation learning provides an effective solution to model complex user preferences by separating intra-domain…

信息检索 · 计算机科学 2025-07-24 Yuhan Wang , Qing Xie , Zhifeng Bao , Mengzi Tang , Lin Li , Yongjian Liu

Audio-Visual Segmentation (AVS) aims to localize sound-producing objects at the pixel level by jointly leveraging auditory and visual information. However, existing methods often suffer from multi-source entanglement and audio-visual…

计算机视觉与模式识别 · 计算机科学 2025-12-24 Jingqi Tian , Yiheng Du , Haoji Zhang , Yuji Wang , Isaac Ning Lee , Xulong Bai , Tianrui Zhu , Jingxuan Niu , Yansong Tang

Remote Sensing Image-Text Retrieval (RSITR) plays a critical role in geographic information interpretation, disaster monitoring, and urban planning by establishing semantic associations between image and textual descriptions. Existing…

计算机视觉与模式识别 · 计算机科学 2025-05-23 Hailong Ning , Siying Wang , Tao Lei , Xiaopeng Cao , Huanmin Dou , Bin Zhao , Asoke K. Nandi , Petia Radeva

In the past few years, cross-modal image-text retrieval (ITR) has experienced increased interest in the research community due to its excellent research value and broad real-world application. It is designed for the scenarios where the…

信息检索 · 计算机科学 2022-11-21 Min Cao , Shiping Li , Juntao Li , Liqiang Nie , Min Zhang

Recent progress in diffusion-based audio generation and restoration has substantially improved performance across heterogeneous conditioning regimes, including text-conditioned audio generation and audio-conditioned super-resolution.…

声音 · 计算机科学 2026-05-07 Xuanhao Zhang , Chang Li

Audio-visual speech recognition (AVSR) combines audio-visual modalities to improve speech recognition, especially in noisy environments. However, most existing methods deploy the unidirectional enhancement or symmetric fusion manner, which…

多媒体 · 计算机科学 2025-08-12 Junxiao Xue , Xiaozhen Liu , Xuecheng Wu , Xinyi Yin , Danlei Huang , Fei Yu

Current methods for Video Moment Retrieval (VMR) struggle to align complex situations involving specific environmental details, character descriptions, and action narratives. To tackle this issue, we propose a Large Language Model-guided…

计算机视觉与模式识别 · 计算机科学 2024-05-22 Weijia Liu , Bo Miao , Jiuxin Cao , Xuelin Zhu , Bo Liu , Mehwish Nasim , Ajmal Mian

Object detectors frequently encounter significant performance degradation when confronted with domain gaps between collected data (source domain) and data from real-world applications (target domain). To address this task, numerous…

计算机视觉与模式识别 · 计算机科学 2024-05-21 Jianhong Han , Liang Chen , Yupei Wang

Vehicle Routing Problems (VRPs) with diverse real-world attributes have driven recent interest in cross-problem learning approaches that efficiently generalize across problem variants. We propose ARC (Attribute Representation via…

机器学习 · 计算机科学 2025-12-23 Han-Seul Jeong , Youngjoon Park , Hyungseok Song , Woohyung Lim

Metric learning minimizes the gap between similar (positive) pairs of data points and increases the separation of dissimilar (negative) pairs, aiming at capturing the underlying data structure and enhancing the performance of tasks like…

声音 · 计算机科学 2024-04-24 Donghuo Zeng , Yanan Wang , Kazushi Ikeda , Yi Yu

Audio-text retrieval aims at retrieving a target audio clip or caption from a pool of candidates given a query in another modality. Solving such cross-modal retrieval task is challenging because it not only requires learning robust feature…

音频与语音处理 · 电气工程与系统科学 2022-07-01 Xinhao Mei , Xubo Liu , Jianyuan Sun , Mark D. Plumbley , Wenwu Wang

Aligning acoustic and linguistic representations is a central challenge to bridge the pre-trained models in knowledge transfer for automatic speech recognition (ASR). This alignment is inherently structured and asymmetric: while multiple…

计算与语言 · 计算机科学 2026-03-06 Xugang Lu , Peng Shen , Hisashi Kawai

Mapping Cyber Threat Intelligence (CTI) text to MITRE ATT\&CK technique IDs is a critical task for understanding adversary behaviors and automating threat defense. While recent Retrieval-Augmented Generation (RAG) approaches have…

计算与语言 · 计算机科学 2026-04-17 Filippo Morbiato , Markus Keller , Priya Nair , Luca Romano

Retrieval-augmented generation (RAG) is a common way to ground language models in external documents and up-to-date information. Classical retrieval systems relied on lexical methods such as BM25, which rank documents by term overlap with…

计算与语言 · 计算机科学 2026-03-05 Martin Asenov , Kenza Benkirane , Dan Goldwater , Aneiss Ghodsi

Recent advancements in deep learning (DL) have posed a significant challenge for automatic speech recognition (ASR). ASR relies on extensive training datasets, including confidential ones, and demands substantial computational and storage…

声音 · 计算机科学 2024-04-19 Hamza Kheddar , Mustapha Hemis , Yassine Himeur

Retrieval-Augmented Generation (RAG) is a framework for grounding Large Language Models (LLMs) in external, up-to-date information. However, recent advancements in context window size allow LLMs to process inputs of up to 128K tokens or…

机器学习 · 计算机科学 2026-02-26 Seongwoong Shim , Myunsoo Kim , Jae Hyeon Cho , Byung-Jun Lee

Anomalous sound detection (ASD) encounters difficulties with domain shift, where the sounds of machines in target domains differ significantly from those in source domains due to varying operating conditions. Existing methods typically…

声音 · 计算机科学 2025-01-06 Jian Guan , Jiantong Tian , Qiaoxi Zhu , Feiyang Xiao , Hejing Zhang , Xubo Liu

Large language models often struggle with complex long-horizon analytical tasks over unstructured tables, which typically feature hierarchical and bidirectional headers and non-canonical layouts. We formalize this challenge as Deep Tabular…

人工智能 · 计算机科学 2026-03-13 Junnan Dong , Chuang Zhou , Zheng Yuan , Yifei Yu , Qiufeng Wang , Yinghui Li , Siyu An , Di Yin , Xing Sun , Feiyue Huang

Retrieval-augmented generation (RAG) enhances large language models (LLMs) by incorporating external knowledge, but existing approaches indiscriminately trigger retrieval and rely on single-path evidence construction, often introducing…

计算与语言 · 计算机科学 2026-01-08 Wang Chen , Guanqiang Qi , Weikang Li , Yang Li , Deguo Xia , Jizhou Huang

Audio-visual video segmentation~(AVVS) aims to generate pixel-level maps of sound-producing objects within image frames and ensure the maps faithfully adhere to the given audio, such as identifying and segmenting a singing person in a…

计算机视觉与模式识别 · 计算机科学 2023-09-21 Kexin Li , Zongxin Yang , Lei Chen , Yi Yang , Jun Xiao