English
Related papers

Related papers: Audio-text Retrieval with Transformer-based Hierar…

200 papers

Cross-domain recommendation (CDR) aims to alleviate the data sparsity by transferring knowledge across domains. Disentangled representation learning provides an effective solution to model complex user preferences by separating intra-domain…

Information Retrieval · Computer Science 2025-07-24 Yuhan Wang , Qing Xie , Zhifeng Bao , Mengzi Tang , Lin Li , Yongjian Liu

Audio-Visual Segmentation (AVS) aims to localize sound-producing objects at the pixel level by jointly leveraging auditory and visual information. However, existing methods often suffer from multi-source entanglement and audio-visual…

Computer Vision and Pattern Recognition · Computer Science 2025-12-24 Jingqi Tian , Yiheng Du , Haoji Zhang , Yuji Wang , Isaac Ning Lee , Xulong Bai , Tianrui Zhu , Jingxuan Niu , Yansong Tang

Remote Sensing Image-Text Retrieval (RSITR) plays a critical role in geographic information interpretation, disaster monitoring, and urban planning by establishing semantic associations between image and textual descriptions. Existing…

Computer Vision and Pattern Recognition · Computer Science 2025-05-23 Hailong Ning , Siying Wang , Tao Lei , Xiaopeng Cao , Huanmin Dou , Bin Zhao , Asoke K. Nandi , Petia Radeva

In the past few years, cross-modal image-text retrieval (ITR) has experienced increased interest in the research community due to its excellent research value and broad real-world application. It is designed for the scenarios where the…

Information Retrieval · Computer Science 2022-11-21 Min Cao , Shiping Li , Juntao Li , Liqiang Nie , Min Zhang

Recent progress in diffusion-based audio generation and restoration has substantially improved performance across heterogeneous conditioning regimes, including text-conditioned audio generation and audio-conditioned super-resolution.…

Sound · Computer Science 2026-05-07 Xuanhao Zhang , Chang Li

Audio-visual speech recognition (AVSR) combines audio-visual modalities to improve speech recognition, especially in noisy environments. However, most existing methods deploy the unidirectional enhancement or symmetric fusion manner, which…

Multimedia · Computer Science 2025-08-12 Junxiao Xue , Xiaozhen Liu , Xuecheng Wu , Xinyi Yin , Danlei Huang , Fei Yu

Current methods for Video Moment Retrieval (VMR) struggle to align complex situations involving specific environmental details, character descriptions, and action narratives. To tackle this issue, we propose a Large Language Model-guided…

Computer Vision and Pattern Recognition · Computer Science 2024-05-22 Weijia Liu , Bo Miao , Jiuxin Cao , Xuelin Zhu , Bo Liu , Mehwish Nasim , Ajmal Mian

Object detectors frequently encounter significant performance degradation when confronted with domain gaps between collected data (source domain) and data from real-world applications (target domain). To address this task, numerous…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Jianhong Han , Liang Chen , Yupei Wang

Vehicle Routing Problems (VRPs) with diverse real-world attributes have driven recent interest in cross-problem learning approaches that efficiently generalize across problem variants. We propose ARC (Attribute Representation via…

Machine Learning · Computer Science 2025-12-23 Han-Seul Jeong , Youngjoon Park , Hyungseok Song , Woohyung Lim

Metric learning minimizes the gap between similar (positive) pairs of data points and increases the separation of dissimilar (negative) pairs, aiming at capturing the underlying data structure and enhancing the performance of tasks like…

Sound · Computer Science 2024-04-24 Donghuo Zeng , Yanan Wang , Kazushi Ikeda , Yi Yu

Audio-text retrieval aims at retrieving a target audio clip or caption from a pool of candidates given a query in another modality. Solving such cross-modal retrieval task is challenging because it not only requires learning robust feature…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-01 Xinhao Mei , Xubo Liu , Jianyuan Sun , Mark D. Plumbley , Wenwu Wang

Aligning acoustic and linguistic representations is a central challenge to bridge the pre-trained models in knowledge transfer for automatic speech recognition (ASR). This alignment is inherently structured and asymmetric: while multiple…

Computation and Language · Computer Science 2026-03-06 Xugang Lu , Peng Shen , Hisashi Kawai

Mapping Cyber Threat Intelligence (CTI) text to MITRE ATT\&CK technique IDs is a critical task for understanding adversary behaviors and automating threat defense. While recent Retrieval-Augmented Generation (RAG) approaches have…

Computation and Language · Computer Science 2026-04-17 Filippo Morbiato , Markus Keller , Priya Nair , Luca Romano

Retrieval-augmented generation (RAG) is a common way to ground language models in external documents and up-to-date information. Classical retrieval systems relied on lexical methods such as BM25, which rank documents by term overlap with…

Computation and Language · Computer Science 2026-03-05 Martin Asenov , Kenza Benkirane , Dan Goldwater , Aneiss Ghodsi

Recent advancements in deep learning (DL) have posed a significant challenge for automatic speech recognition (ASR). ASR relies on extensive training datasets, including confidential ones, and demands substantial computational and storage…

Sound · Computer Science 2024-04-19 Hamza Kheddar , Mustapha Hemis , Yassine Himeur

Retrieval-Augmented Generation (RAG) is a framework for grounding Large Language Models (LLMs) in external, up-to-date information. However, recent advancements in context window size allow LLMs to process inputs of up to 128K tokens or…

Machine Learning · Computer Science 2026-02-26 Seongwoong Shim , Myunsoo Kim , Jae Hyeon Cho , Byung-Jun Lee

Anomalous sound detection (ASD) encounters difficulties with domain shift, where the sounds of machines in target domains differ significantly from those in source domains due to varying operating conditions. Existing methods typically…

Sound · Computer Science 2025-01-06 Jian Guan , Jiantong Tian , Qiaoxi Zhu , Feiyang Xiao , Hejing Zhang , Xubo Liu

Large language models often struggle with complex long-horizon analytical tasks over unstructured tables, which typically feature hierarchical and bidirectional headers and non-canonical layouts. We formalize this challenge as Deep Tabular…

Artificial Intelligence · Computer Science 2026-03-13 Junnan Dong , Chuang Zhou , Zheng Yuan , Yifei Yu , Qiufeng Wang , Yinghui Li , Siyu An , Di Yin , Xing Sun , Feiyue Huang

Retrieval-augmented generation (RAG) enhances large language models (LLMs) by incorporating external knowledge, but existing approaches indiscriminately trigger retrieval and rely on single-path evidence construction, often introducing…

Computation and Language · Computer Science 2026-01-08 Wang Chen , Guanqiang Qi , Weikang Li , Yang Li , Deguo Xia , Jizhou Huang

Audio-visual video segmentation~(AVVS) aims to generate pixel-level maps of sound-producing objects within image frames and ensure the maps faithfully adhere to the given audio, such as identifying and segmenting a singing person in a…

Computer Vision and Pattern Recognition · Computer Science 2023-09-21 Kexin Li , Zongxin Yang , Lei Chen , Yi Yang , Jun Xiao