English
Related papers

Related papers: The 2nd EReL@MIR Workshop on Efficient Representat…

200 papers

In Imitation Learning (IL), utilizing suboptimal and heterogeneous demonstrations presents a substantial challenge due to the varied nature of real-world data. However, standard IL algorithms consider these datasets as homogeneous, thereby…

Machine Learning · Computer Science 2024-12-16 Mark Beliaev , Ramtin Pedarsani

Interactive reinforcement learning (IRL) extends traditional reinforcement learning (RL) by allowing an agent to interact with parent-like trainers during a task. In this paper, we present an IRL approach using dynamic audio-visual input in…

Artificial Intelligence · Computer Science 2018-07-27 Francisco Cruz , German I. Parisi , Stefan Wermter

In the contemporary era of widespread online recruitment, resume understanding has been widely acknowledged as a fundamental and crucial task, which aims to extract structured information from resume documents automatically. Compared to the…

Computation and Language · Computer Science 2024-04-23 Feihu Jiang , Chuan Qin , Jingshuai Zhang , Kaichun Yao , Xi Chen , Dazhong Shen , Chen Zhu , Hengshu Zhu , Hui Xiong

Despite recent advancements in language and vision modeling, integrating rich multimodal knowledge into recommender systems continues to pose significant challenges. This is primarily due to the need for efficient recommendation, which…

Information Retrieval · Computer Science 2024-10-03 Yueqi Wang , Zhenrui Yue , Huimin Zeng , Dong Wang , Julian McAuley

Multimodal recommendation combines the user historical behaviors with the modal features of items to capture the tangible user preferences, presenting superior performance compared to the conventional ID-based recommender systems. However,…

Information Retrieval · Computer Science 2026-01-27 Yuzhuo Dang , Xin Zhang , Zhiqiang Pan , Yuxiao Duan , Wanyu Chen , Fei Cai , Honghui Chen

While Large Vision-Language Models (LVLMs) offer powerful capabilities, they pose privacy risks by unintentionally memorizing sensitive personal information. Current unlearning benchmarks attempt to mitigate this using fictitious identities…

Computer Vision and Pattern Recognition · Computer Science 2026-05-06 JuneHyoung Kwon , MiHyeon Kim , Eunju Lee , JungMin Yun , Byeonggeuk Lim , YoungBin Kim

Multimodal Emotion Recognition (MER) focuses on identifying and interpreting emotions from modality-compound inputs. Closely mirroring human cognitive processes in real-world environments, MER has drawn substantial attention from both…

Multimedia · Computer Science 2026-05-21 Hongrui Zhang , Daiqing Wu , Yangyang Li , Kuien Liu , Yuhui Wang , Yu Zhou , Sicheng Zhao

Reinforcement Learning with Verifiable Rewards (RLVR) has been shown effective in enhancing the visual reflection and reasoning capabilities of Large Multimodal Models (LMMs). However, existing datasets are predominantly derived from either…

Machine Learning · Computer Science 2026-02-20 Haoxiang Sun , Lizhen Xu , Bing Zhao , Wotao Yin , Wei Wang , Boyu Yang , Rui Wang , Hu Wei

Multi-modal retrieval has seen tremendous progress with the development of vision-language models. However, further improving these models require additional labelled data which is a huge manual effort. In this paper, we propose a framework…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Avinash Madasu , Estelle Aflalo , Gabriela Ben Melech Stan , Shachar Rosenman , Shao-Yen Tseng , Gedas Bertasius , Vasudev Lal

Multimodal affective computing aims to predict humans' sentiment, emotion, intention, and opinion using language, acoustic, and visual modalities. However, current models often learn spurious correlations that harm generalization under…

Machine Learning · Computer Science 2026-04-21 Sijie Mai , Shiqin Han

Multimodal representations and continual learning are two areas closely related to human intelligence. The former considers the learning of shared representation spaces where information from different modalities can be compared and…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Kai Wang , Luis Herranz , Joost van de Weijer

This paper presents the third edition of the LongEval Lab, part of the CLEF 2025 conference, which continues to explore the challenges of temporal persistence in Information Retrieval (IR). The lab features two tasks designed to provide…

Recent advancements in Large Language Models (LLMs) have significantly improved reasoning capabilities, with in-context learning (ICL) emerging as a key technique for adaptation without retraining. While previous works have focused on…

Machine Learning · Computer Science 2025-12-17 Jongyeop Hyun , Bumsoo Kim

Multi-Task Learning (MTL) for Vision Transformer aims at enhancing the model capability by tackling multiple tasks simultaneously. Most recent works have predominantly focused on designing Mixture-of-Experts (MoE) structures and in…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Hanwen Zhong , Jiaxin Chen , Yutong Zhang , Di Huang , Yunhong Wang

This paper presents a novel generative framework for learning shared latent representations across multimodal data. Many advanced multimodal methods focus on capturing all combinations of modality-specific details across inputs, which can…

Machine Learning · Computer Science 2025-08-26 Jiali Cui , Yan-Ying Chen , Yanxia Zhang , Matthew Klenk

We introduce MRMR, the first expert-level multidisciplinary multimodal retrieval benchmark requiring intensive reasoning. MRMR contains 1,502 queries spanning 23 domains, with positive documents carefully verified by human experts. Compared…

Information Retrieval · Computer Science 2026-02-17 Siyue Zhang , Yuan Gao , Xiao Zhou , Yilun Zhao , Tingyu Song , Arman Cohan , Anh Tuan Luu , Chen Zhao

Large Language Models (LLMs) and Multimodal Large Language Models (MLLMs) have made significant advancements in reasoning capabilities. However, they still face challenges such as high computational demands and privacy concerns. This paper…

Reasoning-Intensive Retrieval (RIR) targets retrieval settings where relevance is mediated by latent inferential links between a query and supporting evidence, rather than semantic similarity. Motivated by the emergent reasoning abilities…

Information Retrieval · Computer Science 2026-05-04 Yiyang Wei , Tingyu Song , Siyue Zhang , Yilun Zhao

Multimodal Entity Linking (MEL) is a task that aims to link ambiguous mentions within multimodal contexts to referential entities in a multimodal knowledge base. Recent methods for MEL adopt a common framework: they first interact and fuse…

Computation and Language · Computer Science 2023-10-10 Shangyu Xing , Fei Zhao , Zhen Wu , Chunhui Li , Jianbing Zhang , Xinyu Dai

Owing to recent advancements, Large Language Models (LLMs) can now be deployed as agents for increasingly complex decision-making applications in areas including robotics, gaming, and API integration. However, reflecting past experiences in…

‹ Prev 1 4 5 6 7 8 10 Next ›