English
Related papers

Related papers: M3TR: Temporal Retrieval Enhanced Multi-Modal Micr…

200 papers

Sequential recommendation systems aim to predict users' next preferences based on their interaction histories, but existing approaches face critical limitations in efficiency and multi-scale pattern recognition. While Transformer-based…

Information Retrieval · Computer Science 2025-05-08 Qianru Zhang , Liang Qu , Honggang Wen , Dong Huang , Siu-Ming Yiu , Nguyen Quoc Viet Hung , Hongzhi Yin

Click-Through Rate (CTR) prediction is a crucial task in recommendation systems, online searches, and advertising platforms, where accurately capturing users' real interests in content is essential for performance. However, existing methods…

The wide popularity of short videos on social media poses new opportunities and challenges to optimize recommender systems on the video-sharing platforms. Users provide complex and multi-faceted responses towards recommendations, including…

Machine Learning · Computer Science 2022-05-27 Qingpeng Cai , Ruohan Zhan , Chi Zhang , Jie Zheng , Guangwei Ding , Pinghua Gong , Dong Zheng , Peng Jiang

Video Moment Retrieval (MR) aims to localize moments within a video based on a given natural language query. Given the prevalent use of platforms like YouTube for information retrieval, the demand for MR techniques is significantly growing.…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Seojeong Park , Jiho Choi , Kyungjune Baek , Hyunjung Shim

With the rapid advancement of Multimodal Large Language Models (MLLMs), an increasing number of researchers are exploring their application in recommendation systems. However, the high latency associated with large models presents a…

Information Retrieval · Computer Science 2025-04-29 Junjie Zhou

Video search has become the main routine for users to discover videos relevant to a text query on large short-video sharing platforms. During training a query-video bi-encoder model using online search logs, we identify a modality bias…

Computer Vision and Pattern Recognition · Computer Science 2022-05-18 Xun Wang , Bingqing Ke , Xuanping Li , Fangyu Liu , Mingyu Zhang , Xiao Liang , Qiushi Xiao , Cheng Luo , Yue Yu

Recommendation models are predominantly trained using implicit user feedback, since explicit feedback is often costly to obtain. However, implicit feedback, such as clicks, does not always reflect users' real preferences. For example, a…

Information Retrieval · Computer Science 2025-10-06 Mengchen Zhao , Yifan Gao , Yaqing Hou , Xiangyang Li , Pengjie Gu , Zhenhua Dong , Ruiming Tang , Yi Cai

Multimodal document retrieval systems have shown strong progress in aligning visual and textual content for semantic search. However, most existing approaches remain heavily English-centric, limiting their effectiveness in multilingual…

Information Retrieval · Computer Science 2025-12-04 Adithya S Kolavi , Vyoman Jain

An accurate prediction of watch time has been of vital importance to enhance user engagement in video recommender systems. To achieve this, there are four properties that a watch time prediction framework should satisfy: first, despite its…

Information Retrieval · Computer Science 2023-06-07 Xiao Lin , Xiaokai Chen , Linfeng Song , Jingwei Liu , Biao Li , Peng Jiang

Autonomous systems not only need to understand their current environment, but should also be able to predict future actions conditioned on past states, for instance based on captured camera frames. However, existing models mainly focus on…

Computer Vision and Pattern Recognition · Computer Science 2022-11-10 Angel Villar-Corrales , Ani Karapetyan , Andreas Boltres , Sven Behnke

Video Large Language Models (Video LLMs) have shown promising capabilities in video comprehension, yet they struggle with tracking temporal changes and reasoning about temporal relationships. While previous research attributed this…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Lei Li , Yuanxin Liu , Linli Yao , Peiyuan Zhang , Chenxin An , Lean Wang , Xu Sun , Lingpeng Kong , Qi Liu

Recommender System (RS) is an important online application that affects billions of users every day. The mainstream RS ranking framework is composed of two parts: a Multi-Task Learning model (MTL) that predicts various user feedback, i.e.,…

Information Retrieval · Computer Science 2022-08-11 Qihua Zhang , Junning Liu , Yuzhuo Dai , Yiyan Qi , Yifan Yuan , Kunlun Zheng , Fan Huang , Xianfeng Tan

Click-through Rate (CTR) prediction is crucial for online personalization platforms. Recent advancements have shown that modeling rich user behaviors can significantly improve the performance of CTR prediction. Current long-term user…

Information Retrieval · Computer Science 2025-02-18 Xiang Xu , Hao Wang , Wei Guo , Luankang Zhang , Wanshan Yang , Runlong Yu , Yong Liu , Defu Lian , Enhong Chen

Understanding the content of events occurring in the video and their inherent temporal logic is crucial for video-text retrieval. However, web-crawled pre-training datasets often lack sufficient event information, and the widely adopted…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Zongyang Ma , Ziqi Zhang , Yuxin Chen , Zhongang Qi , Chunfeng Yuan , Bing Li , Yingmin Luo , Xu Li , Xiaojuan Qi , Ying Shan , Weiming Hu

Despite significant advancements in video large multimodal models (video-LMMs), achieving effective temporal grounding in long-form videos remains a challenge for existing models. To address this limitation, we propose Temporal Preference…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Rui Li , Xiaohan Wang , Yuhui Zhang , Orr Zohar , Zeyu Wang , Serena Yeung-Levy

Multimodal Large Language Models (MLLMs) have shown strong performance in video understanding tasks. However, they continue to struggle with long-form videos because of an inefficient perception of temporal intervals. Unlike humans, who can…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Chenglin Li , Qianglong Chen , fengtao , Yin Zhang

We employ crowdsourcing to acquire time-continuous affective annotations for movie clips, and refine noisy models trained from these crowd annotations incorporating expert information within a Multi-task Learning (MTL) framework. We propose…

Multimedia · Computer Science 2021-12-17 Ramanathan Subramanian , Yan Yan , Nicu Sebe

Conversion Rate (\emph{CVR}) prediction in modern industrial e-commerce platforms is becoming increasingly important, which directly contributes to the final revenue. In order to address the well-known sample selection bias (\emph{SSB}) and…

Machine Learning · Computer Science 2021-04-21 Hong Wen , Jing Zhang , Fuyu Lv , Wentian Bao , Tianyi Wang , Zulong Chen

Multimodal-aware recommender systems (MRSs) exploit multimodal content (e.g., product images or descriptions) as items' side information to improve recommendation accuracy. While most of such methods rely on factorization models (e.g.,…

Information Retrieval · Computer Science 2023-08-25 Daniele Malitesta , Giandomenico Cornacchia , Claudio Pomo , Tommaso Di Noia

E-commerce search optimization has evolved to include a wider range of metrics that reflect user engagement and business objectives. Modern search frameworks now incorporate advanced quality features, such as sales counts and document-query…

Information Retrieval · Computer Science 2025-09-03 Jungbae Park , Heonseok Jang