English
Related papers

Related papers: MOON Embedding: Multimodal Representation Learning…

200 papers

This paper explores the integration of strategic optimization methods in search advertising, focusing on ad ranking and bidding mechanisms within E-commerce platforms. By employing a combination of reinforcement learning and evolutionary…

Machine Learning · Computer Science 2024-05-30 Chang Zhou , Yang Zhao , Jin Cao , Yi Shen , Xiaoling Cui , Chiyu Cheng

In Taobao, the largest e-commerce platform in China, billions of items are provided and typically displayed with their images. For better user experience and business effectiveness, Click Through Rate (CTR) prediction in online advertising…

Computer Vision and Pattern Recognition · Computer Science 2018-09-05 Tiezheng Ge , Liqin Zhao , Guorui Zhou , Keyu Chen , Shuying Liu , Huimin Yi , Zelin Hu , Bochao Liu , Peng Sun , Haoyu Liu , Pengtao Yi , Sui Huang , Zhiqiang Zhang , Xiaoqiang Zhu , Yu Zhang , Kun Gai

The evolution of Large Language Models (LLMs) has significantly advanced multi-turn conversation systems, emphasizing the need for proactive guidance to enhance users' interactions. However, these systems face challenges in dynamically…

Computation and Language · Computer Science 2025-06-02 Xiaoyu Li , Xiao Li , Li Gao , Yiding Liu , Xiaoyang Wang , Shuaiqiang Wang , Junfeng Wang , Dawei Yin

Modeling feature interactions is essential for accurate click-through rate (CTR) prediction in advertising systems. Recent studies have adopted the Mixture-of-Experts (MoE) approach to improve performance by ensembling multiple feature…

Information Retrieval · Computer Science 2025-09-16 Jiancheng Wang , Mingjia Yin , Hao Wang , Enhong Chen

To avoid myopic behavior, multi-step lookahead Bayesian optimization (BO) algorithms consider the sequential nature of BO and have demonstrated promising results in recent years. However, owing to the curse of dimensionality, most of these…

Machine Learning · Computer Science 2026-04-24 Mujin Cheon , Jay H. Lee , Dong-Yeun Koh , Calvin Tsay

Multimodal recommendation systems are increasingly becoming foundational technologies for e-commerce and content platforms, enabling personalized services by jointly modeling users' historical behaviors and the multimodal features of items…

Information Retrieval · Computer Science 2025-09-12 Kelin Ren , Chan-Yang Ju , Dong-Ho Lee

Meta-learning approaches have shown great success in vision and language domains. However, few studies discuss the practice of meta-learning for large-scale industrial applications. Although e-commerce companies have spent many efforts on…

Machine Learning · Computer Science 2020-10-12 Hao Gong , Qifang Zhao , Tianyu Li , Derek Cho , DuyKhuong Nguyen

Multimodal representations and continual learning are two areas closely related to human intelligence. The former considers the learning of shared representation spaces where information from different modalities can be compared and…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Kai Wang , Luis Herranz , Joost van de Weijer

We propose MORAL (a multimodal reinforcement learning framework for decision making in autonomous laboratories) that enhances sequential decision-making in autonomous robotic laboratories through the integration of visual and textual…

Machine Learning · Computer Science 2025-04-07 Natalie Tirabassi , Sathish A. P. Kumar , Sumit Jha , Arvind Ramanathan

Accurate click-through rate (CTR) prediction is vital for online advertising and recommendation systems. Recent deep learning advancements have improved the ability to capture feature interactions and understand user interests. However,…

Information Retrieval · Computer Science 2025-02-24 Kefan Wang , Hao Wang , Kenan Song , Wei Guo , Kai Cheng , Zhi Li , Yong Liu , Defu Lian , Enhong Chen

Role-playing agents (RPAs) require balancing multiple objectives, such as instruction following, persona consistency, and stylistic fidelity, which are not always perfectly aligned across different dimensions. While prior work has primarily…

Computation and Language · Computer Science 2026-04-23 Chonghua Liao , Ke Wang , Yuchuan Wu , Ruoran Li , Fei Huang , Yongbin Li

We describe a parallel bayesian online deep learning framework (PBODL) for click-through rate (CTR) prediction within today's Tencent advertising system, which provides quick and accurate learning of user preferences. We first explain the…

Machine Learning · Computer Science 2017-07-11 Xun Liu , Wei Xue , Lei Xiao , Bo Zhang

Video understanding plays a fundamental role for content moderation on short video platforms, enabling the detection of inappropriate content. While classification remains the dominant approach for content moderation, it often struggles in…

Information Retrieval · Computer Science 2025-07-03 Hanzhong Liang , Jinghao Shi , Xiang Shen , Zixuan Wang , Vera Wen , Ardalan Mehrani , Zhiqian Chen , Yifan Wu , Zhixin Zhang

The cross-modal retrieval model leverages the potential of triple loss optimization to learn robust embedding spaces. However, existing methods often train these models in a singular pass, overlooking the distinction between semi-hard and…

Sound · Computer Science 2023-10-23 Donghuo Zeng , Kazushi Ikeda

Evolutionary algorithms have been successful in solving multi-objective optimization problems (MOPs). However, as a class of population-based search methodology, evolutionary algorithms require a large number of evaluations of the objective…

Neural and Evolutionary Computing · Computer Science 2024-08-16 Xueming Yan , Yaochu Jin

Over the past decade, significant advances have been made in the field of image search for e-commerce applications. Traditional image-to-image retrieval models, which focus solely on image details such as texture, tend to overlook useful…

Computer Vision and Pattern Recognition · Computer Science 2024-02-09 Chang Liu , Peng Hou , Anxiang Zeng , Han Yu

Improving recommendation systems (RS) can greatly enhance the user experience across many domains, such as social media. Many RS utilize embedding-based retrieval (EBR) approaches to retrieve candidates for recommendation. In an EBR system,…

Information Retrieval · Computer Science 2024-09-24 Matthew Kolodner , Mingxuan Ju , Zihao Fan , Tong Zhao , Elham Ghazizadeh , Yan Wu , Neil Shah , Yozen Liu

Scaling the size of a model enhances its capabilities but significantly increases computation complexity. Mixture-of-Experts models (MoE) address the issue by allowing model size to scale up without substantially increasing training or…

Computation and Language · Computer Science 2024-08-30 Zhenpeng Su , Zijia Lin , Xue Bai , Xing Wu , Yizhe Xiong , Haoran Lian , Guangyuan Ma , Hui Chen , Guiguang Ding , Wei Zhou , Songlin Hu

Recommendation systems play a vital role in many online platforms, with their primary objective being to satisfy and retain users. As directly optimizing user retention is challenging, multiple evaluation metrics are often employed.…

Information Retrieval · Computer Science 2023-06-22 Wanda Li , Wenhao Zheng , Xuanji Xiao , Suhang Wang

We introduce CommerceMM - a multimodal model capable of providing a diverse and granular understanding of commerce topics associated to the given piece of content (image, text, image+text), and having the capability to generalize to a wide…

Computer Vision and Pattern Recognition · Computer Science 2022-02-16 Licheng Yu , Jun Chen , Animesh Sinha , Mengjiao MJ Wang , Hugo Chen , Tamara L. Berg , Ning Zhang