English
Related papers

Related papers: Boosting Multi-Modal E-commerce Attribute Value Ex…

200 papers

In e-commerce advertising, selecting the most compelling combination of creative elements -- such as titles, images, and highlights -- is critical for capturing user attention and driving conversions. However, existing methods often…

Machine Learning · Computer Science 2025-08-14 Qiaolei Gu , Yu Li , DingYi Zeng , Lu Wang , Ming Pang , Changping Peng , Zhangang Lin , Ching Law , Jingping Shao

Information extraction, e.g., attribute value extraction, has been extensively studied and formulated based only on text. However, many attributes can benefit from image-based extraction, like color, shape, pattern, among others. The visual…

Computation and Language · Computer Science 2023-06-05 Hejie Cui , Rongmei Lin , Nasser Zalmout , Chenwei Zhang , Jingbo Shang , Carl Yang , Xian Li

E-commerce platforms should provide detailed product descriptions (attribute values) for effective product search and recommendation. However, attribute value information is typically not available for new products. To predict unseen…

Information Retrieval · Computer Science 2024-02-15 Jiaying Gong , Hoda Eldardiry

In large scale e-commerce marketplaces, duplicate product listings frequently cause consumer confusion and operational inefficiencies, degrading trust on the platform and increasing costs. Traditional keyword-based search methodologies…

Information Retrieval · Computer Science 2025-12-02 Aysenur Kulunk , Berk Taskin , M. Furkan Eseoglu , H. Bahadir Sahin

Modern e-commerce search is inherently multimodal: customers make purchase decisions by jointly considering product text and visual informations. However, most industrial retrieval and ranking systems primarily rely on textual information,…

Information Retrieval · Computer Science 2026-03-06 Qujiaheng Zhang , Guagnyue Xu , Fengjie Li

Structured product data, in the form of attribute-value pairs, is essential for e-commerce platforms to support features such as faceted product search and attribute-based product comparison. However, vendors often provide unstructured…

Computation and Language · Computer Science 2025-02-17 Alexander Brinkmann , Christian Bizer

In e-commerce, content quality of the product catalog plays a key role in delivering a satisfactory experience to the customers. In particular, visual content such as product images influences customers' engagement and purchase decisions.…

Computer Vision and Pattern Recognition · Computer Science 2018-11-21 Abon Chaudhuri , Paolo Messina , Samrat Kokkula , Aditya Subramanian , Abhinandan Krishnan , Shreyansh Gandhi , Alessandro Magnani , Venkatesh Kandaswamy

It is a challenging and practical research problem to obtain effective compression of lengthy product titles for E-commerce. This is particularly important as more and more users browse mobile E-commerce apps and more merchants make the…

Computation and Language · Computer Science 2018-01-08 Jingang Wang , Junfeng Tian , Long Qiu , Sheng Li , Jun Lang , Luo Si , Man Lan

Multimodal product retrieval systems in e-commerce platforms rely on effectively combining visual and textual signals to improve search relevance and user experience. However, vision-language models such as CLIP are vulnerable to…

Machine Learning · Computer Science 2025-11-10 Janet Jenq , Hongda Shen

Meta-learning approaches have shown great success in vision and language domains. However, few studies discuss the practice of meta-learning for large-scale industrial applications. Although e-commerce companies have spent many efforts on…

Machine Learning · Computer Science 2020-10-12 Hao Gong , Qifang Zhao , Tianyu Li , Derek Cho , DuyKhuong Nguyen

Structured product data in the form of attribute/value pairs is the foundation of many e-commerce applications such as faceted product search, product comparison, and product recommendation. Product offers often only contain textual…

Computation and Language · Computer Science 2023-06-28 Alexander Brinkmann , Roee Shraga , Reng Chiz Der , Christian Bizer

Businesses can benefit from customer feedback in different modalities, such as text and images, to enhance their products and services. However, it is difficult to extract actionable and relevant pairs of text segments and images from…

Computation and Language · Computer Science 2024-10-15 Sandeep Sricharan Mukku , Abinesh Kanagarajan , Pushpendu Ghosh , Chetan Aggarwal

Industrial anomaly detection based on RGB-3D multimodal data has emerged as a mainstream paradigm for intelligent quality inspection. However, existing unsupervised methods suffer from two critical limitations: ambiguous cross-modal…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Zewen Li , Shuo Ye , Zitong Yu , Weicheng Xie , Linlin Shen

In this paper, we address multi-modal pretraining of product data in the field of E-commerce. Current multi-modal pretraining methods proposed for image and text modalities lack robustness in the face of modality-missing and modality-noise,…

Computer Vision and Pattern Recognition · Computer Science 2021-09-03 Yushan Zhu , Huaixiao Tou , Wen Zhang , Ganqiang Ye , Hui Chen , Ningyu Zhang , Huajun Chen

Multi-modal recommendation systems aim to enhance performance by integrating an item's content features across various modalities with user behavior data. Effective utilization of features from different modalities requires addressing two…

Information Retrieval · Computer Science 2025-02-27 Hang Zhou , Yucheng Wang , Huijing Zhan

We consider the problem of constraining diffusion model outputs with a user-supplied reference image. Our key objective is to extract multiple attributes (e.g., color, object, layout, style) from this single reference image, and then…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Aishwarya Agarwal , Srikrishna Karanam , Tripti Shukla , Balaji Vasan Srinivasan

Improving performance in multiple domains is a challenging task, and often requires significant amounts of data to train and test models. Active learning techniques provide a promising solution by enabling models to select the most…

Machine Learning · Computer Science 2023-04-14 Anand Gokul Mahalingam , Aayush Shah , Akshay Gulati , Royston Mascarenhas , Rakshitha Panduranga

Accurately recommending products has long been a subject requiring in-depth research. This study proposes a multimodal paradigm for clothing recommendations. Specifically, it designs a multimodal analysis method that integrates clothing…

Information Retrieval · Computer Science 2024-10-22 Bingjie Huang , Qingyi Lu , Shuaishuai Huang , Xue-she Wang , Haowei Yang

The rapid growth of e-commerce requires robust multimodal representations that capture diverse signals from user-generated listings. Existing vision-language models (VLMs) typically align titles with primary images, i.e., single-view, but…

Information Retrieval · Computer Science 2025-12-23 Xiwen Chen , Yen-Chieh Lien , Susan Liu , María Castaños , Abolfazl Razi , Xiaoting Zhao , Congzhe Su

Generative retrieval introduces a groundbreaking paradigm to document retrieval by directly generating the identifier of a pertinent document in response to a specific query. This paradigm has demonstrated considerable benefits and…

Information Retrieval · Computer Science 2024-10-28 Mingming Li , Huimu Wang , Zuxu Chen , Guangtao Nie , Yiming Qiu , Guoyu Tang , Lin Liu , Jingwei Zhuo