English
Related papers

Related papers: A Hybrid Multimodal Deep Learning Framework for In…

200 papers

Recommender systems are ubiquitous in the domain of e-commerce, used to improve the user experience and to market inventory, thereby increasing revenue for the site. Techniques such as item-based collaborative filtering are used to model…

Information Retrieval · Computer Science 2018-12-31 Daniel A. Galron , Yuri M. Brovman , Jin Chung , Michal Wieja , Paul Wang

While multi-modal Visual Language Models (VLMs) have demonstrated significant success across various domains, the integration of VLMs into recommendation and retrieval systems remains a challenge, due to issues like training objective…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Josh Beal , Eric Kim , Jinfeng Rao , Rex Wu , Dmitry Kislyuk , Charles Rosenberg

Conventional multimodal recommender systems predominantly leverage Bayesian Personalized Ranking (BPR) optimization to learn item representations by amalgamating item identity (ID) embeddings with multimodal features. Nevertheless, our…

Information Retrieval · Computer Science 2025-05-09 Xin Zhou , Xiaoxiong Zhang , Dusit Niyato , Zhiqi Shen

How to recommend outfits has gained considerable attention in both academia and industry in recent years. Many studies have been carried out regarding fashion compatibility learning, to determine whether the fashion items in an outfit are…

Computer Vision and Pattern Recognition · Computer Science 2025-02-14 Dongliang Zhou , Haijun Zhang , Qun Li , Jianghong Ma , Xiaofei Xu

We present Loom, an outfit recommendation system that combines neural embedding retrieval with structured domain scoring to generate complete, coherent outfits from fashion catalogs. Given an anchor clothing item, Loom retrieves…

Information Retrieval · Computer Science 2026-05-12 Anushree Berlia

Multimodal recommendation systems integrate diverse multimodal information into the feature representations of both items and users, thereby enabling a more comprehensive modeling of user preferences. However, existing methods are hindered…

Multimedia · Computer Science 2025-01-03 Qiya Song , Jiajun Hu , Lin Xiao , Bin Sun , Xieping Gao , Shutao Li

The clothing fashion reflects the common aesthetics that people share with each other in dressing. To recognize the fashion time of a clothing is meaningful for both an individual and the industry. In this paper, under the assumption that…

Computer Vision and Pattern Recognition · Computer Science 2018-03-14 Zheng Zhang , Chengfang Song , Qin Zou

TIReID aims to retrieve the image corresponding to the given text query from a pool of candidate images. Existing methods employ prior knowledge from single-modality pre-training to facilitate learning, but lack multi-modal correspondences.…

Computer Vision and Pattern Recognition · Computer Science 2022-10-20 Shuanglin Yan , Neng Dong , Liyan Zhang , Jinhui Tang

Food recommendation systems serve as pivotal components in the realm of digital lifestyle services, designed to assist users in discovering recipes and food items that resonate with their unique dietary predilections. Typically, multi-modal…

Information Retrieval · Computer Science 2025-02-28 Yixin Zhang , Xin Zhou , Qianwen Meng , Fanglin Zhu , Yonghui Xu , Zhiqi Shen , Lizhen Cui

The popularity of online fashion shopping continues to grow. The ability to offer an effective recommendation to customers is becoming increasingly important. In this work, we focus on Fashion Outfits Challenge, part of SIGIR 2022 Workshop…

Information Retrieval · Computer Science 2022-07-22 Mariya Hendriksen , Viggo Overes

Human fashion understanding is one crucial computer vision task since it has comprehensive information for real-world applications. This focus on joint human fashion segmentation and attribute recognition. Contrary to the previous works…

Computer Vision and Pattern Recognition · Computer Science 2022-07-12 Shilin Xu , Xiangtai Li , Jingbo Wang , Guangliang Cheng , Yunhai Tong , Dacheng Tao

When thinking about dressing oneself, people often have a theme in mind whether they're going to a tropical getaway or wish to appear attractive at a cocktail party. A useful outfit generation system should come up with clothing items that…

Computer Vision and Pattern Recognition · Computer Science 2019-11-19 Kedan Li , Chen Liu , David Forsyth

Nowadays, recommender systems and search engines play an integral role in fashion e-commerce. Still, many challenges lie ahead, and this study tries to tackle some. This article first suggests a content-based fashion recommender system that…

Information Retrieval · Computer Science 2022-07-26 Seyed Omid Mohammadi , Hossein Bodaghi , Ahmad Kalhor

The task of fashion recommendation includes two main challenges: visual understanding and visual matching. Visual understanding aims to extract effective visual features. Visual matching aims to model a human notion of compatibility to…

Information Retrieval · Computer Science 2019-08-27 Yujie Lin , Pengjie Ren , Zhumin Chen , Zhaochun Ren , Jun Ma , Maarten de Rijke

This work presents an open-source unified benchmarking and evaluation framework for text-to-image generation models, with a particular focus on the impact of metadata augmented prompts. Leveraging the DeepFashion-MultiModal dataset, we…

Graphics · Computer Science 2025-05-09 Kapil Wanaskar , Gaytri Jena , Magdalini Eirinaki

We propose a novel learning framework to answer questions such as "if a user is purchasing a shirt, what other items will (s)he need with the shirt?" Our framework learns distributed representations for items from available textual data,…

Machine Learning · Computer Science 2019-09-17 Mansi Ranjit Mane , Stephen Guo , Kannan Achan

Modelling mix-and-match relationships among fashion items has become increasingly demanding yet challenging for modern E-commerce recommender systems. When performing clothes matching, most existing approaches leverage the latent visual…

Information Retrieval · Computer Science 2021-07-06 Yang Li , Tong Chen , Zi Huang

Many vision-related tasks benefit from reasoning over multiple modalities to leverage complementary views of data in an attempt to learn robust embedding spaces. Most deep learning-based methods rely on a late fusion technique whereby…

Computer Vision and Pattern Recognition · Computer Science 2020-03-04 Austin Reiter , Menglin Jia , Pu Yang , Ser-Nam Lim

Fashion plays a pivotal role in society. Combining garments appropriately is essential for people to communicate their personality and style. Also different events require outfits to be thoroughly chosen to comply with underlying social…

Computer Vision and Pattern Recognition · Computer Science 2020-12-14 Lavinia De Divitiis , Federico Becattini , Claudio Baecchi , Alberto Del Bimbo

This paper extends fully-convolutional neural networks (FCN) for the clothing parsing problem. Clothing parsing requires higher-level knowledge on clothing semantics and contextual cues to disambiguate fine-grained categories. We extend FCN…

Computer Vision and Pattern Recognition · Computer Science 2017-05-03 Pongsate Tangseng , Zhipeng Wu , Kota Yamaguchi