English
Related papers

Related papers: Multi-Label Product Categorization Using Multi-Mod…

200 papers

Classification is a fundamental task in machine learning. While conventional methods-such as binary, multiclass, and multi-label classification-are effective for simpler problems, they may not adequately address the complexities of some…

Competitive methods for multi-label classification typically invest in learning labels together. To do so in a beneficial way, analysis of label dependence is often seen as a fundamental step, separate and prior to constructing a…

Machine Learning · Statistics 2017-07-19 Jesse Read , Jaakko Hollmén

Integrating diverse data modalities is crucial for enhancing the performance of personalized recommendation systems. Traditional models, which often rely on singular data sources, lack the depth needed to accurately capture the multifaceted…

Information Retrieval · Computer Science 2025-02-18 Luyi Ma , Xiaohan Li , Zezhong Fan , Kai Zhao , Jianpeng Xu , Jason Cho , Praveen Kanumala , Kaushiki Nag , Sushant Kumar , Kannan Achan

Recently, the cross-modal pretraining model has been employed to produce meaningful pseudo-labels to supervise the training of an image clustering model. However, numerous erroneous alignments in a cross-modal pre-training model could…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Liping Qiu , Qin Zhang , Xiaojun Chen , Shaotian Cai

This paper introduces a new multi-modal model based on the Transformer architecture and tensor product fusion strategy, combining BERT's text vectors and ViT's image vectors to classify students' psychological conditions, with an accuracy…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Ao Xiang , Zongqing Qi , Han Wang , Qin Yang , Danqing Ma

Modern e-commerce search is inherently multimodal: customers make purchase decisions by jointly considering product text and visual informations. However, most industrial retrieval and ranking systems primarily rely on textual information,…

Information Retrieval · Computer Science 2026-03-06 Qujiaheng Zhang , Guagnyue Xu , Fengjie Li

Multimodal information processing has become increasingly important for enhancing image classification performance. However, the intricate and implicit dependencies across different modalities often hinder conventional methods from…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Yang Qiao , Xiaoyu Zhong , Xiaofeng Gu , Zhiguo Yu

This study investigates a hybrid method for text classification that integrates deep feature extraction from large language models, multi-scale fusion through feature pyramids, and structured modeling with graph neural networks to enhance…

Computation and Language · Computer Science 2025-11-11 Xiangchen Song , Yulin Huang , Jinxu Guo , Yuchen Liu , Yaxuan Luan

In modern e-commerce, item content features in various modalities offer accurate yet comprehensive information to recommender systems. The majority of previous work either focuses on learning effective item representation during modelling…

Information Retrieval · Computer Science 2024-08-15 Hao Wu , Alejandro Ariza-Casabona , Bartłomiej Twardowski , Tri Kurniawan Wijaya

Visual recognition inside the vehicle cabin leads to safer driving and more intuitive human-vehicle interaction but such systems face substantial obstacles as they need to capture different granularities of driver behaviour while dealing…

Computer Vision and Pattern Recognition · Computer Science 2022-04-12 Alina Roitberg , Kunyu Peng , Zdravko Marinov , Constantin Seibold , David Schneider , Rainer Stiefelhagen

Recent advances in product bundling have leveraged multimodal information through sophisticated encoders, but remain constrained by limited semantic understanding and a narrow scope of knowledge. Therefore, some attempts employ In-context…

Information Retrieval · Computer Science 2025-02-04 Xiaohao Liu , Jie Wu , Zhulin Tao , Yunshan Ma , Yinwei Wei , Tat-seng Chua

This paper addresses the question of emotion classification. The task consists in predicting emotion labels (taken among a set of possible labels) best describing the emotions contained in short video clips. Building on a standard framework…

Computer Vision and Pattern Recognition · Computer Science 2017-09-22 Valentin Vielzeuf , Stéphane Pateux , Frédéric Jurie

Multi-label image classification, which can be categorized into label-dependency and region-based methods, is a challenging problem due to the complex underlying object layouts. Although region-based methods are less likely to encounter…

Computer Vision and Pattern Recognition · Computer Science 2022-11-24 Jiawei Zhan , Jun Liu , Wei Tang , Guannan Jiang , Xi Wang , Bin-Bin Gao , Tianliang Zhang , Wenlong Wu , Wei Zhang , Chengjie Wang , Yuan Xie

We develop a novel probabilistic approach for multi-label classification that is based on the mixtures-of-experts architecture combined with recently introduced conditional tree-structured Bayesian networks. Our approach captures different…

Machine Learning · Computer Science 2014-09-17 Charmgil Hong , Iyad Batal , Milos Hauskrecht

Image classification is one of the most important areas in computer vision. Hierarchical multi-label classification applies when a multi-class image classification problem is arranged into smaller ones based upon a hierarchy or taxonomy.…

Computer Vision and Pattern Recognition · Computer Science 2022-09-14 Khondaker Tasrif Noor , Antonio Robles-Kelly , Brano Kusy

Multimodal recommendation has emerged as a promising solution to alleviate the cold-start and sparsity problems in collaborative filtering by incorporating rich content information, such as product images and textual descriptions. However,…

Information Retrieval · Computer Science 2025-06-03 Sibei Liu , Yuanzhe Zhang , Xiang Li , Yunbo Liu , Chengwei Feng , Hao Yang

Multi-label (ML) classification is an actively researched topic currently, which deals with convoluted and overlapping boundaries that arise due to several labels being active for a particular data instance. We propose a classifier capable…

Machine Learning · Computer Science 2021-07-22 Anwesha Law , Ashish Ghosh

Recent years have witnessed growing interests in multimedia recommendation, which aims to predict whether a user will interact with an item with multimodal contents. Previous studies focus on modeling user-item interactions with multimodal…

Information Retrieval · Computer Science 2022-03-18 Jinghao Zhang , Yanqiao Zhu , Qiang Liu , Mengqi Zhang , Shu Wu , Liang Wang

Semi-supervised learning addresses the issue of limited annotations in medical images effectively, but its performance is often inadequate for complex backgrounds and challenging tasks. Multi-modal fusion methods can significantly improve…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Dongdong Meng , Sheng Li , Hao Wu , Guoping Wang , Xueqing Yan

Classification of social media data is an important approach in understanding user behavior on the Web. Although information on social media can be of different modalities such as texts, images, audio or videos, traditional approaches in…

Computation and Language · Computer Science 2017-08-08 Chi Thang Duong , Remi Lebret , Karl Aberer