English
Related papers

Related papers: Modality Alignment with Multi-scale Bilateral Atte…

200 papers

The integration of multimodal information into sequential recommender systems has attracted significant attention in recent research. In the initial stages of multimodal sequential recommendation models, the mainstream paradigm was…

Information Retrieval · Computer Science 2024-03-06 Jiaxi Hu , Jingtong Gao , Xiangyu Zhao , Yuehong Hu , Yuxuan Liang , Yiqi Wang , Ming He , Zitao Liu , Hongzhi Yin

Multi-modal image segmentation faces real-world deployment challenges from incomplete/corrupted modalities degrading performance. While existing methods address training-inference modality gaps via specialized per-combination models, they…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Xiaoqi Zhao , Youwei Pang , Chenyang Yu , Lihe Zhang , Huchuan Lu , Shijian Lu , Georges El Fakhri , Xiaofeng Liu

Recently, significant progress has been made in sequential recommendation with deep learning. Existing neural sequential recommendation models usually rely on the item prediction loss to learn model parameters or data representations.…

Information Retrieval · Computer Science 2020-08-19 Kun Zhou , Hui Wang , Wayne Xin Zhao , Yutao Zhu , Sirui Wang , Fuzheng Zhang , Zhongyuan Wang , Ji-Rong Wen

While thinking-aware generation aims to improve performance on complex tasks, we identify a critical failure mode where existing sequential, autoregressive approaches can paradoxically degrade performance due to error propagation. To…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Ye Tian , Ling Yang , Jiongfan Yang , Anran Wang , Yu Tian , Jiani Zheng , Haochen Wang , Zhiyang Teng , Zhuochen Wang , Yinjie Wang , Yunhai Tong , Mengdi Wang , Xiangtai Li

The multimodal recommendation has gradually become the infrastructure of online media platforms, enabling them to provide personalized service to users through a joint modeling of user historical behaviors (e.g., purchases, clicks) and item…

Information Retrieval · Computer Science 2024-04-19 Zhiqiang Guo , Jianjun Li , Guohui Li , Chaoyang Wang , Si Shi , Bin Ruan

Sequential Recommendation (SR) in multimodal settings typically relies on small frozen pretrained encoders, which limits semantic capacity and prevents Collaborative Filtering (CF) signals from being fully integrated into item…

Information Retrieval · Computer Science 2026-03-19 Junyoung Kim , Woojoo Kim , Jaehyung Lim , Dongha Kim , Hwanjo Yu

Recommender systems have long been built upon the modeling of interactions between users and items, while recent studies have sought to broaden this paradigm by generalizing to new users and items, incorporating diverse information sources,…

Information Retrieval · Computer Science 2025-10-28 Chanyoung Chung , Kyeongryul Lee , Sunbin Park , Joyce Jiyoung Whang

Multimodal Dataset Distillation (MDD) seeks to condense large-scale image-text datasets into compact surrogates while retaining their effectiveness for cross-modal learning. Despite recent progress, existing MDD approaches often suffer from…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Xin Zhang , Ziruo Zhang , Jiawei Du , Zuozhu Liu , Joey Tianyi Zhou

Recent deep sequential recommendation models often struggle to effectively model key characteristics of user behaviors, particularly in handling sequence length variations and capturing diverse interaction patterns. We propose STAR-Rec, a…

Information Retrieval · Computer Science 2025-05-07 Maolin Wang , Sheng Zhang , Ruocheng Guo , Wanyu Wang , Xuetao Wei , Zitao Liu , Hongzhi Yin , Yi Chang , Xiangyu Zhao

In recent years, deep learning has shown near-expert performance in segmenting complex medical tissues and tumors. However, existing models are often task-specific, with performance varying across modalities and anatomical regions.…

Computer Vision and Pattern Recognition · Computer Science 2025-10-30 T-Mai Bui , Fares Bougourzi , Fadi Dornaika , Vinh Truong Hoang

Contemporary real-time video communication systems, such as WebRTC, use an adaptive bitrate (ABR) algorithm to assure high-quality and low-delay services, e.g., promptly adjusting video bitrate according to the instantaneous network…

Multimedia · Computer Science 2023-08-08 Yueheng Li , Zicheng Zhang , Hao Chen , Zhan Ma

Recent advancements of sequential deep learning models such as Transformer and BERT have significantly facilitated the sequential recommendation. However, according to our study, the distribution of item embeddings generated by these models…

Information Retrieval · Computer Science 2021-11-19 Ruihong Qiu , Zi Huang , Hongzhi Yin , Zijian Wang

Multi-modal fusion holds great promise for integrating information from different modalities. However, due to a lack of consideration for modal consistency, existing multi-modal fusion methods in the field of remote sensing still face…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Mingxiang Cao , Weiying Xie , Xin Zhang , Jiaqing Zhang , Kai Jiang , Jie Lei , Yunsong Li

The self-attention mechanism, which equips with a strong capability of modeling long-range dependencies, is one of the extensively used techniques in the sequential recommendation field. However, many recent studies represent that current…

Information Retrieval · Computer Science 2023-05-18 Xinyu Du , Huanhuan Yuan , Pengpeng Zhao , Jianfeng Qu , Fuzhen Zhuang , Guanfeng Liu , Victor S. Sheng

The evolution of recommender systems has shifted from traditional collaborative filtering to LLM-based agentic systems, which rely on semantic user and item memories to make predictions. However, existing agents maintain these memories in…

Information Retrieval · Computer Science 2026-04-29 Weixin Chen , Yuhan Zhao , Jingyuan Huang , Zihe Ye , Clark Mingxuan Ju , Tong Zhao , Neil Shah , Li Chen , Yongfeng Zhang

Deep neural networks have emerged as a powerful technique for learning representations from user-item interaction data in collaborative filtering (CF) for recommender systems. However, many existing methods heavily rely on unique user and…

Information Retrieval · Computer Science 2025-10-21 Xubin Ren , Chao Huang

Conventional multimodal recommender systems predominantly leverage Bayesian Personalized Ranking (BPR) optimization to learn item representations by amalgamating item identity (ID) embeddings with multimodal features. Nevertheless, our…

Information Retrieval · Computer Science 2025-05-09 Xin Zhou , Xiaoxiong Zhang , Dusit Niyato , Zhiqi Shen

Multi-modality image fusion, particularly infrared and visible, plays a crucial role in integrating diverse modalities to enhance scene understanding. Although early research prioritized visual quality, preserving fine details and adapting…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Guanyao Wu , Haoyu Liu , Hongming Fu , Yichuan Peng , Jinyuan Liu , Xin Fan , Risheng Liu

Multimodal learning leverages complementary information derived from different modalities, thereby enhancing performance in medical image segmentation. However, prevailing multimodal learning methods heavily rely on extensive well-annotated…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Xiaogen Zhou , Yiyou Sun , Min Deng , Winnie Chiu Wing Chu , Qi Dou

Multimodal recommendation aims to recommend user-preferred candidates based on her/his historically interacted items and associated multimodal information. Previous studies commonly employ an embed-and-retrieve paradigm: learning user and…

Information Retrieval · Computer Science 2026-01-15 Han Liu , Yinwei Wei , Xuemeng Song , Weili Guan , Yuan-Fang Li , Liqiang Nie