English
Related papers

Related papers: Towards Transfer-Efficient Multi-modal Sequential …

200 papers

As one of the most effective methods for cardiovascular disease (CVD) diagnosis, multi-lead Electrocardiogram (ECG) signals present a characteristic multi-sensor information fusion challenge that has been continuously researched in deep…

Signal Processing · Electrical Eng. & Systems 2025-09-04 Huaicheng Zhang , Ruoxin Wang , Chenlian Zhou , Jiguang Shi , Yue Ge , Zhoutong Li , Sheng Chang , Hao Wang , Jin He , Qijun Huang

Recently, the state space model (SSM) represented by Mamba has shown remarkable performance in long-term sequence modeling tasks, including speech enhancement. However, due to substantial differences in sub-band features, applying the same…

Sound · Computer Science 2025-02-25 Jizhen Li , Weiping Tu , Yuhong Yang , Xinmeng Xu , Yiqun Zhang , Yanzhen Ren

Decision Transformer, a promising approach that applies Transformer architectures to reinforcement learning, relies on causal self-attention to model sequences of states, actions, and rewards. While this method has shown competitive…

Machine Learning · Computer Science 2024-04-01 Toshihiro Ota

Sequential Recommender Systems (SRSs) have emerged as a highly efficient approach to recommendation systems. By leveraging sequential data, SRSs can identify temporal patterns in user behaviour, significantly improving recommendation…

Multimodal Sentiment Analysis (MSA) aims to predict sentiment from language, acoustic, and visual data in videos. However, imbalanced unimodal performance often leads to suboptimal fused representations. Existing approaches typically adopt…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Dingkang Yang , Mingcheng Li , Xuecheng Wu , Zhaoyu Chen , Kaixun Jiang , Keliang Liu , Peng Zhai , Lihua Zhang

Despite recent advancements in language and vision modeling, integrating rich multimodal knowledge into recommender systems continues to pose significant challenges. This is primarily due to the need for efficient recommendation, which…

Information Retrieval · Computer Science 2024-10-03 Yueqi Wang , Zhenrui Yue , Huimin Zeng , Dong Wang , Julian McAuley

Selective state-space models (SSMs) like Mamba overcome some of the shortcomings of Transformers, such as quadratic computational complexity with sequence length and large inference-time memory requirements from the key-value cache.…

Video super-resolution (VSR) faces critical challenges in effectively modeling non-local dependencies across misaligned frames while preserving computational efficiency. Existing VSR methods typically rely on optical flow strategies or…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Linfeng He , Meiqin Liu , Qi Tang , Chao Yao , Yao Zhao

Characterizing users' interests accurately plays a significant role in an effective recommender system. The sequential recommender system can learn powerful hidden representations of users from successive user-item interactions and dynamic…

Social and Information Networks · Computer Science 2020-11-24 Lingxiao Zhang , Jiangpeng Yan , Yujiu Yang , Xiu Li

Deep motion forecasting models have achieved great success when trained on a massive amount of data. Yet, they often perform poorly when training data is limited. To address this challenge, we propose a transfer learning approach for…

Computer Vision and Pattern Recognition · Computer Science 2022-11-08 Parth Kothari , Danya Li , Yuejiang Liu , Alexandre Alahi

Sequential recommender systems (SRS) have become the key technology in capturing user's dynamic interests and generating high-quality recommendations. Current state-of-the-art sequential recommender models are typically based on a…

Information Retrieval · Computer Science 2020-05-27 Yang Sun , Fajie Yuan , Min Yang , Guoao Wei , Zhou Zhao , Duo Liu

Recently, the Mamba architecture based on state space models has demonstrated remarkable performance in a series of natural language processing tasks and has been rapidly applied to remote sensing change detection (CD) tasks. However, most…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Haotian Zhang , Keyan Chen , Chenyang Liu , Hao Chen , Zhengxia Zou , Zhenwei Shi

Processing long temporal sequences is a key challenge in deep learning. In recent years, Transformers have become state-of-the-art for this task, but suffer from excessive memory requirements due to the need to explicitly store the…

Machine Learning · Computer Science 2025-07-09 Sebastian Siegel , Ming-Jay Yang , John-Paul Strachan

Recent advances in sequence modeling have introduced selective SSMs as promising alternatives to Transformer architectures, offering theoretical computational efficiency and sequence processing advantages. A comprehensive understanding of…

Machine Learning · Computer Science 2025-12-01 Abdullah Al Asif , Mobina Kashaniyan , Sixing Yu , Juan Pablo Muñoz , Ali Jannesari

Robust feature representations are essential for learning-based Multi-View Stereo (MVS), which relies on accurate feature matching. Recent MVS methods leverage Transformers to capture long-range dependencies based on local features…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Jianfei Jiang , Qiankun Liu , Hongyuan Liu , Haochen Yu , Liyong Wang , Jiansheng Chen , Huimin Ma

The sequential recommendation system utilizes historical user interactions to predict preferences. Effectively integrating diverse user behavior patterns with rich multimodal information of items to enhance the accuracy of sequential…

Information Retrieval · Computer Science 2025-08-08 Xiaoxi Cui , Weihai Lu , Yu Tong , Yiheng Li , Zhejun Zhao

Multimodal recommendation systems are increasingly popular for their potential to improve performance by integrating diverse data types. However, the actual benefits of this integration remain unclear, raising questions about when and how…

Information Retrieval · Computer Science 2025-08-08 Hongyu Zhou , Yinan Zhang , Aixin Sun , Zhiqi Shen

State-space models (SSMs) have recently shown promise in capturing long-range dependencies with subquadratic computational complexity, making them attractive for various applications. However, purely SSM-based models face critical…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Abdelrahman Shaker , Syed Talal Wasim , Salman Khan , Juergen Gall , Fahad Shahbaz Khan

State Space Models (SSMs) are emerging as a compelling alternative to Transformers because of their consistent memory usage and high performance. Despite this, scaling up SSMs on cloud services or limited-resource devices is challenging due…

Machine Learning · Computer Science 2025-11-07 Hung-Yueh Chiang , Chi-Chih Chang , Natalia Frumkin , Kai-Chiang Wu , Mohamed S. Abdelfattah , Diana Marculescu

Generative recommendation (GR) has become a powerful paradigm in recommendation systems that implicitly links modality and semantics to item representation, in contrast to previous methods that relied on non-semantic item identifiers in…

Information Retrieval · Computer Science 2025-04-01 Jing Zhu , Mingxuan Ju , Yozen Liu , Danai Koutra , Neil Shah , Tong Zhao