English
Related papers

Related papers: MOI-Mixer: Improving MLP-Mixer with Multi Order In…

200 papers

In urban computing, precise and swift forecasting of multivariate time series data from traffic networks is crucial. This data incorporates additional spatial contexts such as sensor placements and road network layouts, and exhibits complex…

Machine Learning · Computer Science 2024-12-19 Tongtong Zhang , Zhiyong Cui , Bingzhang Wang , Yilong Ren , Haiyang Yu , Pan Deng , Yinhai Wang

Sequential recommendation systems predict the next interaction item based on users' past interactions, aligning recommendations with individual preferences. Leveraging the strengths of Large Language Models (LLMs) in knowledge comprehension…

Information Retrieval · Computer Science 2025-01-22 Xiaoyu Kong , Jiancan Wu , An Zhang , Leheng Sheng , Hui Lin , Xiang Wang , Xiangnan He

We propose an algorithm for next query recommendation in interactive data exploration settings, like knowledge discovery for information gathering. The state-of-the-art query recommendation algorithms are based on sequence-to-sequence…

Information Retrieval · Computer Science 2024-07-08 Shameem A Puthiya Parambath , Christos Anagnostopoulos , Roderick Murray-Smith

Conventional recommendation systems succeed in identifying relevant content but often fail to provide users with surprising or novel items. Multimodal Large Language Models (MLLMs) possess the world knowledge and multimodal understanding…

Information Retrieval · Computer Science 2025-09-23 Haoting Wang , Jianling Wang , Hao Li , Fangjun Yi , Mengyu Fu , Youwei Zhang , Yifan Liu , Liang Liu , Minmin Chen , Ed H. Chi , Lichan Hong , Haokai Lu

Sequential Recommendation (SR) models user dynamics and predicts the next preferred items based on the user history. Existing SR methods model the 'was interacted before' item-item transitions observed in sequences, which can be viewed as…

Information Retrieval · Computer Science 2022-11-01 Ziwei Fan , Zhiwei Liu , Chen Wang , Peijie Huang , Hao Peng , Philip S. Yu

Recent studies have attempted to refine the Transformer architecture to demonstrate its effectiveness in Long-Term Time Series Forecasting (LTSF) tasks. Despite surpassing many linear forecasting models with ever-improving performance, we…

Machine Learning · Computer Science 2024-12-30 Peiwang Tang , Weitai Zhang

The Transformer architecture has dominated machine learning in a wide range of tasks. The specific characteristic of this architecture is an expensive scaled dot-product attention mechanism that models the inter-token interactions, which is…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Zizhao Hu , Mohammad Rostami

Recommender systems are indispensable in the realm of online applications, and sequential recommendation has enjoyed considerable prevalence due to its capacity to encapsulate the dynamic shifts in user interests. However, previous…

Information Retrieval · Computer Science 2024-04-16 Junzhe Jiang , Shang Qu , Mingyue Cheng , Qi Liu , Zhiding Liu , Hao Zhang , Rujiao Zhang , Kai Zhang , Rui Li , Jiatong Li , Min Gao

Sequential recommendations have drawn significant attention in modeling the user's historical behaviors to predict the next item. With the booming development of multimodal data (e.g., image, text) on internet platforms, sequential…

Information Retrieval · Computer Science 2024-12-12 Changhong Li , Zhiqiang Guo

Human preference alignment is critical in building powerful and reliable large language models (LLMs). However, current methods either ignore the multi-dimensionality of human preferences (e.g. helpfulness and harmlessness) or struggle with…

Machine Learning · Computer Science 2024-10-14 Xingzhou Lou , Junge Zhang , Jian Xie , Lifeng Liu , Dong Yan , Kaiqi Huang

Research on continual learning in multi-modal tasks has been receiving increasing attention. However, most existing work overlooks the explicit cross-modal and cross-task interactions. In this paper, we innovatively propose the Low-rank…

Computer Vision and Pattern Recognition · Computer Science 2025-01-27 Weicai Yan , Ye Wang , Wang Lin , Zirun Guo , Zhou Zhao , Tao Jin

Large Language Models (LLMs) lack persistent memory for long-term personalized conversations. Existing graph-based memory systems suffer from information dilution, absent provenance tracking, and uniform retrieval that ignores query…

Computation and Language · Computer Science 2026-05-05 Hung Pham Van , Nguyen Manh Hieu , Khang Pham Tran Tuan , Nam Le Hai , Linh Ngo Van , Nguyen Thi Ngoc Diep , Trung Le

Modeling user preferences (long-term history) and user dynamics (short-term history) is of greatest importance to build efficient sequential recommender systems. The challenge lies in the successful combination of the whole user's history…

Machine Learning · Computer Science 2021-03-31 Corentin Lonjarret , Roch Auburtin , Céline Robardet , Marc Plantevit

Recommender systems are one of the most successful applications of machine learning and data science. They are successful in a wide variety of application domains, including e-commerce, media streaming content, email marketing, and…

Information Retrieval · Computer Science 2023-04-04 Juan Pablo Equihua , Maged Ali , Henrik Nordmark , Berthold Lausen

What enables large language models (LLMs) to effectively model user preferences in sequential recommendation? Our investigation reveals that existing preference-alignment approaches largely rely on binary pairwise comparisons, overlooking…

Information Retrieval · Computer Science 2026-04-20 Zhongyu Ouyang , Qianlong Wen , Chunhui Zhang , Yanfang Ye , Soroush Vosoughi

In real-world reinforcement learning (RL) scenarios, agents often encounter partial observability, where incomplete or noisy information obscures the true state of the environment. Partially Observable Markov Decision Processes (POMDPs) are…

Machine Learning · Computer Science 2025-05-19 Ashok Arora , Neetesh Kumar

Sequential recommendation systems aim to provide personalized recommendations by analyzing dynamic preferences and dependencies within user behavior sequences. Recently, Transformer models can effectively capture user preferences. However,…

Information Retrieval · Computer Science 2024-07-30 Shun Zhang , Runsen Zhang , Zhirong Yang

This paper proposes a new neural architecture for collaborative ranking with implicit feedback. Our model, LRML (\textit{Latent Relational Metric Learning}) is a novel metric learning approach for recommendation. More specifically, instead…

Artificial Intelligence · Computer Science 2018-02-14 Yi Tay , Anh Tuan Luu , Siu Cheung Hui

In recent years, numerous Transformer-based models have been applied to long-term time-series forecasting (LTSF) tasks. However, recent studies with linear models have questioned their effectiveness, demonstrating that simple linear layers…

Machine Learning · Computer Science 2024-08-20 Jiaheng Yin , Zhengxin Shi , Jianshen Zhang , Xiaomin Lin , Yulin Huang , Yongzhi Qi , Wei Qi

In the last few years, the success of Transformers in computer vision has stimulated the discovery of many alternative models that compete with Transformers, such as the MLP-Mixer. Despite their weak inductive bias, these models have…

Machine Learning · Computer Science 2024-04-02 Toshihiro Ota , Masato Taki