English
Related papers

Related papers: HiSAC: Hierarchical Sparse Activation Compression …

200 papers

Characterizing users' interests accurately plays a significant role in an effective recommender system. The sequential recommender system can learn powerful hidden representations of users from successive user-item interactions and dynamic…

Social and Information Networks · Computer Science 2020-11-24 Lingxiao Zhang , Jiangpeng Yan , Yujiu Yang , Xiu Li

Contextual bandit learning is an increasingly popular approach to optimizing recommender systems via user feedback, but can be slow to converge in practice due to the need for exploring a large feature space. In this paper, we propose a…

Machine Learning · Computer Science 2012-07-03 Yisong Yue , Sue Ann Hong , Carlos Guestrin

The Segment Anything Model (SAM) achieves strong open-vocabulary segmentation, but its ViT-based image encoders dominate inference latency and memory. Existing activation compression methods, such as token merging, reduce the token length…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Hoai-Chau Tran , Chi H. Nguyen , Duy M. H. Nguyen , Mathias Niepert , Fan Lai , Khoa D. Doan

Leveraging long contexts is crucial for advanced AI systems, but attention computation poses a scalability challenge. While scaled dot-product attention (SDPA) exhibits token sparsity, i.e. only a few pivotal tokens significantly contribute…

Machine Learning · Computer Science 2025-06-05 Aditya Desai , Shuo Yang , Alejandro Cuadron , Matei Zaharia , Joseph E. Gonzalez , Ion Stoica

Modeling the evolution of user preference is essential in recommender systems. Recently, dynamic graph-based methods have been studied and achieved SOTA for recommendation, majority of which focus on user's stable long-term preference.…

Information Retrieval · Computer Science 2022-08-02 Huixuan Chi , Hao Xu , Hao Fu , Mengya Liu , Mengdi Zhang , Yuji Yang , Qinfen Hao , Wei Wu

Conversational recommendation systems (CRS) aim to timely and proactively acquire user dynamic preferred attributes through conversations for item recommendation. In each turn of CRS, there naturally have two decision-making processes with…

Information Retrieval · Computer Science 2023-07-27 Sen Zhao , Wei Wei , Yifan Liu , Ziyang Wang , Wendi Li , Xian-Ling Mao , Shuai Zhu , Minghui Yang , Zujie Wen

Capturing users' precise preferences is a fundamental problem in large-scale recommender system. Currently, item-based Collaborative Filtering (CF) methods are common matching approaches in industry. However, they are not effective to model…

Information Retrieval · Computer Science 2020-01-01 Fuyu Lv , Taiwei Jin , Changlong Yu , Fei Sun , Quan Lin , Keping Yang , Wilfred Ng

Heterogeneous information networks (HINs) are widely applied to recommendation systems due to their capability of modeling various auxiliary information with meta-paths. However, existing HIN-based recommendation models usually fuse the…

Information Retrieval · Computer Science 2022-03-09 Dengcheng Yan , Wenxin Xie , Yiwen Zhang

Estimating Click-Through Rate (CTR) is a vital yet challenging task in personalized product search. However, existing CTR methods still struggle in the product search settings due to the following three challenges including how to more…

Information Retrieval · Computer Science 2023-04-06 Qijie Shen , Hong Wen , Jing Zhang , Qi Rao

Sequential recommendation aims to model dynamic user behavior from historical interactions. Self-attentive methods have proven effective at capturing short-term dynamics and long-term preferences. Despite their success, these approaches…

Information Retrieval · Computer Science 2022-04-06 Jiacheng Li , Tong Zhao , Jin Li , Jim Chan , Christos Faloutsos , George Karypis , Soo-Min Pantel , Julian McAuley

We present an interface that can be leveraged to quickly and effortlessly elicit people's preferences for visual stimuli, such as photographs, visual art and screensavers, along with rich side-information about its users. We plan to employ…

Social and Information Networks · Computer Science 2017-06-28 Pantelis P. Analytis , Tobias Schnabel , Stefan Herzog , Daniel Barkoczi , Thorsten Joachims

Increasing the size of embedding layers has shown to be effective in improving the performance of recommendation models, yet gradually causing their sizes to exceed terabytes in industrial recommender systems, and hence the increase of…

Information Retrieval · Computer Science 2023-08-21 Beichuan Zhang , Chenggen Sun , Jianchao Tan , Xinjun Cai , Jun Zhao , Mengqi Miao , Kang Yin , Chengru Song , Na Mou , Yang Song

Hyperdimensional computing (HDC), also known as vector symbolic architectures (VSA), is a computing framework used within artificial intelligence and cognitive computing that operates with distributed vector representations of large fixed…

Artificial Intelligence · Computer Science 2022-05-18 Dmitri A. Rachkovskij , Denis Kleyko

Sequential recommendation, where user preference is dynamically inferred from sequential historical behaviors, is a critical task in recommender systems (RSs). To further optimize long-term user engagement, offline…

Machine Learning · Computer Science 2024-08-16 Jun Wang , Likang Wu , Qi Liu , Yu Yang

Diffusion Transformers (DiTs) set the state of the art in visual generation, yet their quadratic self-attention cost fundamentally limits scaling to long token sequences. Recent Top-K sparse attention approaches reduce the computation of…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Yifan Zhou , Zeqi Xiao , Tianyi Wei , Shuai Yang , Xingang Pan

Sequential recommendation is one of the most important tasks in recommender systems, which aims to recommend the next interacted item with historical behaviors as input. Traditional sequential recommendation always mainly considers the…

Information Retrieval · Computer Science 2023-08-09 Yunzhu Pan , Chen Gao , Jianxin Chang , Yanan Niu , Yang Song , Kun Gai , Depeng Jin , Yong Li

Sequential recommendation systems have become a cornerstone of personalized services, adept at modeling the temporal evolution of user preferences by capturing dynamic interaction sequences. Existing approaches predominantly rely on…

Information Retrieval · Computer Science 2025-05-15 Qianru Zhang , Honggang Wen , Wei Yuan , Crystal Chen , Menglin Yang , Siu-Ming Yiu , Hongzhi Yin

With the prevalence of social media, there has recently been a proliferation of recommenders that shift their focus from individual modeling to group recommendation. Since the group preference is a mixture of various predilections from…

Information Retrieval · Computer Science 2022-03-22 Junwei Zhang , Min Gao , Junliang Yu , Lei Guo , Jundong Li , Hongzhi Yin

The lifelong user behavior sequence provides abundant information of user preference and gains impressive improvement in the recommendation task, however increases computational consumption significantly. To meet the severe latency…

Information Retrieval · Computer Science 2024-06-17 Wenhui Yu , Chao Feng , Yanze Zhang , Lantao Hu , Peng Jiang , Han Li

The significance of modeling long-term user interests for CTR prediction tasks in large-scale recommendation systems is progressively gaining attention among researchers and practitioners. Existing work, such as SIM and TWIN, typically…