English
Related papers

Related papers: Random Attention Span

200 papers

In this paper, we introduce the latent racial bias, a metric and method to evaluate the racial bias within specific events. For the purpose of this paper we explore the British Home Office dataset of stop-and-search incidents. We explore…

Applications · Statistics 2020-05-28 Akbir Khan

This paper introduces a novel methodology that utilizes latency to unveil time-series dependence patterns. A customized statistical test detects memory dependence in event sequences by analyzing their inter-event time distributions.…

Econometrics · Economics 2023-09-22 Fabio Vanni , David Lambert

The aim of session-based recommendation is to predict the users' next clicked item, which is a challenging task due to the inherent uncertainty in user behaviors and anonymous implicit feedback information. A powerful session-based…

Information Retrieval · Computer Science 2020-07-27 Jing Zhu , Yanan Xu , Yanmin Zhu

User interests are usually dynamic in the real world, which poses both theoretical and practical challenges for learning accurate preferences from rich behavior data. Among existing user behavior modeling solutions, attention networks are…

Information Retrieval · Computer Science 2022-04-14 Chao Chen , Haoyu Geng , Nianzu Yang , Junchi Yan , Daiyue Xue , Jianping Yu , Xiaokang Yang

Neural processes (NPs) learn stochastic processes and predict the distribution of target output adaptively conditioned on a context set of observed input-output pairs. Furthermore, Attentive Neural Process (ANP) improved the prediction…

Machine Learning · Computer Science 2019-10-22 Shenghao Qin , Jiacheng Zhu , Jimmy Qin , Wenshuo Wang , Ding Zhao

Session-based recommendation aims to predict user's next behavior from current session and previous anonymous sessions. Capturing long-range dependencies between items is a vital challenge in session-based recommendation. A novel approach…

Information Retrieval · Computer Science 2021-02-04 Jun Fang

Capturing the temporal dynamics of user preferences over items is important for recommendation. Existing methods mainly assume that all time steps in user-item interaction history are equally relevant to recommendation, which however does…

Information Retrieval · Computer Science 2017-09-08 Wenjie Pei , Jie Yang , Zhu Sun , Jie Zhang , Alessandro Bozzon , David M. J. Tax

In this paper we study a rational inattention model in environments where the decision maker faces uncertainty about the true prior distribution over states. The decision maker seeks to select a stochastic choice rule over a finite set of…

Theoretical Economics · Economics 2023-05-08 Emerson Melo

This paper proposes a variational self-attention model (VSAM) that employs variational inference to derive self-attention. We model the self-attention vector as random variables by imposing a probabilistic distribution. The self-attention…

Computation and Language · Computer Science 2020-03-11 Qiang Zhang , Shangsong Liang , Emine Yilmaz

Response-adaptive randomization has recently attracted a lot of attention in the literature. In this paper, we propose a new and simple family of response-adaptive randomization procedures that attain the Cramer--Rao lower bounds on the…

Statistics Theory · Mathematics 2009-08-25 Feifang Hu , Li-Xin Zhang , Xuming He

Pervasive and ubiquitous computing facilitates immediate access to information in the sense of always-on. Information such as news, messages, or reminders can significantly enhance our daily routines but are rendered useless or disturbing…

Human-Computer Interaction · Computer Science 2022-12-20 Christoph Anderson , Judith Simone Heinisch , Shohreh Deldari , Flora D. Salim , Sandra Ohly , Klaus David , Veljko Pejovic

Recent deep sequential recommendation models often struggle to effectively model key characteristics of user behaviors, particularly in handling sequence length variations and capturing diverse interaction patterns. We propose STAR-Rec, a…

Information Retrieval · Computer Science 2025-05-07 Maolin Wang , Sheng Zhang , Ruocheng Guo , Wanyu Wang , Xuetao Wei , Zitao Liu , Hongzhi Yin , Yi Chang , Xiangyu Zhao

Sequential recommendation aims to recommend the next item of users' interest based on their historical interactions. Recently, the self-attention mechanism has been adapted for sequential recommendation, and demonstrated state-of-the-art…

Information Retrieval · Computer Science 2022-09-19 Bo Peng , Srinivasan Parthasarathy , Xia Ning

The goal of this article is to investigate how human participants allocate their limited time to decisions with different properties. We report the results of two behavioral experiments. In each trial of the experiments, the participant…

Neurons and Cognition · Quantitative Biology 2016-07-20 Arash Khodadadi , Pegah Fakhari , Jerome R. Busemeyer

Selective prediction, where a model has the option to abstain from making a decision, is crucial for machine learning applications in which mistakes are costly. In this work, we focus on distributional regression and introduce a framework…

Statistics Theory · Mathematics 2025-04-01 Ahmed Zaoui , Clément Dombry

Recurrent neural networks (RNNs) have achieved great success in language modeling. However, since the RNNs have fixed size of memory, their memory cannot store all the information about the words it have seen before in the sentence, and…

Computation and Language · Computer Science 2016-11-29 Da-Rong Liu , Shun-Po Chuang , Hung-yi Lee

A user can be represented as what he/she does along the history. A common way to deal with the user modeling problem is to manually extract all kinds of aggregated features over the heterogeneous behaviors, which may fail to fully represent…

Artificial Intelligence · Computer Science 2017-11-28 Chang Zhou , Jinze Bai , Junshuai Song , Xiaofei Liu , Zhengchao Zhao , Xiusi Chen , Jun Gao

While linear attention architectures offer efficient inference, compressing unbounded history into a fixed-size memory inherently limits expressivity and causes information loss. To address this limitation, we introduce Random Access Memory…

Machine Learning · Computer Science 2026-02-13 Kaicheng Xiao , Haotian Li , Liran Dong , Guoliang Xing

To choose between two discrete goods, a consumer pays attention to only those with prices below a threshold. From these, she chooses her most preferred good. We assume consumers in a population have the same preference but may have…

Theoretical Economics · Economics 2025-11-07 Kaushil Patel

Sequential recommendation predicts users' next behaviors with their historical interactions. Recommending with longer sequences improves recommendation accuracy and increases the degree of personalization. As sequences get longer, existing…

Information Retrieval · Computer Science 2022-09-05 Qianying Lin , Wen-Ji Zhou , Yanshi Wang , Qing Da , Qing-Guo Chen , Bing Wang