English
Related papers

Related papers: Positional encoding is not the same as context: A …

200 papers

Time series analysis has gained significant attention due to its critical applications in diverse fields such as healthcare, finance, and sensor networks. The complexity and non-stationarity of time series make it challenging to capture the…

Machine Learning · Computer Science 2024-10-31 Guancen Lin , Cong Shen , Aijing Lin

Recommender systems have become an essential component of many online platforms, providing personalized recommendations to users. A crucial aspect is embedding techniques that convert the high-dimensional discrete features, such as user and…

Information Retrieval · Computer Science 2025-10-23 Maolin Wang , Xinjian Zhao , Wanyu Wang , Sheng Zhang , Jiansheng Li , Bowen Yu , Binhao Wang , Shucheng Zhou , Dawei Yin , Qing Li , Ruocheng Guo , Xiangyu Zhao

Spatial reasoning, the ability to understand spatial relations, causality, and dynamic evolution, is central to human intelligence and essential for real-world applications such as autonomous driving and robotics. Existing studies, however,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Yanguang Zhao , Jie Yang , Shengqiong Wu , Shutong Hu , Hongbo Qiu , Yu Wang , Guijia Zhang , Tan Kai Ze , Hao Fei , Chia-Wen Lin , Mong-Li Lee , Wynne Hsu

Sequential recommendation aims to predict users' future interactions by modeling collaborative filtering (CF) signals from historical behaviors of similar users or items. Traditional sequential recommenders predominantly rely on ID-based…

Information Retrieval · Computer Science 2025-06-30 Yingzhi He , Xiaohao Liu , An Zhang , Yunshan Ma , Tat-Seng Chua

Current state-of-the-art audio analysis systems rely on pre-trained embedding models, often used off-the-shelf as (frozen) feature extractors. Choosing the best one for a set of tasks is the subject of many recent publications. However, one…

Sound · Computer Science 2023-12-22 Aurian Quelennec , Michel Olvera , Geoffroy Peeters , Slim Essid

Multivariate time-series forecasting holds immense value across diverse applications, requiring methods to effectively capture complex temporal and inter-variable dynamics. A key challenge lies in uncovering the intrinsic patterns that…

Machine Learning · Computer Science 2025-03-12 Liang Yu , Lai Tu , Xiang Bai

We introduce a temporal feature encoding architecture called Time Series Representation Model (TSRM) for multivariate time series forecasting and imputation. The architecture is structured around CNN-based representation layers, each…

Machine Learning · Computer Science 2025-04-29 Robert Leppich , Michael Stenger , Daniel Grillmeyer , Vanessa Borst , Samuel Kounev

In recommender systems (RSs), predicting the next item that a user interacts with is critical for user retention. While the last decade has seen an explosion of RSs aimed at identifying relevant items that match user preferences, there is…

Machine Learning · Computer Science 2021-03-02 Zekarias T. Kefato , Sarunas Girdzijauskas , Nasrullah Sheikh , Alberto Montresor

We explore the power of spatial context as a self-supervisory signal for learning visual representations. In particular, we propose spatial context networks that learn to predict a representation of one image patch from another image patch,…

Computer Vision and Pattern Recognition · Computer Science 2019-01-31 Zuxuan Wu , Larry S. Davis , Leonid Sigal

In contrast to fully connected networks, Convolutional Neural Networks (CNNs) achieve efficiency by learning weights associated with local filters with a finite spatial extent. An implication of this is that a filter may know what it is…

Computer Vision and Pattern Recognition · Computer Science 2021-02-01 Md Amirul Islam , Matthew Kowal , Sen Jia , Konstantinos G. Derpanis , Neil D. B. Bruce

Temporal grounding, which localizes video moments related to a natural language query, is a core problem of vision-language learning and video understanding. To encode video moments of varying lengths, recent methods employ a multi-level…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Thong Thanh Nguyen , Yi Bin , Xiaobao Wu , Zhiyuan Hu , Cong-Duy T Nguyen , See-Kiong Ng , Anh Tuan Luu

Recent advances in Transformer models allow for unprecedented sequence lengths, due to linear space and time complexity. In the meantime, relative positional encoding (RPE) was proposed as beneficial for classical Transformers and consists…

Machine Learning · Computer Science 2021-06-11 Antoine Liutkus , Ondřej Cífka , Shih-Lun Wu , Umut Şimşekli , Yi-Hsuan Yang , Gaël Richard

Recommender systems have achieved great success in modeling user's preferences on items and predicting the next item the user would consume. Recently, there have been many efforts to utilize time information of users' interactions with…

Information Retrieval · Computer Science 2021-04-30 Junsu Cho , Dongmin Hyun , SeongKu Kang , Hwanjo Yu

Code search is a widely used technique by developers during software development. It provides semantically similar implementations from a large code corpus to developers based on their queries. Existing techniques leverage deep learning…

Software Engineering · Computer Science 2022-02-17 Weisong Sun , Chunrong Fang , Yuchen Chen , Guanhong Tao , Tingxu Han , Quanjun Zhang

Sequential recommendation models are crucial for next-item recommendations in online platforms, capturing complex patterns in user interactions. However, many focus on a single behavior, overlooking valuable implicit interactions like…

Information Retrieval · Computer Science 2023-12-18 Shereen Elsayed , Ahmed Rashed , Lars Schmidt-Thieme

The collaborative ranking problem has been an important open research question as most recommendation problems can be naturally formulated as ranking problems. While much of collaborative ranking methodology assumes static ranking data, the…

Machine Learning · Computer Science 2019-08-16 Liwei Wu , Shuqing Li , Cho-Jui Hsieh , James Sharpnack

Conversational Recommender Systems (CRS) has become an emerging research topic seeking to perform recommendations through interactive conversations, which generally consist of generation and recommendation modules. Prior work on CRS tends…

Computation and Language · Computer Science 2022-09-26 Lingzhi Wang , Shafiq Joty , Wei Gao , Xingshan Zeng , Kam-Fai Wong

Pre-training on large-scale video data has become a common recipe for learning transferable spatiotemporal representations in recent years. Despite some progress, existing methods are mostly limited to highly curated datasets (e.g., K400)…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Ziyun Zeng , Yuying Ge , Xihui Liu , Bin Chen , Ping Luo , Shu-Tao Xia , Yixiao Ge

Early detection and precise characterization of emerging topics in text streams can be highly useful in applications such as timely and targeted public health interventions and discovering evolving regional business trends. Many methods…

Information Retrieval · Computer Science 2016-02-16 Abhinav Maurya , Kenton Murray , Yandong Liu , Chris Dyer , William W. Cohen , Daniel B. Neill

The availability of devices that track moving objects has led to an explosive growth in trajectory data. When exploring the resulting large trajectory collections, visual summaries are a useful tool to identify time intervals of interest. A…

Human-Computer Interaction · Computer Science 2021-07-13 Jules Wulms , Juri Buchmüller , Wouter Meulemans , Kevin Verbeek , Bettina Speckmann