English
Related papers

Related papers: Positional encoding is not the same as context: A …

200 papers

As a representative of public transportation, the fundamental issue of managing bike-sharing systems is bike flow prediction. Recent methods overemphasize the spatio-temporal correlations in the data, ignoring the effects of contextual…

Machine Learning · Computer Science 2023-01-20 Pan Deng , Yu Zhao , Junting Liu , Xiaofeng Jia , Mulan Wang

Biological spiking neural networks (SNNs) can temporally encode information in their outputs, e.g. in the rank order in which neurons fire, whereas artificial neural networks (ANNs) conventionally do not. As a result, models of SNNs for…

Neural and Evolutionary Computing · Computer Science 2023-08-03 Alan Jeffares , Qinghai Guo , Pontus Stenetorp , Timoleon Moraitis

Generating video descriptions automatically is a challenging task that involves a complex interplay between spatio-temporal visual features and language models. Given that videos consist of spatial (frame-level) features and their temporal…

Computer Vision and Pattern Recognition · Computer Science 2020-01-20 Anoop Cherian , Jue Wang , Chiori Hori , Tim K. Marks

The exponential growth of online content has posed significant challenges to ID-based models in industrial recommendation systems, ranging from extremely high cardinality and dynamically growing ID space, to highly skewed engagement…

Sequential modelling entails making sense of sequential data, which naturally occurs in a wide array of domains. One example is systems that interact with users, log user actions and behaviour, and make recommendations of items of potential…

Information Retrieval · Computer Science 2021-09-15 Christian Hansen

Structural and Positional Encodings can significantly improve the performance of Graph Neural Networks in downstream tasks. Recent literature has begun to systematically investigate differences in the structural properties that these…

Machine Learning · Computer Science 2024-03-14 Lukas Fesser , Melanie Weber

The context information such as product category plays a critical role in sequential recommendation. Recent years have witnessed a growing interest in context-aware sequential recommender systems. Existing studies often treat the contexts…

Information Retrieval · Computer Science 2020-01-15 Ke Sun , Tieyun Qian

The success of visual tracking has been largely driven by datasets with manual box annotations. However, these box annotations require tremendous human effort, limiting the scale and diversity of existing tracking datasets. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Yaozong Zheng , Bineng Zhong , Qihua Liang , Ning Li , Shuxiang Song

This paper addresses the task of anomaly diagnosis when the underlying data generation process has a complex spatio-temporal (ST) dependency. The key technical challenge is to extract actionable insights from the dependency tensor…

Machine Learning · Computer Science 2023-05-30 Jokin Labaien , Tsuyoshi Idé , Pin-Yu Chen , Ekhi Zugasti , Xabier De Carlos

Most recommender systems treat timestamps as numeric or cyclical values, overlooking real-world context such as holidays, events, and seasonal patterns. We propose a scalable framework that uses large language models (LLMs) to generate…

Information Retrieval · Computer Science 2025-10-29 Yejin Kim , Shaghayegh Agah , Mayur Nankani , Neeraj Sharma , Feifei Peng , Maria Peifer , Sardar Hamidian , H Howie Huang

Sequential recommendation aims to predict the next item a user is likely to prefer based on their sequential interaction history. Recently, text-based sequential recommendation has emerged as a promising paradigm that uses pre-trained…

Information Retrieval · Computer Science 2024-09-05 Hyunsoo Kim , Junyoung Kim , Minjin Choi , Sunkyung Lee , Jongwuk Lee

Implicit neural representations (INRs) are increasingly being used as tools to map coordinates to signals, encompassing applications from neural fields to texture compression, shape representations, and beyond. Most INR methods are based on…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Guillaume Perez , Janarbek Matai , Takahiro Harada

Spatiotemporal predictive learning (ST-PL) is a hotspot with numerous applications, such as object movement and meteorological prediction. It aims at predicting the subsequent frames via observed sequences. However, inherent uncertainty…

Computer Vision and Pattern Recognition · Computer Science 2022-04-13 Zenghao Chai , Zhengzhuo Xu , Yunpeng Bai , Zhihui Lin , Chun Yuan

The meaning of a word is closely linked to sociocultural factors that can change over time and location, resulting in corresponding meaning changes. Taking a global view of words and their meanings in a widely used language, such as…

Computation and Language · Computer Science 2020-10-05 Hongyu Gong , Suma Bhat , Pramod Viswanath

We address the problem of generating video features for action recognition. The spatial pyramid and its variants have been very popular feature models due to their success in balancing spatial location encoding and spatial invariance.…

Computer Vision and Pattern Recognition · Computer Science 2015-10-16 Zhenzhong Lan , Alexander G. Hauptmann

Traffic prediction has drawn increasing attention in AI research field due to the increasing availability of large-scale traffic data and its importance in the real world. For example, an accurate taxi demand prediction can assist taxi…

Machine Learning · Computer Science 2018-11-06 Huaxiu Yao , Xianfeng Tang , Hua Wei , Guanjie Zheng , Zhenhui Li

We study cross-modal recommendation of music tracks to be used as soundtracks for videos. This problem is known as the music supervision task. We build on a self-supervised system that learns a content association between music and video.…

Multimedia · Computer Science 2023-06-13 Laure Prétet , Gaël Richard , Clément Souchier , Geoffroy Peeters

The timed position of documents retrieved by learning to rank models can be seen as signals. Signals carry useful information such as drop or rise of documents over time or user behaviors. In this work, we propose to use the logic formalism…

Logic in Computer Science · Computer Science 2021-01-15 Tommaso Dreossi , Giorgio Ballardin , Parth Gupta , Jan Bakus , Yu-Hsiang Lin , Vamsi Salaka

This paper presents an approach for Evoked Expressions from Videos (EEV) challenge, which aims to predict evoked facial expressions from video. We take advantage of pre-trained models on large-scale datasets in computer vision and audio…

Computer Vision and Pattern Recognition · Computer Science 2023-07-12 VanThong Huynh , Guee-Sang Lee , Hyung-Jeong Yang , Soo-Huyng Kim

Current time-series forecasting problems use short-term weather attributes as exogenous inputs. However, in specific time-series forecasting solutions (e.g., demand prediction in the supply chain), seasonal climate predictions are crucial…

Machine Learning · Computer Science 2023-09-06 Smit Marvaniya , Jitendra Singh , Nicolas Galichet , Fred Ochieng Otieno , Geeth De Mel , Kommy Weldemariam