English
Related papers

Related papers: Exploration Space Theory: Formal Foundations for P…

200 papers

Sequential location recommendation plays a huge role in modern life, which can enhance user experience, bring more profit to businesses and assist in government administration. Although methods for location recommendation have evolved…

Artificial Intelligence · Computer Science 2023-10-25 Xuan Luo , Mingqing Huang , Rui Lv , Hui Zhao

Reinforcement learning has shown promising results in learning neural network policies for complicated control tasks. However, the lack of formal guarantees about the behavior of such policies remains an impediment to their deployment. We…

Machine Learning · Computer Science 2023-12-05 Đorđe Žikelić , Mathias Lechner , Abhinav Verma , Krishnendu Chatterjee , Thomas A. Henzinger

Reasoning at multiple levels of temporal abstraction is one of the key attributes of intelligence. In reinforcement learning, this is often modeled through temporally extended courses of actions called options. Options allow agents to make…

Machine Learning · Computer Science 2023-04-13 Marlos C. Machado , Andre Barreto , Doina Precup , Michael Bowling

Spatial item recommendation has become an important means to help people discover interesting locations, especially when people pay a visit to unfamiliar regions. Some current researches are focusing on modelling individual and collective…

Social and Information Networks · Computer Science 2017-06-21 Hao Wang , Yanmei Fu , Qinyong Wang , Hongzhi Yin , Changying Du , Hui Xiong

In Reinforcement Learning (RL), artificial agents are trained to maximize numerical rewards by performing tasks. Exploration is essential in RL because agents must discover information before exploiting it. Two rewards encouraging efficient…

Machine Learning · Computer Science 2024-05-14 Theodore Jerome Tinker , Kenji Doya , Jun Tani

Generative recommendation with large language models (LLMs) reframes prediction as sequence generation, yet existing LLM-based recommenders remain limited in leveraging geographic signals that are crucial in mobility and local-services…

Artificial Intelligence · Computer Science 2026-04-22 Dongyi Lv , Qiuyu Ding , Heng-Da Xu , Zhaoxu Sun , Zhi Wang , Feng Xiong , Mu Xu

The growing ubiquity of Extended Reality (XR) is driving Conversational Recommendation Systems (CRS) toward visually immersive experiences. We formalize this paradigm as Immersive CRS (ICRS), where recommended items are highlighted directly…

Information Retrieval · Computer Science 2026-04-14 Jiazhou Liang , Yifan Simon Liu , David Guo , Minqi Sun , Yilun Jiang , Scott Sanner

The next location recommendation is at the core of various location-based applications. Current state-of-the-art models have attempted to solve spatial sparsity with hierarchical gridding and model temporal relation with explicit time…

Information Retrieval · Computer Science 2021-02-09 Yingtao Luo , Qiang Liu , Zhaocheng Liu

The options framework in reinforcement learning models the notion of a skill or a temporally extended sequence of actions. The discovery of a reusable set of skills has typically entailed building options, that navigate to bottleneck…

Machine Learning · Computer Science 2019-05-15 Rahul Ramesh , Manan Tomar , Balaraman Ravindran

Excursion set theory (EST) is an analytical framework to study the large-scale structure of the Universe. EST introduces a procedure to calculate the number density of structures by relating the cosmological linear perturbation theory to…

Cosmology and Nongalactic Astrophysics · Physics 2017-09-06 Farnik Nikakhtar , Shant Baghram

Sequential recommender systems have become increasingly important in real-world applications that model user behavior sequences to predict their preferences. However, existing sequential recommendation methods predominantly rely on…

Information Retrieval · Computer Science 2025-06-05 Enze Liu , Bowen Zheng , Xiaolei Wang , Wayne Xin Zhao , Jinpeng Wang , Sheng Chen , Ji-Rong Wen

Using the previously developed concepts of semantic spacetime, I explore the interpretation of knowledge representations, and their structure, as a semantic system, within the framework of promise theory. By assigning interpretations to…

Artificial Intelligence · Computer Science 2017-08-02 Mark Burgess

Efficient exploration remains a central challenge in reinforcement learning, serving as a useful pretraining objective for data collection, particularly when an external reward function is unavailable. A principled formulation of the…

Machine Learning · Computer Science 2026-03-16 Jacob Adamczyk , Adam Kamoski , Rahul V. Kulkarni

How to design automated procedures which (i) accurately assess the knowledge of a student, and (ii) efficiently provide advices for further study? To produce well-founded answers, Knowledge Space Theory relies on a combinatorial viewpoint…

Combinatorics · Mathematics 2015-11-24 Jean-Paul Doignon , Jean-Claude Falmagne

Effective exploration in reinforcement learning requires not only tracking where an agent has been, but also understanding how the agent perceives and represents the world. To learn powerful representations, an agent should actively explore…

Machine Learning · Computer Science 2026-04-21 Faisal Mohamed , Catherine Ji , Benjamin Eysenbach , Glen Berseth

Recommender systems aim to estimate the dynamically changing user preferences and sequential dependencies between historical user behaviour and metadata. Although transformer-based models have proven to be effective in sequential…

Information Retrieval · Computer Science 2025-10-07 Mark Obozov , Makar Baderko , Stepan Kulibaba , Nikolay Kutuzov , Alexander Gasnikov

In various computational systems, accessing information incurs time, memory or energy costs. However, standard epistemic logics usually model the acquisition of evidence as a cost-free process, which restricts their applicability in…

Logic in Computer Science · Computer Science 2026-04-14 Ondrej Majer , Krishna Manoorkar , Wolfgang Poiger , Igor Sedlár

Electronic Structure Theory (EST) describes the behavior of electrons in matter and is used to predict material properties. Conventionally, this involves forming a Hamiltonian and solving the Schr\"odinger equation through discrete…

Signal Processing · Electrical Eng. & Systems 2024-04-02 Aakash Yadav , Daniel Hedman , Hongsik Jeong

While Conversational Recommender Systems (CRS) have matured technically, they frequently lack principled methods for encoding latent experiential aims as adaptive state variables. Consequently, contemporary architectures often prioritise…

Human-Computer Interaction · Computer Science 2026-01-13 Raj Mahmud , Shlomo Berkovsky , Mukesh Prasad , A. Baki Kocaballi

Many social network applications depend on robust representations of spatio-temporal data. In this work, we present an embedding model based on feed-forward neural networks which transforms social media check-ins into dense feature vectors…

Information Retrieval · Computer Science 2018-01-23 Jing Yang , Carsten Eickhoff