English
Related papers

Related papers: GeoExplorer: Active Geo-localization with Curiosit…

200 papers

Active learning strategies respond to the costly labelling task in a supervised classification by selecting the most useful unlabelled examples in training a predictive model. Many conventional active learning algorithms focus on refining…

Machine Learning · Computer Science 2014-08-12 Djallel Bouneffouf

The emergence of Vision-Language Models (VLMs) has introduced new paradigms for global image geo-localization through retrieval-augmented generation (RAG) and reasoning-driven inference. However, RAG methods are constrained by retrieval…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Bo Yu , Fengze Yang , Yiming Liu , Chao Wang , Xuewen Luo , Taozhe Li , Ruimin Ke , Xiaofan Zhou , Chenxi Liu

The advancement in autonomous vehicles has empowered navigation and exploration in unknown environments. Geomagnetic navigation for autonomous vehicles has drawn increasing attention with its independence from GPS or inertial navigation…

Robotics · Computer Science 2025-02-10 Wenqi Bai , Shiliang Zhang , Xiaohui Zhang , Xuehui Ma , Songnan Yang , Yushuai Li , Tingwen Huang

In many real-world scenarios where extrinsic rewards to the agent are extremely sparse, curiosity has emerged as a useful concept providing intrinsic rewards that enable the agent to explore its environment and acquire information to…

Machine Learning · Computer Science 2021-04-27 Jivat Neet Kaur , Yiding Jiang , Paul Pu Liang

Image geolocation aims to infer capture locations based on visual content. Fundamentally, this constitutes a reasoning process composed of \textit{hypothesis-verification cycles}, requiring models to possess both geospatial reasoning…

Artificial Intelligence · Computer Science 2026-01-28 Qiujun Li , Zijin Xiao , Xulin Wang , Zhidan Ma , Cheng Yang , Haifeng Li

Goal-Conditioned Reinforcement Learning (GCRL) can enable agents to spontaneously set diverse goals to learn a set of skills. Despite the excellent works proposed in various fields, reaching distant goals in temporally extended tasks…

Robotics · Computer Science 2023-07-21 Zhifeng Qian , Mingyu You , Hongjun Zhou , Xuanhui Xu , Bin He

How can artificial agents learn to solve many diverse tasks in complex visual environments in the absence of any supervision? We decompose this question into two problems: discovering new goals and learning to reliably achieve them. We…

Machine Learning · Computer Science 2021-10-19 Russell Mendonca , Oleh Rybkin , Kostas Daniilidis , Danijar Hafner , Deepak Pathak

Goal-conditioned hierarchical reinforcement learning (GCHRL) decomposes long-horizon tasks into sub-tasks through a hierarchical framework and it has demonstrated promising results across a variety of domains. However, the high-level…

Machine Learning · Computer Science 2024-04-18 Fei Cui , Jiaojiao Fang , Mengke Yang , Guizhong Liu

Recently, reinforcement learning (RL) has been used as a tool for finding failures in autonomous systems. During execution, the RL agents often rely on some domain-specific heuristic reward to guide them towards finding failures, but…

Machine Learning · Computer Science 2020-06-22 Mark Koren , Mykel J. Kochenderfer

Natural language can offer a concise and human-interpretable means of specifying reinforcement learning (RL) tasks. The ability to extract rewards from a language instruction can enable the development of robotic systems that can learn from…

Machine Learning · Computer Science 2025-12-15 Alexey Zakharov , Shimon Whiteson

Multi-agent reinforcement learning (MARL) is increasingly ubiquitous in training dynamic and adaptive synthetic characters for interactive simulations on geo-specific terrains. Frameworks such as Unity's ML-Agents help to make such…

Machine Learning · Computer Science 2025-03-27 Volkan Ustun , Soham Hans , Rajay Kumar , Yunzhe Wang

Robots with increasing autonomy progress our space exploration capabilities, particularly for in-situ exploration and sampling to stand in for human explorers. Currently, humans drive robots to meet scientific objectives, but depending on…

Robotics · Computer Science 2023-09-29 Sapphira Akins , Frances Zhu

Building autonomous machines that can explore open-ended environments, discover possible interactions and build repertoires of skills is a general objective of artificial intelligence. Developmental approaches argue that this can only be…

Machine Learning · Computer Science 2026-01-30 Cédric Colas , Tristan Karch , Olivier Sigaud , Pierre-Yves Oudeyer

Active learning (AL) strategies aim to train high-performance models with minimal labeling efforts, only selecting the most informative instances for annotation. Current approaches to evaluating data informativeness predominantly focus on…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Zhixuan Liang , Xingyu Zeng , Rui Zhao , Ping Luo

Worldwide geolocalization aims to locate the precise location at the coordinate level of photos taken anywhere on the Earth. It is very challenging due to 1) the difficulty of capturing subtle location-aware visual semantics, and 2) the…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Pengyue Jia , Yiding Liu , Xiaopeng Li , Yuhao Wang , Yantong Du , Xiao Han , Xuetao Wei , Shuaiqiang Wang , Dawei Yin , Xiangyu Zhao

Intrinsic rewards have been increasingly used to mitigate the sparse reward problem in single-agent reinforcement learning. These intrinsic rewards encourage the agent to look for novel experiences, guiding the agent to explore the…

Artificial Intelligence · Computer Science 2022-11-01 Roben Delos Reyes , Kyunghwan Son , Jinhwan Jung , Wan Ju Kang , Yung Yi

Exploration strategy design is one of the challenging problems in reinforcement learning~(RL), especially when the environment contains a large state space or sparse rewards. During exploration, the agent tries to discover novel areas or…

Machine Learning · Computer Science 2019-06-07 Xiao Ma , Shen-Yi Zhao , Wu-Jun Li

Exploration is one of the core challenges in reinforcement learning. A common formulation of curiosity-driven exploration uses the difference between the real future and the future predicted by a learned model. However, predicting the…

Machine Learning · Computer Science 2021-01-19 Victoria Dean , Shubham Tulsiani , Abhinav Gupta

Geomagnetic navigation has drawn increasing attention with its capacity in navigating through complex environments and its independence from external navigation services like global navigation satellite systems (GNSS). Existing studies on…

Robotics · Computer Science 2024-10-22 Wenqi Bai , Xiaohui Zhang , Shiliang Zhang , Songnan Yang , Yushuai Li , Tingwen Huang

In classic Reinforcement Learning (RL), the agent maximizes an additive objective of the visited states, e.g., a value function. Unfortunately, objectives of this type cannot model many real-world applications such as experiment design,…

Machine Learning · Computer Science 2024-07-16 Riccardo De Santi , Manish Prajapat , Andreas Krause