English
Related papers

Related papers: MGeo: Multi-Modal Geographic Pre-Training Method

200 papers

In human reading and communication, individuals tend to engage in geospatial reasoning, which involves recognizing geographic entities and making informed inferences about their interrelationships. To mimic such cognitive process, current…

Computation and Language · Computer Science 2024-08-22 Yibo Yan , Joey Lee

The advent of Large Language Models (LLMs) has paved the way for AI search engines, e.g., SearchGPT, showcasing a new paradigm in human-internet interaction. However, most current AI search engines are limited to text-only settings,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Dongzhi Jiang , Renrui Zhang , Ziyu Guo , Yanmin Wu , Jiayi Lei , Pengshuo Qiu , Pan Lu , Zehui Chen , Chaoyou Fu , Guanglu Song , Peng Gao , Yu Liu , Chunyuan Li , Hongsheng Li

Universal Multimodal embedding models built on Multimodal Large Language Models (MLLMs) have traditionally employed contrastive learning, which aligns representations of query-target pairs across different modalities. Yet, despite its…

Information Retrieval · Computer Science 2026-04-03 Geonmo Gu , Byeongho Heo , Jaemyung Yu , Jaehui Hwang , Taekyung Kim , Sangmin Lee , HeeJae Jun , Yoohoon Kang , Sangdoo Yun , Dongyoon Han

Existing methods for self-supervised representation learning of geospatial regions and map entities rely extensively on the design of pretext tasks, often involving augmentations or heuristic sampling of positive and negative pairs based on…

Machine Learning · Computer Science 2025-03-11 Theodor Lundqvist , Ludvig Delvret

We present a winning solution to RoboSense 2025 Track 4: Cross-Modal Drone Navigation. The task retrieves the most relevant geo-referenced image from a large multi-platform corpus (satellite/drone/ground) given a natural-language query. Two…

Computer Vision and Pattern Recognition · Computer Science 2025-10-24 LinFeng Li , Jian Zhao , Zepeng Yang , Yuhang Song , Bojun Lin , Tianle Zhang , Yuchen Yuan , Chi Zhang , Xuelong Li

Multiple clustering has gained significant attention in recent years due to its potential to reveal multiple hidden structures of data from different perspectives. The advent of deep multiple clustering techniques has notably advanced the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Jiawei Yao , Qi Qian , Juhua Hu

Large Language Models (LLMs) have shown great promise in multilingual machine translation (MT), even with limited bilingual supervision. However, fine-tuning LLMs with parallel corpora presents major challenges, namely parameter…

Computation and Language · Computer Science 2026-05-26 Bo Li , Tianyu Dong , Shaolin Zhu , Deyi Xiong

Language-guided grasping has emerged as a promising paradigm for enabling robots to identify and manipulate target objects through natural language instructions, yet it remains highly challenging in cluttered or occluded scenes. Existing…

Robotics · Computer Science 2026-02-05 Rui Tang , Guankun Wang , Long Bai , Huxin Gao , Jiewen Lai , Chi Kit Ng , Jiazheng Wang , Fan Zhang , Hongliang Ren

To effectively exploit the potential of large-scale models, various pre-training strategies supported by massive data from different sources are proposed, including supervised pre-training, weakly-supervised pre-training, and…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Weijie Su , Xizhou Zhu , Chenxin Tao , Lewei Lu , Bin Li , Gao Huang , Yu Qiao , Xiaogang Wang , Jie Zhou , Jifeng Dai

Multi-modal co-learning is emerging as an effective paradigm in machine learning, enabling models to collaboratively learn from different modalities to enhance single-modality predictions. Earth Observation (EO) represents a quintessential…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Francisco Mena , Dino Ienco , Cassio F. Dantas , Roberto Interdonato , Andreas Dengel

To assist humans in open-world environments, robots must interpret ambiguous instructions to locate desired objects. Foundation model-based approaches excel at multimodal grounding, but they lack a principled mechanism for modeling…

Robotics · Computer Science 2026-03-06 Ivy Xiao He , Stefanie Tellex , Jason Xinyu Liu

Geometry problem-solving remains a significant challenge for Large Multimodal Models (LMMs), requiring not only global shape recognition but also attention to intricate local relationships related to geometric theory. To address this, we…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Linger Deng , Yuliang Liu , Wenwen Yu , Zujia Zhang , Jianzhong Ju , Zhenbo Luo , Xiang Bai

Multimodal learning aims to discover the relationship between multiple modalities. It has become an important research topic due to extensive multimodal applications such as cross-modal retrieval. This paper attempts to address the modality…

Machine Learning · Computer Science 2019-08-15 Guoli Song , Shuhui Wang , Qingming Huang , Qi Tian

The next point-of-interest (POI) prediction is a significant task in location-based services, yet its complexity arises from the consolidation of spatial and semantic intent. This fusion is subject to the influences of historical…

Information Retrieval · Computer Science 2024-04-09 Nan Jiang , Haitao Yuan , Jianing Si , Minxiao Chen , Shangguang Wang

Enabling resilient autonomous motion planning requires robust predictions of surrounding road users' future behavior. In response to this need and the associated challenges, we introduce our model titled MTP-GO. The model encodes the scene…

Robotics · Computer Science 2023-12-12 Theodor Westny , Joel Oskarsson , Björn Olofsson , Erik Frisk

Large pre-trained models, also known as foundation models (FMs), are trained in a task-agnostic manner on large-scale data and can be adapted to a wide range of downstream tasks by fine-tuning, few-shot, or even zero-shot learning. Despite…

Artificial Intelligence · Computer Science 2023-04-17 Gengchen Mai , Weiming Huang , Jin Sun , Suhang Song , Deepak Mishra , Ninghao Liu , Song Gao , Tianming Liu , Gao Cong , Yingjie Hu , Chris Cundy , Ziyuan Li , Rui Zhu , Ni Lao

Natural-language Guided Cross-view Geo-localization (NGCG) aims to retrieve geo-tagged satellite imagery using textual descriptions of ground scenes. While recent NGCG methods commonly rely on CLIP-style dual-encoder architectures, they…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Yuqi Chen , Xiaohan Zhang , Ahmad Arrabi , Waqas Sultani , Chen Chen , Safwan Wshah

Current multimodal large language models (MLLMs) struggle with fine-grained or precise understanding of visuals although they give comprehensive perception and reasoning in a spectrum of vision applications. Recent studies either develop…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Ziang Yan , Zhilin Li , Yinan He , Chenting Wang , Kunchang Li , Xinhao Li , Xiangyu Zeng , Zilei Wang , Yali Wang , Yu Qiao , Limin Wang , Yi Wang

Millions of biological sample records collected in the last few centuries archived in natural history collections are un-georeferenced. Georeferencing complex locality descriptions associated with these collection samples is a highly…

Artificial Intelligence · Computer Science 2025-07-14 Kalana Wijegunarathna , Kristin Stock , Christopher B. Jones

Geolocation, the task of identifying the geographic location of an image, requires abundant world knowledge and complex reasoning abilities. Though advanced large multimodal models (LMMs) have shown superior aforementioned capabilities,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Yushuo Zheng , Huiyu Duan , Zicheng Zhang , Xiaohong Liu , Xiongkuo Min