中文
相关论文

相关论文: OmniGeo: Towards a Multimodal Large Language Model…

200 篇论文

This research focuses on assessing the ability of large language models (LLMs) in representing geometries and their spatial relations. We utilize LLMs including GPT-2 and BERT to encode the well-known text (WKT) format of geometries and…

计算与语言 · 计算机科学 2023-07-10 Yuhan Ji , Song Gao

Large language models (LLMs), such as ChatGPT/GPT-4, have proven to be powerful tools in promoting the user experience as an AI assistant. The continuous works are proposing multi-modal large language models (MLLM), empowering LLMs with the…

计算与语言 · 计算机科学 2023-10-23 Ziqiang Zheng , Jipeng Zhang , Tuan-Anh Vu , Shizhe Diao , Yue Him Wong Tim , Sai-Kit Yeung

Traffic safety remains a critical global challenge, with traditional Advanced Driver-Assistance Systems (ADAS) often struggling in dynamic real-world scenarios due to fragmented sensor processing and susceptibility to adversarial…

计算机视觉与模式识别 · 计算机科学 2025-04-24 Mohammad Abu Tami , Mohammed Elhenawy , Huthaifa I. Ashqar

In near-field extremely large-scale multiple-input multiple-output (XL-MIMO) systems, spherical wavefront propagation expands the traditional beam codebook into the joint angular-distance domain, rendering conventional beam training…

信号处理 · 电气工程与系统科学 2026-03-18 Mengyuan Li , Qianfan Lu , Jiachen Tian , Hongjun Hu , Yu Han , Xiao Li , Chao-kai Wen , Shi Jin

We present OGD4All, a transparent, auditable, and reproducible framework based on Large Language Models (LLMs) to enhance citizens' interaction with geospatial Open Government Data (OGD). The system combines semantic data retrieval, agentic…

We provide a comprehensive examination of agent-based approaches that codify the principles and linkages underlying multi-agent systems, simulations, and information systems. Based on two decades of study, this paper confirms a framework…

多智能体系统 · 计算机科学 2025-08-01 Virginia Padilla , Jacinto Dávila

Large Language Models (LLMs), typified by OpenAI's GPT, have marked a significant advancement in artificial intelligence. Trained on vast amounts of text data, LLMs are capable of understanding and generating human-like text across a…

人工智能 · 计算机科学 2024-10-29 Haochen Zhang , Yuyang Dong , Chuan Xiao , Masafumi Oyamada

Artificial Intelligence models have demonstrated significant success in diagnosing skin diseases, including cancer, showing the potential to assist clinicians in their analysis. However, the interpretability of model predictions must be…

计算机视觉与模式识别 · 计算机科学 2025-08-29 Max Torop , Masih Eskandar , Nicholas Kurtansky , Jinyang Liu , Jochen Weber , Octavia Camps , Veronica Rotemberg , Jennifer Dy , Kivanc Kose

Recent breakthroughs in multimodal large language models (MLLMs) have endowed AI systems with unified perception, reasoning and natural-language interaction across text, image and video streams. Meanwhile, Unmanned Aerial Vehicle (UAV)…

Multimodal Large Language Models (MLLMs) that directly process RGB inputs for tasks like 3D localization and navigation have shown remarkable potential. However, we argue that these RGB-only approaches are fundamentally flawed in their…

计算机视觉与模式识别 · 计算机科学 2026-03-10 Gongjie Zhang , Wenhao Li , Quanhao Qian , Jiuniu Wang , Deli Zhao , Shijian Lu , Ran Xu

This paper presents an in-depth survey on the use of multimodal Generative Artificial Intelligence (GenAI) and autoregressive Large Language Models (LLMs) for human motion understanding and generation, offering insights into emerging…

计算机视觉与模式识别 · 计算机科学 2025-06-05 Muhammad Islam , Tao Huang , Euijoon Ahn , Usman Naseem

Humans possess spatial reasoning abilities that enable them to understand spaces through multimodal observations, such as vision and sound. Large multimodal reasoning models extend these abilities by learning to perceive and reason, showing…

Multimodal large language models (MLLMs) excel at 2D visual understanding but remain limited in their ability to reason about 3D space. In this work, we leverage large-scale high-quality 3D scene data with open-set annotations to introduce…

计算机视觉与模式识别 · 计算机科学 2025-09-09 Erik Daxberger , Nina Wenzel , David Griffiths , Haiming Gang , Justin Lazarow , Gefen Kohavi , Kai Kang , Marcin Eichner , Yinfei Yang , Afshin Dehghan , Peter Grasch

Large language models (LLMs) have shown remarkable proficiency in human-level reasoning and generation capabilities, which encourages extensive research on their application in mathematical problem solving. However, current work has been…

计算与语言 · 计算机科学 2025-08-21 Jiahui Gao , Renjie Pi , Jipeng Zhang , Jiacheng Ye , Wanjun Zhong , Yufei Wang , Lanqing Hong , Jianhua Han , Hang Xu , Zhenguo Li , Lingpeng Kong

Image geolocalization, in which an AI model traditionally predicts the precise GPS coordinates of an image, is a challenging task with many downstream applications. However, the user cannot utilize the model to further their knowledge…

计算机视觉与模式识别 · 计算机科学 2025-09-04 Ron Campos , Ashmal Vayani , Parth Parag Kulkarni , Rohit Gupta , Aizan Zafar , Aritra Dutta , Mubarak Shah

We present JoyAI-Image, a unified multimodal foundation model for visual understanding, text-to-image generation, and instruction-guided image editing. JoyAI-Image couples a spatially enhanced Multimodal Large Language Model (MLLM) with a…

Multilingual Large Language Models (MLLMs) represent a pivotal advancement in democratizing artificial intelligence across linguistic boundaries. While theoretical foundations are well-established, practical implementation guidelines remain…

计算与语言 · 计算机科学 2024-10-24 Junhua Liu , Bin Fu

A Language Model is a term that encompasses various types of models designed to understand and generate human communication. Large Language Models (LLMs) have gained significant attention due to their ability to process text with human-like…

The emergence of Large Language Models (LLMs) has transformed information access, with current LLMs also powering deep research systems that can generate comprehensive report-style answers, through planned iterative search, retrieval, and…

计算与语言 · 计算机科学 2025-06-18 Bruno Martins , Piotr Szymański , Piotr Gramacki

Large language models (LLMs) have achieved great success in general domains of natural language processing. In this paper, we bring LLMs to the realm of geoscience with the objective of advancing research and applications in this field. To…