中文
相关论文

相关论文: OmniGeo: Towards a Multimodal Large Language Model…

200 篇论文

Large language models (LLMs) have received considerable attention recently due to their outstanding comprehension and reasoning capabilities, leading to great progress in many fields. The advancement of LLM techniques also offers promising…

系统与控制 · 电气工程与系统科学 2024-09-17 Hao Zhou , Chengming Hu , Ye Yuan , Yufei Cui , Yili Jin , Can Chen , Haolun Wu , Dun Yuan , Li Jiang , Di Wu , Xue Liu , Charlie Zhang , Xianbin Wang , Jiangchuan Liu

The 180x360 omnidirectional field of view captured by 360-degree cameras enables their use in a wide range of applications such as embodied AI and virtual reality. Although recent advances in multimodal large language models (MLLMs) have…

计算机视觉与模式识别 · 计算机科学 2025-05-20 Zihao Dongfang , Xu Zheng , Ziqiao Weng , Yuanhuiyi Lyu , Danda Pani Paudel , Luc Van Gool , Kailun Yang , Xuming Hu

Moving beyond traditional surveys, combining heterogeneous data sources with AI-driven inference models brings new opportunities to measure socio-economic conditions, such as poverty and population, over expansive geographic areas. The…

计算机与社会 · 计算机科学 2024-06-17 Sungwon Han , Donghyun Ahn , Seungeon Lee , Minhyuk Song , Sungwon Park , Sangyoon Park , Jihee Kim , Meeyoung Cha

This study investigates the potential of Large Language Models (LLMs) for reconstructing and constructing the physical world solely based on textual knowledge. It explores the impact of model performance on spatial understanding abilities.…

计算与语言 · 计算机科学 2024-10-24 Yongqiang Huang , Wentao Ye , Liyao Li , Junbo Zhao

Multimodal Large Language Models (MLLMs) have demonstrated impressive progress in single-image grounding and general multi-image understanding. Recently, some methods begin to address multi-image grounding. However, they are constrained by…

计算机视觉与模式识别 · 计算机科学 2026-01-09 Shurong Zheng , Yousong Zhu , Hongyin Zhao , Fan Yang , Yufei Zhan , Ming Tang , Jinqiao Wang

With the increasing popularity of ChatGPT, large language models (LLMs) have demonstrated their capabilities in communication and reasoning, promising for transportation sector intelligentization. However, they still face challenges in…

人机交互 · 计算机科学 2024-04-10 Jiajing Chen , Weihang Xu , Haiming Cao , Zihuan Xu , Yu Zhang , Zhao Zhang , Siyao Zhang

Recently, Large Language Models (LLMs) and Multimodal Large Language Models (MLLMs) have shown promise in instruction following and 2D image understanding. While these models are powerful, they have not yet been developed to comprehend the…

计算机视觉与模式识别 · 计算机科学 2023-12-22 Senqiao Yang , Jiaming Liu , Ray Zhang , Mingjie Pan , Zoey Guo , Xiaoqi Li , Zehui Chen , Peng Gao , Yandong Guo , Shanghang Zhang

Rapid advancements in imaging techniques and analytical methods over the past decade have revolutionized our ability to comprehensively probe the biological world at multiple scales, pinpointing the type, quantity, location, and even…

人工智能 · 计算机科学 2025-10-02 Shanghang Zhang , Gaole Dai , Tiejun Huang , Jianxu Chen

While Multimodal Large Language Models (MLLMs) have exhibited remarkable general intelligence across diverse domains, their potential in low-altitude applications dominated by Unmanned Aerial Vehicles (UAVs) remains largely underexplored.…

计算机视觉与模式识别 · 计算机科学 2025-12-30 Shiqi Dai , Zizhi Ma , Zhicong Luo , Xuesong Yang , Yibin Huang , Wanyue Zhang , Chi Chen , Zonghao Guo , Wang Xu , Yufei Sun , Maosong Sun

The emergence of Multimodal Large Language Models (MLLMs) has revolutionized image understanding by bridging textual and visual modalities. However, these models often struggle with capturing fine-grained semantic information, such as the…

计算机视觉与模式识别 · 计算机科学 2025-07-16 Jie Yang , Wang Zeng , Sheng Jin , Lumin Xu , Wentao Liu , Chen Qian , Zhen Li , Ruimao Zhang

In the rapidly evolving landscape of AI research and application, Multimodal Large Language Models (MLLMs) have emerged as a transformative force, adept at interpreting and integrating information from diverse modalities such as text,…

人工智能 · 计算机科学 2024-07-23 Abdur Rahman , Rajat Chawla , Muskaan Kumar , Arkajit Datta , Adarsh Jha , Mukunda NS , Ishaan Bhola

A robot in a human-centric environment needs to account for the human's intent and future motion in its task and motion planning to ensure safe and effective operation. This requires symbolic reasoning about probable future actions and the…

机器人学 · 计算机科学 2023-11-01 Moritz A. Graule , Volkan Isler

Traditional robot navigation systems primarily utilize occupancy grid maps and laser-based sensing technologies, as demonstrated by the popular move_base package in ROS. Unlike robots, humans navigate not only through spatial awareness and…

机器人学 · 计算机科学 2025-07-22 Fujing Xie , Jiajie Zhang , Sören Schwertfeger

Large Language Models(LLMs)have become effective tools for natural language processing and have been used in many different fields. This essay offers a succinct summary of various LLM subcategories. The survey emphasizes recent developments…

计算与语言 · 计算机科学 2023-07-21 Saurabh Pahune , Manoj Chandrasekharan

Large language models (LLMs) can handle a wide variety of general tasks with simple prompts, without the need for task-specific training. Multimodal Large Language Models (MLLMs), built upon LLMs, have demonstrated impressive potential in…

Humans subconsciously engage in geospatial reasoning when reading articles. We recognize place names and their spatial relations in text and mentally associate them with their physical locations on Earth. Although pretrained language models…

计算与语言 · 计算机科学 2023-10-24 Zekun Li , Wenxuan Zhou , Yao-Yi Chiang , Muhao Chen

Pre-trained large language models (PLMs) have the potential to support urban science research through content creation, information extraction, assisted programming, text classification, and other technical advances. In this research, we…

人机交互 · 计算机科学 2023-05-22 Jiayi Fu , Haoying Han , Xing Su , Chao Fan

Various methods have been proposed for utilizing Large Language Models (LLMs) in autonomous driving. One strategy of using LLMs for autonomous driving involves inputting surrounding objects as text prompts to the LLMs, along with their…

The applications of large language models (LLMs) are promising for biomedical and healthcare research. Despite the availability of open-source LLMs trained using a wide range of biomedical data, current research on the applications of LLMs…

机器学习 · 计算机科学 2024-09-25 Tianyu Liu , Yijia Xiao , Xiao Luo , Hua Xu , W. Jim Zheng , Hongyu Zhao

Recently, the astonishing performance of large language models (LLMs) in natural language comprehension and generation tasks triggered lots of exploration of using them as central controllers to build agent systems. Multiple studies focus…

计算机视觉与模式识别 · 计算机科学 2025-04-14 Chenyu Wang , Weixin Luo , Sixun Dong , Xiaohua Xuan , Zhengxin Li , Lin Ma , Shenghua Gao