English
Related papers

Related papers: MineAgent: Towards Remote-Sensing Mineral Explorat…

200 papers

Recent efforts to leverage the Multi-modal Large Language Model (MLLM) as GUI agents have yielded promising outcomes. However, these agents still struggle with long-horizon tasks in online environments, primarily due to insufficient…

Artificial Intelligence · Computer Science 2025-06-13 Yuquan Xie , Zaijing Li , Rui Shao , Gongwei Chen , Kaiwen Zhou , Yinchuan Li , Dongmei Jiang , Liqiang Nie

Large Language Models (LLMs) are transforming artificial intelligence, evolving into task-oriented systems capable of autonomous planning and execution. One of the primary applications of LLMs is conversational AI systems, which must…

Computation and Language · Computer Science 2025-01-22 Elad Levi , Ilan Kadar

Aerial vision-and-language navigation (VLN), requiring drones to interpret natural language instructions and navigate complex urban environments, emerges as a critical embodied AI challenge that bridges human-robot interaction, 3D spatial…

Robotics · Computer Science 2025-12-29 Weichen Zhang , Chen Gao , Shiquan Yu , Ruiying Peng , Baining Zhao , Qian Zhang , Jinqiang Cui , Xinlei Chen , Yong Li

The discovery of novel small molecule drugs remains a critical scientific challenge with far-reaching implications for treating diseases and advancing human health. Traditional drug development--especially for small molecule…

Biomolecules · Quantitative Biology 2025-04-01 Bowen Gao , Yanwen Huang , Yiqiao Liu , Wenxuan Xie , Wei-Ying Ma , Ya-Qin Zhang , Yanyan Lan

Multimodal Large Language Models (MLLMs) have demonstrated remarkable capabilities across a wide range of vision-language tasks. However, their performance as embodied agents, which requires multi-round dialogue spatial reasoning and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-07 Xunyi Zhao , Gengze Zhou , Qi Wu

Fault diagnosis of lithium-ion batteries is critical for system safety. While existing deep learning methods exhibit superior detection accuracy, their "black-box" nature hinders interpretability. Furthermore, restricted by binary…

Artificial Intelligence · Computer Science 2026-01-01 Songqi Zhou , Ruixue Liu , Boman Su , Jiazhou Wang , Yixing Wang , Benben Jiang

Large Language Models (LLMs) have demonstrated remarkable capabilities in challenging, knowledge-intensive reasoning tasks. However, extending LLMs to perceive and reason over a new modality (e.g., vision), often requires costly development…

Computation and Language · Computer Science 2025-11-25 James Y. Huang , Sheng Zhang , Qianchu Liu , Guanghui Qin , Tinghui Zhu , Tristan Naumann , Muhao Chen , Hoifung Poon

Multimodal large language models (MLLMs) are increasingly considered as a foundation for embodied agents, yet it remains unclear whether they can reliably reason about the long-term physical consequences of actions from an egocentric…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Chengjun Yu , Xuhan Zhu , Chaoqun Du , Pengfei Yu , Wei Zhai , Yang Cao , Zheng-Jun Zha

Large Language Models (LLMs) have shown impressive performance on existing medical question-answering benchmarks. This high performance makes it increasingly difficult to meaningfully evaluate and differentiate advanced methods. We present…

Computation and Language · Computer Science 2025-03-21 Xiangru Tang , Daniel Shao , Jiwoong Sohn , Jiapeng Chen , Jiayi Zhang , Jinyu Xiang , Fang Wu , Yilun Zhao , Chenglin Wu , Wenqi Shi , Arman Cohan , Mark Gerstein

Multimodal large language models (MLLMs) have advanced clinical tasks for common conditions, but their performance on rare diseases remains largely untested. In rare-disease scenarios, clinicians often lack prior clinical knowledge, forcing…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Junzhi Ning , Jiashi Lin , Yingying Fang , Wei Li , Jiyao Liu , Cheng Tang , Chenglong Ma , Wenhao Tang , Tianbin Li , Ziyan Huang , Guang Yang , Junjun He

The Multi-Modal Large Language Model (MLLM) refers to an extension of the Large Language Model (LLM) equipped with the capability to receive and infer multi-modal data. Spatial awareness stands as one of the crucial abilities of MLLM,…

Artificial Intelligence · Computer Science 2023-11-02 Yongqiang Zhao , Zhenyu Li , Zhi Jin , Feng Zhang , Haiyan Zhao , Chengfeng Dou , Zhengwei Tao , Xinhai Xu , Donghong Liu

As large language models (LLMs) are applied to increasingly longer and more complex tasks, there is a growing need for realistic long-context benchmarks that require selective reading and integration of heterogeneous, multi-modal…

Computation and Language · Computer Science 2026-02-06 Aadi Palnitkar , Mingyang Mao , Nicholas Waytowich , Vinicius G. Goecks , Xiaomin Lin

Multimodal Large Language Models (MLLMs) have achieved remarkable success in vision-language tasks but their remote sensing (RS) counterpart are relatively under explored. Unlike natural images, RS imagery presents unique challenges that…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Abduljaleel Adejumo , Faegheh Yeganli , Clifford Broni-bediako , Aoran Xiao , Naoto Yokoya , Mennatullah Siam

Despite significant strides in multimodal tasks, Multimodal Large Language Models (MLLMs) are plagued by the critical issue of hallucination. The reliable detection of such hallucinations in MLLMs has, therefore, become a vital aspect of…

Computation and Language · Computer Science 2024-05-28 Xiang Chen , Chenxi Wang , Yida Xue , Ningyu Zhang , Xiaoyan Yang , Qiang Li , Yue Shen , Lei Liang , Jinjie Gu , Huajun Chen

Several medical Multimodal Large Languange Models (MLLMs) have been developed to address tasks involving visual images with textual instructions across various medical modalities, achieving impressive results. Most current medical…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Lehan Wang , Haonan Wang , Honglong Yang , Jiaji Mao , Zehong Yang , Jun Shen , Xiaomeng Li

Multimodal large language models (MLLMs) have advanced rapidly, yet heterogeneity in architecture, alignment strategies, and efficiency means that no single model is uniformly superior across tasks. In practical deployments, workloads span…

Artificial Intelligence · Computer Science 2026-01-27 Haoxuan Ma , Guannan Lai , Han-Jia Ye

While Multimodal Large Language Models (MLLMs) excel in general vision-language tasks, their application to remote sensing change understanding is hindered by a fundamental "temporal blindness". Existing architectures lack intrinsic…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Xiaohe Li , Jiahao Li , Kaixin Zhang , Yuqiang Fang , Leilei Lin , Hong Wang , Haohua Wu , Zide Fan

Recent advancements in artificial intelligence have sparked interest in scientific assistants that could support researchers across the full spectrum of scientific workflows, from literature review to experimental design and data analysis.…

Existing vision-language understanding benchmarks largely consist of images of objects in their usual contexts. As a consequence, recent multimodal large language models can perform well with only a shallow visual understanding by relying…

The rapid evolution of Multimodal Large Language Models (MLLMs) has brought substantial advancements in artificial intelligence, significantly enhancing the capability to understand and generate multimodal content. While prior studies have…

Artificial Intelligence · Computer Science 2024-09-30 Lin Li , Guikun Chen , Hanrong Shi , Jun Xiao , Long Chen