English
Related papers

Related papers: RemoteAgent: Bridging Vague Human Intents and Eart…

200 papers

Current evaluation methods for large language models (LLMs) primarily rely on static benchmarks, presenting two major challenges: limited knowledge coverage and fixed difficulties that mismatch with the evaluated LLMs. These limitations…

Computation and Language · Computer Science 2026-01-16 Zhichao Shi , Xuhui Jiang , Chengjin Xu , Cangli Yao , Shengjia Ma , Yinghan Shen , Zixuan Li , Jian Guo , Yuanzhuo Wang

Earth Observation (EO) data encompass a vast range of remotely sensed information, featuring multi-sensor and multi-temporal, playing an indispensable role in understanding our planet's dynamics. Recently, Vision Language Models (VLMs) have…

Computer Vision and Pattern Recognition · Computer Science 2025-02-21 Xizhe Xue , Xiao Xiang Zhu

While Vision-Language-Action (VLA) models have demonstrated impressive capabilities in robotic manipulation, their performance in complex reasoning and long-horizon task planning is limited by data scarcity and model capacity. To address…

Robotics · Computer Science 2025-10-15 Yi Yang , Kefan Gu , Yuqing Wen , Hebei Li , Yucheng Zhao , Tiancai Wang , Xudong Liu

Relational learning is a challenging problem that has motivated a wide range of approaches, including graph-based models (e.g., graph neural networks, graph transformers), tabular methods (e.g., tabular foundation models), and…

Machine Learning · Computer Science 2026-05-11 Xingyue Huang , Louis Tichelman , Jinwoo Kim , Krzysztof Olejniczak , İsmail İlkan Ceylan

Finite Element Analysis (FEA) serves as the cornerstone of modern engineering design. However, its workflow is inherently complex and relies heavily on domain expertise. Although recent efforts have integrated Large Language Models (LLMs)…

Artificial Intelligence · Computer Science 2026-05-29 Jiachen Zhang , Junyi Lao , Chenghao Liu , Siyuan Liu , Shixin Wu , Linsen Zhang , Boyu Wang , Songfang Huang

We present the first loss agent, dubbed LossAgent, for low-level image processing tasks, e.g., image super-resolution and restoration, intending to achieve any customized optimization objectives of low-level image processing in different…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Bingchen Li , Xin Li , Yiting Lu , Zhibo Chen

A robust Multimodal Large Language Model (MLLM) for Earth Observation should maintain consistent interpretation and reasoning under realistic input variations. However, current Remote Sensing MLLMs fail to meet this requirement. Trained on…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Rui Min , Liang Yao , Shiyu Miao , Shengxiang Xu , Yuxuan Liu , Chuanyi Zhang , Shimin Di , Fan Liu

Recent advances in Large Language Models (LLMs) have propelled intelligent agents from reactive responses to proactive support. While promising, existing proactive agents either rely exclusively on observations from enclosed environments…

Artificial Intelligence · Computer Science 2025-10-28 Bufang Yang , Lilin Xu , Liekang Zeng , Kaiwei Liu , Siyang Jiang , Wenrui Lu , Hongkai Chen , Xiaofan Jiang , Guoliang Xing , Zhenyu Yan

Recent studies have begun to explore proactive large language model (LLM) agents that provide unobtrusive assistance by automatically leveraging contextual information, such as in code editing and in-app suggestions. However, most focus on…

Artificial Intelligence · Computer Science 2026-05-08 Bufang Yang , Lilin Xu , Liekang Zeng , Yunqi Guo , Siyang Jiang , Wenrui Lu , Kaiwei Liu , Yixuan Li , Xiaofan Jiang , Guoliang Xing , Zhenyu Yan

Robotic planning and execution in open-world environments is a complex problem due to the vast state spaces and high variability of task embodiment. Recent advances in perception algorithms, combined with Large Language Models (LLMs) for…

Cross-domain multimodal time series forecasting is a challenging task, requiring models to integrate precise numerical comprehension, cross-domain semantic understanding, and effective multimodal fusion. Existing approaches either build…

Artificial Intelligence · Computer Science 2026-05-29 Kun Feng , Ziwei Shan , Yuchen Fang , Yiyang Tan , Sihan Lu , Shuqi Gu , Lintao Ma , Xingyu Lu , Kan Ren

Medical Large Vision-Language Models (Med-LVLMs) have been widely adopted for medical report generation. Despite Med-LVLMs producing state-of-the-art performance, they exhibit a bias toward predicting all findings as normal, leading to…

Multiagent Systems · Computer Science 2025-05-27 Pengyu Wang , Shuchang Ye , Usman Naseem , Jinman Kim

Dermatological diagnosis requires integrating fine-grained visual perception with expert clinical knowledge. Although Multimodal Large Language Models (MLLMs) facilitate interactive medical image analysis, their application in dermatology…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Yize Liu , Siyuan Yan , Ming Hu , Lie Ju , Xieji Li , Feilong Tang , Wei Feng , Zongyuan Ge

Despite the remarkable capabilities of text-to-image (T2I) generation models, real-world applications often demand fine-grained, iterative image editing that existing methods struggle to provide. Key challenges include granular instruction…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Zihan Liang , Jiahao Sun , Haoran Ma

Recent VLM-based agents aim to replicate OpenAI O3's "thinking with images" via tool use, yet most open-source methods restrict inputs to a single image, limiting their applicability to real-world multi-image QA tasks. To address this gap,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Chengqi Dong , Chuhuai Yue , Hang He , Rongge Mao , Fenghe Tang , S Kevin Zhou , Zekun Xu , Xiaohan Wang , Jiajun Chai , Guojun Yin

This study introduces "CosmoAgent," an innovative artificial intelligence system that utilizes Large Language Models (LLMs) to simulate complex interactions between human and extraterrestrial civilizations. This paper introduces a…

Computation and Language · Computer Science 2025-06-10 Zhaoqian Xue , Beichen Wang , Suiyuan Zhu , Kai Mei , Hua Tang , Wenyue Hua , Mengnan Du , Yongfeng Zhang

Bridging the gap between complex human instructions and precise 3D object grounding remains a significant challenge in vision and robotics. Existing 3D segmentation methods often struggle to interpret ambiguous, reasoning-based…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Changyue Shi , Minghao Chen , Yiping Mao , Chuxiao Yang , Xinyuan Hu , Jiajun Ding , Zhou Yu

The rapid development of generative artificial intelligence (GenAI) presents new opportunities to advance the cartographic process. Previous studies have either overlooked the artistic aspects of maps or faced challenges in creating both…

Human-Computer Interaction · Computer Science 2025-05-16 Chenglong Wang , Yuhao Kang , Zhaoya Gong , Pengjun Zhao , Yu Feng , Wenjia Zhang , Ge Li

Recent advances in multimodal large language models (MLLMs) have demonstrated impressive results in various visual tasks. However, in remote sensing (RS), high resolution and small proportion of objects pose challenges to existing MLLMs,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Hongxiang Jiang , Jihao Yin , Qixiong Wang , Jiaqi Feng , Guo Chen

Multimodal Retrieval-Augmented Generation (mRAG) has emerged as a promising solution to address the temporal limitations of Multimodal Large Language Models (MLLMs) in real-world scenarios like news analysis and trending topics. However,…

Artificial Intelligence · Computer Science 2025-08-13 Yuechen Wang , Yuming Qiao , Dan Meng , Jun Yang , Haonan Lu , Zhenyu Yang , Xudong Zhang