English
Related papers

Related papers: MobileWorldBench: Towards Semantic World Modeling …

200 papers

Neural Network Language Models (NNLMs) for Virtual Assistants (VAs) are generally language-, region-, and in some cases, device-dependent, which increases the effort to scale and maintain them. Combining NNLMs for one or more of the…

Computation and Language · Computer Science 2024-03-28 Rricha Jalota , Lyan Verwimp , Markus Nussbaum-Thom , Amr Mousa , Arturo Argueta , Youssef Oualil

Recent large language models (LLMs) have demonstrated significant advancements, particularly in their ability to serve as agents thereby surpassing their traditional role as chatbots. These agents can leverage their planning and tool…

Machine Learning · Computer Science 2025-02-13 Yixing Jiang , Kameron C. Black , Gloria Geng , Danny Park , James Zou , Andrew Y. Ng , Jonathan H. Chen

Planning is an important capability of artificial agents that perform long-horizon tasks in real-world environments. In this work, we explore the use of pre-trained language models (PLMs) to reason about plan sequences from text…

Computation and Language · Computer Science 2023-03-17 Anthony Z. Liu , Lajanugen Logeswaran , Sungryull Sohn , Honglak Lee

The rapid evolution of wireless networks presents unprecedented challenges in managing complex and dynamic systems. Existing methods are increasingly facing fundamental limitations in addressing these challenges. In this paper, we introduce…

Signal Processing · Electrical Eng. & Systems 2025-05-05 Jingwen Tong , Wei Guo , Jiawei Shao , Qiong Wu , Zijian Li , Zehong Lin , Jun Zhang

Large Language Model (LLM)-based UI agents show great promise for UI automation but often hallucinate in long-horizon tasks due to their lack of understanding of the global UI transition structure. To address this, we introduce AGENT+P, a…

Multiagent Systems · Computer Science 2026-01-09 Shang Ma , Xusheng Xiao , Yanfang Ye

Achieving human-like reasoning in deep learning models for complex tasks in unknown environments remains a critical challenge in embodied intelligence. While advanced vision-language models (VLMs) excel in static scene understanding, their…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Jinzhou Tang , Jusheng zhang , Sidi Liu , Waikit Xiu , Qinhan Lv , Xiying Li

Real-world data visualization (DV) requires native environmental grounding, cross-platform evolution, and proactive intent alignment. Yet, existing benchmarks often suffer from code-sandbox confinement, single-language creation-only tasks,…

Web-based participatory urban sensing has emerged as a vital approach for modern urban management by leveraging mobile individuals as distributed sensors. However, existing urban sensing systems struggle with limited generalization across…

Artificial Intelligence · Computer Science 2025-10-27 Xusen Guo , Mingxing Peng , Xixuan Hao , Xingchen Zou , Qiongyan Wang , Sijie Ruan , Yuxuan Liang

Mobile traffic prediction is a fundamental yet challenging problem for wireless network planning and optimization. Existing models focus on learning static long-term temporal patterns in mobile traffic series, which limits their ability to…

Networking and Internet Architecture · Computer Science 2026-04-10 Xiaoqian Qi , Haoye Chai , Yue Wang , Yong Li

The integration of Large Language Models (LLMs) into Geographic Information Systems (GIS) marks a paradigm shift toward autonomous spatial analysis. However, evaluating these LLM-based agents remains challenging due to the complex,…

Artificial Intelligence · Computer Science 2026-04-16 Bo Yu , Cheng Yang , Dongyang Hou , Chengfu Liu , Jiayao Liu , Chi Wang , Zhiming Zhang , Haifeng Li , Wentao Yang

Video Understanding, Scene Interpretation and Commonsense Reasoning are highly challenging tasks enabling the interpretation of visual information, allowing agents to perceive, interact with and make rational decisions in its environment.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-12 Nicolas Schuler , Lea Dewald , Nick Baldig , Jürgen Graf

Understanding and modeling human mobility patterns is crucial for effective transportation planning and urban development. Despite significant advances in mobility research, there remains a critical gap in simulation platforms that allow…

Artificial Intelligence · Computer Science 2025-06-30 Yifan Liu , Xishun Liao , Haoxuan Ma , Jonathan Liu , Rohan Jadhav , Jiaqi Ma

Existing Large Language Models (LLM) can invoke a variety of tools and APIs to complete complex tasks. The computer, as the most powerful and universal tool, could potentially be controlled directly by a trained LLM agent. Powered by the…

Human-Computer Interaction · Computer Science 2025-05-27 Runliang Niu , Jindong Li , Shiqi Wang , Yali Fu , Xiyu Hu , Xueyuan Leng , He Kong , Yi Chang , Qi Wang

Recent advances in large language models (LLMs) have enabled the emergence of general-purpose agents for automating end-to-end machine learning (ML) workflows, including data analysis, feature engineering, model training, and competition…

Artificial Intelligence · Computer Science 2025-09-12 Hangyi Jia , Yuxi Qian , Hanwen Tong , Xinhui Wu , Lin Chen , Feng Wei

Given the remarkable ability of 2D foundation image models to generate high-fidelity outputs, we investigate a fundamental question: do 2D foundation image models inherently possess 3D world model capabilities? To answer this, we…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Ziya Erkoç , Angela Dai , Matthias Nießner

With the integration of large language models (LLMs), embodied agents have strong capabilities to understand and plan complicated natural language instructions. However, a foreseeable issue is that those embodied agents can also flawlessly…

Cryptography and Security · Computer Science 2025-11-03 Sheng Yin , Xianghe Pang , Yuanzhuo Ding , Menglan Chen , Yutong Bi , Yichen Xiong , Wenhao Huang , Zhen Xiang , Jing Shao , Siheng Chen

Tool-augmented Large Language Models (LLMs) have shown impressive capabilities in remote sensing (RS) applications. However, existing benchmarks assume question-answering input templates over predefined image-text data pairs. These…

Computation and Language · Computer Science 2024-05-03 Simranjit Singh , Michael Fore , Dimitrios Stamoulis

Computer-using agents powered by Vision-Language Models (VLMs) have demonstrated human-like capabilities in operating digital environments like mobile platforms. While these agents hold great promise for advancing digital automation, their…

Language agents increasingly require persistent worlds in which they can act, remember, and learn. Existing approaches sit at two extremes: conventional web frameworks provide reliable but fixed contexts backed by databases, while fully…

Artificial Intelligence · Computer Science 2025-12-30 Jichen Feng , Yifan Zhang , Chenggong Zhang , Yifu Lu , Shilong Liu , Mengdi Wang

Large Language Models (LLMs) show promise as data analysis agents, but existing benchmarks overlook the iterative nature of the field, where experts' decisions evolve with deeper insights of the dataset. To address this, we introduce…

Computation and Language · Computer Science 2025-06-09 Hanyu Li , Haoyu Liu , Tingyu Zhu , Tianyu Guo , Zeyu Zheng , Xiaotie Deng , Michael I. Jordan