English
Related papers

Related papers: SAGE: Scalable Agentic 3D Scene Generation for Emb…

200 papers

The common sense reasoning abilities and vast general knowledge of Large Language Models (LLMs) make them a natural fit for interpreting user requests in a Smart Home assistant context. LLMs, however, lack specific knowledge about the user…

Artificial Intelligence · Computer Science 2024-01-22 Dmitriy Rivkin , Francois Hogan , Amal Feriani , Abhisek Konar , Adam Sigal , Steve Liu , Greg Dudek

Software Engineering Agents (SWE-Agents) have proven effective for traditional software engineering tasks with accessible codebases, but their performance for embodied tasks requiring well-designed information discovery remains unexplored.…

Software Engineering · Computer Science 2025-10-28 Timothé Boulet , Xavier Hinaut , Clément Moulin-Frier

Large language models (LLMs) have achieved remarkable progress, yet their internal mechanisms remain largely opaque, posing a significant challenge to their safe and reliable deployment. Sparse autoencoders (SAEs) have emerged as a…

Computation and Language · Computer Science 2026-02-11 Jiaojiao Han , Wujiang Xu , Mingyu Jin , Mengnan Du

Structured scene representations are a core component of embodied agents, helping to consolidate raw sensory streams into readable, modular, and searchable formats. Due to their high computational overhead, many approaches build such…

Artificial Intelligence · Computer Science 2025-06-03 Muhammad Qasim Ali , Saeejith Nair , Alexander Wong , Yuchen Cui , Yuhao Chen

Multi-modal AI systems will likely become a ubiquitous presence in our everyday lives. A promising approach to making these systems more interactive is to embody them as agents within physical and virtual environments. At present, systems…

The development of Large Language Models (LLMs) has catalyzed automation in customer service, yet benchmarking their performance remains challenging. Existing benchmarks predominantly rely on static paradigms and single-dimensional metrics,…

Artificial Intelligence · Computer Science 2026-04-13 Ling Shi , Yuqin Dai , Ziyin Wang , Ning Gao , Wei Zhang , Chaozheng Wang , Yujie Wang , Wei He , Jinpeng Wang , Deiyi Xiong

Fully leveraging the capabilities of AI agents in software development requires a rethinking of the software ecosystem itself. To this end, this paper outlines the creation of an Agentic Infused Software Ecosystem (AISE), that rests on…

Software Engineering · Computer Science 2026-02-25 Mark Marron

Significant progress has been made in scene understanding which seeks to build 3D, metric and object-oriented representations of the world. Concurrently, reinforcement learning has made impressive strides largely enabled by advances in…

Robotics · Computer Science 2020-11-23 Zachary Ravichandran , J. Daniel Griffith , Benjamin Smith , Costas Frost

City-scale 3D generation is of great importance for the development of embodied intelligence and world models. Existing methods, however, face significant challenges regarding quality, fidelity, and scalability in 3D world generation. Thus,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Shengyuan Wang , Zhiheng Zheng , Yu Shang , Lixuan He , Yangcheng Yu , Fan Hangyu , Jie Feng , Qingmin Liao , Yong Li

Grounding 3D scene affordance aims to locate interactive regions in 3D environments, which is crucial for embodied agents to interact intelligently with their surroundings. Most existing approaches achieve this by mapping semantics to 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Cuiyu Liu , Wei Zhai , Yuhang Yang , Hongchen Luo , Sen Liang , Yang Cao , Zheng-Jun Zha

Large language models (LLMs) have proven to work well in question-answering scenarios, but real-world applications often require access to tools for live information or actuation. For this, LLMs can be extended with tools, which are often…

Software Engineering · Computer Science 2026-01-16 Robert K. Strehlow , Tobias Küster , Oskar F. Kupke , Brandon Llanque Kurps , Fikret Sivrikaya , Sahin Albayrak

Sleep is vital for health, yet access to data alone does not guarantee improvement. While wearables and health apps enable tracking, users face a "Data-Action Gap," struggling to interpret metrics and translate them into action. Current…

Human-Computer Interaction · Computer Science 2026-04-21 Hansoo Lee , Yoonjae Cho , Sonya S. Kwak , Rafael A. Calvo

Constructing a physically realistic and accurately scaled simulated 3D world is crucial for the training and evaluation of embodied intelligence tasks. The diversity, realism, low cost accessibility and affordability of 3D data assets are…

Robotics · Computer Science 2025-06-17 Xinjie Wang , Liu Liu , Yu Cao , Ruiqi Wu , Wenkang Qin , Dehui Wang , Wei Sui , Zhizhong Su

Digital human generation has been studied for decades and supports a wide range of real-world applications. However, most existing systems are passively animated, relying on privileged state or scripted control, which limits scalability to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Hang Ye , Xiaoxuan Ma , Fan Lu , Wayne Wu , Kwan-Yee Lin , Yizhou Wang

To interact with daily-life articulated objects of diverse structures and functionalities, understanding the object parts plays a central role in both user instruction comprehension and task execution. However, the possible discordance…

Robotics · Computer Science 2024-04-02 Haoran Geng , Songlin Wei , Congyue Deng , Bokui Shen , He Wang , Leonidas Guibas

The development of embodied agents that can communicate with humans in natural language has gained increasing interest over the last years, as it facilitates the diffusion of robotic platforms in human-populated environments. As a step…

Robotics · Computer Science 2024-04-16 Roberto Bigazzi , Marcella Cornia , Silvia Cascianelli , Lorenzo Baraldi , Rita Cucchiara

Recent advances in vision language models (VLMs) have shown strong potential for spatial reasoning and 3D scene layout generation from open-ended language instructions. However, generating layouts that are not only semantically coherent but…

Artificial Intelligence · Computer Science 2026-03-10 Ali Shamsaddinlou

Current 3D scene graph generation (3DSGG) approaches heavily rely on a single-agent assumption and small-scale environments, exhibiting limited scalability to real-world scenarios. In this work, we introduce Multi-Agent 3D Scene Graph…

Robotics · Computer Science 2026-02-05 Yirum Kim , Jaewoo Kim , Ue-Hwan Kim

Agentic Software Engineering (SE 3.0) represents a new era where intelligent agents are tasked not with simple code generation, but with achieving complex, goal-oriented SE objectives. To harness these new capabilities while ensuring…

Software Engineering · Computer Science 2025-09-24 Ahmed E. Hassan , Hao Li , Dayi Lin , Bram Adams , Tse-Hsun Chen , Yutaro Kashiwa , Dong Qiu

Effective mental health counseling is a complex, theory-driven process requiring the simultaneous integration of psychological frameworks, real-time distress signals, and strategic intervention planning. This level of clinical reasoning is…

Computation and Language · Computer Science 2026-04-30 Eliya Naomi Aharon , Meytal Grimland , Avi Segal , Loona Ben Dayan , Inbar Shenfeld , Yossi Levi Belz , Kobi Gal