English
Related papers

Related papers: Boosting Embodied AI Agents through Perception-Gen…

200 papers

Computer models are indispensable tools for understanding the Earth system. While high-resolution operational models have achieved many successes, they exhibit persistent biases, particularly in simulating extreme events and statistical…

Machine Learning · Computer Science 2025-10-16 Pouria Behnoudfar , Charlotte Moser , Marc Bocquet , Sibo Cheng , Nan Chen

Conventional generative models for materials discovery are predominantly trained and validated using data from Density Functional Theory (DFT) with approximate exchange-correlation functionals. This creates a fundamental bottleneck: these…

Artificial Intelligence · Computer Science 2026-04-30 Mahule Roy

Embodied Artificial Intelligence (AI) systems, such as autonomous robots and intelligent vehicles, are increasingly reliant on diverse heterogeneous accelerators (e.g., GPGPUs, NPUs, FPGAs) to meet stringent real-time processing and…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-16 Jieke Lin , Wanyu Wang , Longxiang Yin , Yinhe Han

We present PEAM, a Parametric Embodied Agent Memory framework in Minecraft that transforms agent memory from inference-time retrieval into parameter-resident skills internalized through experience. PEAM pairs a slow deliberative LLM for…

Artificial Intelligence · Computer Science 2026-05-28 Yuchen Guo , Junli Gong , Hongmin Cai , Yiu-ming Cheung , Weifeng Su

Active event perception, the ability to dynamically detect, track, and summarize events in real time, is essential for embodied intelligence in tasks such as human-AI collaboration, assistive robotics, and autonomous navigation. However,…

Robotics · Computer Science 2025-06-24 Zhou Chen , Sanjoy Kundu , Harsimran S. Baweja , Sathyanarayanan N. Aakur

There is no limit to how much a robot might explore and learn, but all of that knowledge needs to be searchable and actionable. Within language research, retrieval augmented generation (RAG) has become the workhorse of large-scale…

Embodied artificial intelligence (Embodied AI) plays a pivotal role in the application of advanced technologies in the intelligent era, where AI systems are integrated with physical bodies that enable them to perceive, reason, and interact…

Artificial Intelligence · Computer Science 2025-06-24 Zhaohan Feng , Ruiqi Xue , Lei Yuan , Yang Yu , Ning Ding , Meiqin Liu , Bingzhao Gao , Jian Sun , Xinhu Zheng , Gang Wang

Infrared-visible image fusion aims to create an information-rich fused image by integrating the complementary thermal saliency from infrared sensing and fine textures from visible imaging. Such accurate fusion is essential for real-world…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Zhenyu Sun , Luobin Zhang , Axi Niu , Haishen Wang , Qingsen Yan

Enterprise Resource Planning (ERP) systems serve as the digital backbone of modern financial institutions, yet they continue to rely on static, rule-based workflows that limit adaptability, scalability, and intelligence. As business…

Artificial Intelligence · Computer Science 2025-06-03 Hongyang Yang , Likun Lin , Yang She , Xinyu Liao , Jiaoyang Wang , Runjia Zhang , Yuquan Mo , Christina Dan Wang

We present Megaverse, a new 3D simulation platform for reinforcement learning and embodied AI research. The efficient design of our engine enables physics-based simulation with high-dimensional egocentric observations at more than 1,000,000…

Machine Learning · Computer Science 2021-07-22 Aleksei Petrenko , Erik Wijmans , Brennan Shacklett , Vladlen Koltun

Current perceptive models heavily depend on resource-intensive datasets, prompting the need for innovative solutions. Leveraging recent advances in diffusion models, synthetic data, by constructing image inputs from various annotations,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Yibo Wang , Ruiyuan Gao , Kai Chen , Kaiqiang Zhou , Yingjie Cai , Lanqing Hong , Zhenguo Li , Lihui Jiang , Dit-Yan Yeung , Qiang Xu , Kai Zhang

Pre-trained models for automatic speech recognition (ASR) and speech enhancement (SE) have exhibited remarkable capabilities under matched noise and channel conditions. However, these models often suffer from severe performance degradation…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-03 Chien-Chun Wang , Hung-Shin Lee , Hsin-Min Wang , Berlin Chen

Learning-based methods for training embodied agents typically require a large number of high-quality scenes that contain realistic layouts and support meaningful interactions. However, current simulators for Embodied AI (EAI) challenges…

Artificial Intelligence · Computer Science 2021-11-11 Yizhou Zhao , Kaixiang Lin , Zhiwei Jia , Qiaozi Gao , Govind Thattai , Jesse Thomason , Gaurav S. Sukhatme

Audio-driven avatar interaction demands real-time, streaming, and infinite-length generation -- capabilities fundamentally at odds with the sequential denoising and long-horizon drift of current diffusion models. We present Live Avatar, an…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Yubo Huang , Hailong Guo , Fangtai Wu , Weiqiang Wang , Shifeng Zhang , Shijie Huang , Qijun Gan , Lin Liu , Sirui Zhao , Enhong Chen , Jiaming Liu , Steven Hoi

Embodied intelligence is a key step towards Artificial General Intelligence (AGI), yet its development faces multiple challenges including data, frameworks, infrastructure, and evaluation systems. To address these issues, we have, for the…

Embodied Artificial Intelligence (AI) is an intelligent system formed by agents and their environment through active perception, embodied cognition, and action interaction. Existing embodied AI remains confined to human-crafted setting, in…

Emerging Technologies · Computer Science 2026-02-05 Tongtong Feng , Xin Wang , Wenwu Zhu

Generative artificial intelligence (AI) technology is revolutionizing the computing industry. Not only its applications have broadened to various sectors but also poses new system design and optimization opportunities. The technology is…

Text-to-Image generation has seen significant advancements in output realism with the advent of diffusion models. However, diffusion models encounter difficulties when tasked with generating multiple objects, frequently resulting in…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Federico Betti , Lorenzo Baraldi , Lorenzo Baraldi , Rita Cucchiara , Nicu Sebe

Diffusion models has emerged as a powerful framework for tasks like image controllable generation and dense prediction. However, existing models often struggle to capture underlying semantics (e.g., edges, textures, shapes) and effectively…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Zhong Ji , Weilong Cao , Yan Zhang , Yanwei Pang , Jungong Han , Xuelong Li

The advent of Generative Artificial Intelligence (GAI) has heralded an inflection point that changed how society thinks about knowledge acquisition. While GAI cannot be fully trusted for decision-making, it may still provide valuable…

Methodology · Statistics 2025-05-20 Sean O'Hagan , Veronika Ročková