中文
相关论文

相关论文: RynnBrain: Open Embodied Foundation Models

200 篇论文

Task planning for robots in real-life settings presents significant challenges. These challenges stem from three primary issues: the difficulty in identifying grounded sequences of steps to achieve a goal; the lack of a standardized mapping…

机器人学 · 计算机科学 2024-10-23 Francesco Argenziano , Michele Brienza , Vincenzo Suriani , Daniele Nardi , Domenico D. Bloisi

We introduce Griffin, the first foundation model attemptation designed specifically for Relational Databases (RDBs). Unlike previous smaller models focused on single RDB tasks, Griffin unifies the data encoder and task decoder to handle…

机器学习 · 计算机科学 2025-06-12 Yanbo Wang , Xiyuan Wang , Quan Gan , Minjie Wang , Qibin Yang , David Wipf , Muhan Zhang

Deploying foundation models in embodied edge systems is fundamentally a systems problem, not just a problem of model compression. Real-time control must operate within strict size, weight, and power constraints, where memory traffic,…

For decades, neuroscientists and computer scientists have pursued a shared ambition: to understand intelligence and build it. Modern artificial neural networks now rival humans in language, perception, and reasoning, yet it is still largely…

Cognitive processes are realized across an extraordinary range of natural, artificial, and hybrid systems, yet there is no unified framework for comparing their forms, limits, and unrealized possibilities. Here, we propose a cognition space…

神经元与认知 · 定量生物学 2026-01-21 Ricard Solé , Luis F Seoane , Jordi Pla-Mauri , Michael Timothy Bennett , Michael E. Hochberg , Michael Levin

Recent advances in vision, language, and multimodal learning have substantially accelerated progress in robotic foundation models, with robot manipulation remaining a central and challenging problem. This survey examines robot manipulation…

The enhancement of generalization in robots by large vision-language models (LVLMs) is increasingly evident. Therefore, the embodied cognitive abilities of LVLMs based on egocentric videos are of great interest. However, current datasets…

计算机视觉与模式识别 · 计算机科学 2025-03-14 Ronghao Dang , Yuqian Yuan , Wenqi Zhang , Yifei Xin , Boqiang Zhang , Long Li , Liuyi Wang , Qinyang Zeng , Xin Li , Lidong Bing

A core task in embodied intelligence is ego-centric 3D visual grounding. Existing methods typically adopt two-stage, heterogeneous pipelines that pair a detector with a separate grounding model. Incompatible decoders and box heads hinder…

计算机视觉与模式识别 · 计算机科学 2026-04-29 Yani Zhang , Dongming Wu , Hao Shi , Yingfei Liu , Tiancai Wang , Xingping Dong

The recent rapid development of Large Vision-Language Models (LVLMs) has indicated their potential for embodied tasks.However, the critical skill of spatial understanding in embodied environments has not been thoroughly evaluated, leaving…

人工智能 · 计算机科学 2024-06-11 Mengfei Du , Binhao Wu , Zejun Li , Xuanjing Huang , Zhongyu Wei

Despite significant progress in natural language understanding, Large Language Models (LLMs) remain error-prone when performing logical reasoning, often lacking the robust mental representations that enable human-like comprehension. We…

人工智能 · 计算机科学 2025-09-05 François Olivier , Zied Bouraoui

Large Language Models (LLMs) have demonstrated remarkable capabilities across various tasks, yet they face significant challenges in embodied task planning scenarios that require continuous environmental understanding and action generation.…

计算与语言 · 计算机科学 2025-07-01 Zhaoye Fei , Li Ji , Siyin Wang , Junhao Shi , Jingjing Gong , Xipeng Qiu

Foundation models (FMs), large neural networks pretrained on extensive and diverse datasets, have revolutionized artificial intelligence and shown significant promise in medical imaging by enabling robust performance with limited labeled…

图像与视频处理 · 电气工程与系统科学 2025-06-17 Salah Ghamizi , Georgia Kanli , Yu Deng , Magali Perquin , Olivier Keunen

Brain foundation models bring the foundation model paradigm to the field of neuroscience. Like language and image foundation models, they are general-purpose AI systems pretrained on large-scale datasets that adapt readily to downstream…

计算机与社会 · 计算机科学 2026-02-04 Margot Hanley , Jiunn-Tyng Yeh , Ryan Rodriguez , Jack Pilkington , Nita Farahany

Resting-state functional magnetic resonance imaging (rsfMRI) is a powerful tool for investigating the relationship between brain function and cognitive processes as it allows for the functional organization of the brain to be captured…

机器学习 · 计算机科学 2025-02-25 Bishal Thapaliya , Esra Akbas , Jiayu Chen , Raam Sapkota , Bhaskar Ray , Pranav Suresh , Vince Calhoun , Jingyu Liu

Magnetic resonance imaging~(MRI) have played a crucial role in brain disease diagnosis, with which a range of computer-aided artificial intelligence methods have been proposed. However, the early explorations usually focus on the limited…

计算机视觉与模式识别 · 计算机科学 2023-09-14 Jiayu Lei , Lisong Dai , Haoyun Jiang , Chaoyi Wu , Xiaoman Zhang , Yao Zhang , Jiangchao Yao , Weidi Xie , Yanyong Zhang , Yuehua Li , Ya Zhang , Yanfeng Wang

Despite impressive progress in high-fidelity image synthesis, generative models still struggle with logic-intensive instruction following, exposing a persistent reasoning--execution gap. Meanwhile, closed-source systems (e.g., Nano Banana)…

计算机视觉与模式识别 · 计算机科学 2026-04-06 Sashuai Zhou , Qiang Zhou , Jijin Hu , Hanqing Yang , Yue Cao , Junpeng Ma , Yinchao Ma , Jun Song , Tiezheng Ge , Cheng Yu , Bo Zheng , Zhou Zhao

Recent vision and multimodal foundation backbones, such as Transformer families and state-space models like Mamba, have achieved remarkable progress, enabling unified modeling across images, text, and beyond. Despite their empirical…

Reinforcement learning with verifiable rewards (RLVR) has become central to post-training reasoning models, yet a key limitation of existing studies is their narrow view of the reasoning space: difficulty is treated as reasoning depth…

计算与语言 · 计算机科学 2026-05-27 Yihua Zhu , Qianying Liu , Fei Cheng , Jiaxin Wang , Akiko Aizawa , Sadao Kurohashi , Hidetoshi Shimodaira

We present Brain Harmony (BrainHarmonix), the first multimodal brain foundation model that unifies structural morphology and functional dynamics into compact 1D token representations. The model was pretrained on two of the largest…

We present OrbiSim, a novel robotic simulation paradigm that redefines world models as a fully differentiable physics engine for embodied intelligence. Unlike prior world models that focus on unconstrained imagination in latent or visual…

机器人学 · 计算机科学 2026-05-19 Jiajian Li , Jingyuan Huang , Junru Gong , Qi Wang , Xiaokang Yang , Yunbo Wang