English
Related papers

Related papers: CAGE: Causal Attention Enables Data-Efficient Gene…

200 papers

The integration of single-cell RNA sequencing (scRNA-seq) and spatial transcriptomics (ST) data is crucial for understanding gene expression in spatial context. Existing methods for such integration have limited performance, with structural…

Computer Vision and Pattern Recognition · Computer Science 2025-02-12 Rabeya Tus Sadia , Md Atik Ahamed , Qiang Cheng

Robot caregiving should be personalized to meet the diverse needs of care recipients -- assisting with tasks as needed, while taking user agency in action into account. In physical tasks such as handover, bathing, dressing, and…

Exploiting robots for activities in human-shared environments, whether warehouses, shopping centres or hospitals, calls for such robots to understand the underlying physical interactions between nearby agents and objects. In particular,…

Robotics · Computer Science 2023-02-21 Luca Castri , Sariah Mghames , Marc Hanheide , Nicola Bellotto

Vision-Language-Action (VLA) models demonstrate promising generalization in robotic manipulation, driven by advances in large-scale vision and language pre-training. This progress can be misleading. Despite the zero-shot perception and…

Reinforcement learning (RL) is a promising approach for robotic navigation, allowing robots to learn through trial and error. However, real-world robotic tasks often suffer from sparse rewards, leading to inefficient exploration and…

Foundation models have brought changes to the landscape of machine learning, demonstrating sparks of human-level intelligence across a diverse array of tasks. However, a gap persists in complex tasks such as causal inference, primarily due…

Machine Learning · Computer Science 2024-06-05 Jiaqi Zhang , Joel Jennings , Agrin Hilmkil , Nick Pawlowski , Cheng Zhang , Chao Ma

"Code-as-Policy" considers how executable code can complement data-intensive Vision-Language-Action (VLA) methods, yet their effectiveness as autonomous controllers for embodied manipulation remains underexplored. We present CaP-X, an…

Modern paradigms for robot imitation train expressive policy architectures on large amounts of human demonstration data. Yet performance on contact-rich, deformable-object, and long-horizon tasks plateau far below perfect execution, even…

Robotics · Computer Science 2025-09-10 Zheyuan Hu , Robyn Wu , Naveen Enock , Jasmine Li , Riya Kadakia , Zackory Erickson , Aviral Kumar

Traditional robotic approaches rely on an accurate model of the environment, a detailed description of how to perform the task, and a robust perception system to keep track of the current state. On the other hand, reinforcement learning…

Robust generalization in robotic manipulation is crucial for robots to adapt flexibly to diverse environments. Existing methods usually improve generalization by scaling data and networks, but model tasks independently and overlook…

Robotics · Computer Science 2026-01-19 Aoshen Huang , Jiaming Chen , Jiyu Cheng , Ran Song , Wei Pan , Wei Zhang

Designing intuitive interfaces for robotic control remains a central challenge in enabling effective human-robot interaction, particularly in assistive care settings. Eye gaze offers a fast, non-intrusive, and intent-rich input modality,…

Robotics · Computer Science 2026-01-12 Tracey Yee Hsin Tay , Xu Yan , Jonathan Ouyang , Daniel Wu , William Jiang , Jonathan Kao , Yuchen Cui

Leveraging deep learning for causal discovery in time series remains challenging because existing neural methods predominantly rely on component-wise architectures that fail to capture shared system dynamics or employ decoupled post-hoc…

Machine Learning · Computer Science 2026-05-11 Omar Muhammad , Pasupuleti Dhruv Shivkant , Deepak N. Subramani

This work highlights that video world modeling, alongside vision-language pre-training, establishes a fresh and independent foundation for robot learning. Intuitively, video world models provide the ability to imagine the near future by…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Lin Li , Qihang Zhang , Yiming Luo , Shuai Yang , Ruilin Wang , Fei Han , Mingrui Yu , Zelin Gao , Nan Xue , Xing Zhu , Yujun Shen , Yinghao Xu

General-purpose robots coexisting with humans in their environment must learn to relate human language to their perceptions and actions to be useful in a range of daily tasks. Moreover, they need to acquire a diverse repertoire of…

Robotics · Computer Science 2022-07-14 Oier Mees , Lukas Hermann , Erick Rosete-Beas , Wolfram Burgard

Improving the generalization capabilities of general-purpose robotic manipulation agents in the real world has long been a significant challenge. Existing approaches often rely on collecting large-scale robotic data which is costly and…

Robotics · Computer Science 2025-02-10 Jiange Yang , Wenhui Tan , Chuhao Jin , Keling Yao , Bei Liu , Jianlong Fu , Ruihua Song , Gangshan Wu , Limin Wang

Learning from Interactive Demonstrations has revolutionized the way non-expert humans teach robots. It is enough to kinesthetically move the robot around to teach pick-and-place, dressing, or cleaning policies. However, the main challenge…

Robotics · Computer Science 2025-08-01 Giovanni Franzese , Ravi Prakash , Cosimo Della Santina , Jens Kober

Diffusion Policy has dominated action generation due to its strong capabilities for modeling multi-modal action distributions, but its multi-step denoising processes make it impractical for real-time visuomotor control. Existing…

Robotics · Computer Science 2026-05-18 Kangye Ji , Jianbo Zhou , Yuan Meng , Ye Li , Hanyun Cui , Zhi Wang

Caging is a promising tool which allows a robot to manipulate an object without directly reasoning about the contact dynamics involved. Furthermore, caging also provides useful guarantees in terms of robustness to uncertainty, and often…

Robotics · Computer Science 2019-08-05 Bernardo Aceituno-Cabezas , Hongkai Dai , Alberto Rodriguez

Attention (and distraction) recognition is a key factor in improving human-robot collaboration. We present an assembly scenario where a human operator and a cobot collaborate equally to piece together a gearbox. The setup provides multiple…

Human-Computer Interaction · Computer Science 2023-04-03 Pooja Prajod , Matteo Lavit Nicora , Matteo Malosio , Elisabeth André

Using Reinforcement Learning (RL) to learn new robotic tasks from scratch is often inefficient. Leveraging prior knowledge has the potential to significantly enhance learning efficiency, which, however, raises two critical challenges: how…

Robotics · Computer Science 2025-06-10 Zechen Hu , Tong Xu , Xuesu Xiao , Xuan Wang