English
Related papers

Related papers: VisionClaw: Always-On AI Agents through Smart Glas…

200 papers

Autonomous agent systems such as OpenClaw introduce significant efficiency challenges due to long-context inputs and multi-turn reasoning. This results in prohibitively high computational and monetary costs in real-world development. While…

Artificial Intelligence · Computer Science 2026-04-27 Manyi Zhang , Ji-Fu Li , Zhongao Sun , Xiaohao Liu , Zhenhua Dong , Xianzhi Yu , Haoli Bai , Xiaobo Xia

We envision the "virtual eye" as a next-generation, AI-powered platform that uses interconnected foundation models to simulate the eye's intricate structure and biological function across all scales. Advances in AI, imaging, and multiomics…

Tissues and Organs · Quantitative Biology 2025-05-12 Yue Wu , Yibo Guo , Yulong Yan , Jiancheng Yang , Xin Zhou , Ching-Yu Cheng , Danli Shi , Mingguang He

As embodied agents become central to VR, telepresence, and digital human applications, their motion must go beyond speech-aligned gestures: agents should turn toward users, respond to their movement, and maintain natural gaze. Current…

Computer Vision and Pattern Recognition · Computer Science 2026-02-23 Evonne Ng , Siwei Zhang , Zhang Chen , Michael Zollhoefer , Alexander Richard

Recent advances in Vision-Language-Action (VLA) models have shown strong potential for general-purpose robotic manipulation. However, the visual representations of most VLA models are often dominated by global object appearance and struggle…

Robotics · Computer Science 2026-05-19 Weijie Kong , Zhian Su , Wei Yu , Huixu Dong

We present, to our knowledge, the first sign language-driven Vision-Language-Action (VLA) framework for intuitive and inclusive human-robot interaction. Unlike conventional approaches that rely on gloss annotations as intermediate…

Vision-Language-Action (VLA) models have significantly advanced the capabilities of robotic agents in executing diverse tasks; however, they still face challenges in contact-rich manipulation scenarios that require precise physical…

Robotics · Computer Science 2026-05-19 Xiaoqi Li , Muhe Cai , Jiadong Xu , Juan Zhu , Hongwei Fan , Yan Shen , Guangrui Ren , Hao Dong

Agentic Artificial Intelligence (AI) constitutes a transformative paradigm in the evolution of intelligent agents and decision-support systems, redefining smart environments by enhancing operational efficiency, optimizing resource…

Large language model (LLM)-based agents that reason, plan, and act through tools, memory, and structured interaction are emerging as a promising paradigm for automating complex workflows. Recent systems such as OpenClaw and Claude Code…

Information Retrieval · Computer Science 2026-05-27 Yingli Zhou , Wang Shu , Yaodong Su , Wenchuan Du , Yixiang Fang , Xuemin Lin

Meaningful social interaction is vital to well-being, yet Blind and Low Vision (BLV) individuals face persistent barriers when collaborating with sighted peers due to inaccessible visual cues. While most wearable assistive technologies…

Human-Computer Interaction · Computer Science 2026-04-09 Jieqiong Ding , Yumo Zhang , Xiuqi Tommy Zhu , Kaige Yang , Yuqing Wei , Shiyi Wang , Yishan Liu , Yang Jiao

Large language model agents are increasingly envisioned as always-on personal assistants with access to anything relevant in the user's digital world. Yet current systems operate over only narrow slices of that world, limiting…

Artificial Intelligence · Computer Science 2026-05-26 Yusong Lin , Xinyuan Liang , Haiyang Wang , Qipeng Gu , Siqi Cheng , Jiangui Chen , Shuzhe Wu , Feiyang Pan , Lue Fan , Sanyuan Zhao , Dandan Tu

Despite the recent successes in robotics, artificial intelligence and computer vision, a complete artificial agent necessarily must include active perception. A multitude of ideas and methods for how to accomplish this have already appeared…

Computer Vision and Pattern Recognition · Computer Science 2016-03-15 Ruzena Bajcsy , Yiannis Aloimonos , John K. Tsotsos

Vision plays a crucial role in comprehending the world around us. More than 85% of the external information is obtained through the vision system. It influences our mobility, cognition, information access, and interaction with the…

Computer Vision and Pattern Recognition · Computer Science 2022-01-05 Ishwarya Sivakumar , Nishaali Meenakshisundaram , Ishwarya Ramesh , Shiloah Elizabeth D , Sunil Retmin Raj C

Environments built for people are increasingly operated by a new class of economic actors: LLM-powered software agents making decisions on our behalf. These decisions range from our purchases to travel plans to medical treatment selection.…

Artificial Intelligence · Computer Science 2026-02-25 Manuel Cherep , Chengtian Ma , Abigail Xu , Maya Shaked , Pattie Maes , Nikhil Singh

This paper proposes a unique active relative localization mechanism for multi-agent Simultaneous Localization and Mapping(SLAM),in which a agent to be observed are considered as a task, which is performed by others assisting that agent by…

Artificial Intelligence · Computer Science 2019-09-24 Zhaoyi Pei , Piaosong Hao , Meixiang Quan , Muhammad Zuhair Qadir , Guo Li

Manipulation tasks in daily life, such as pouring water, unfold intentionally under specialized manipulation contexts. Being able to process contextual knowledge in these Activities of Daily Living (ADLs) over time can help us understand…

Computer Vision and Pattern Recognition · Computer Science 2020-03-04 Chen Jiang , Masood Dehghan , Martin Jagersand

Biological laboratory automation can reduce repetitive manual work and improve reproducibility, but reliable embodied execution in wet-lab environments remains challenging. Protocols are often unstructured, labware is frequently transparent…

Robotics · Computer Science 2026-05-11 Zhaohui Du , Zhe Wang , Hongmei Fei , Xiwen Cao , Ting Xiao , Qi Wang , Huanbo Jin , Jiaming Gu , Quan Lu , Zhe Liu

Autonomous coding agents are increasingly integrated into software development workflows, offering capabilities that extend beyond code suggestion to active system interaction and environment management. OpenClaw, a representative platform…

Cryptography and Security · Computer Science 2026-03-23 Fazhong Liu , Zhuoyan Chen , Tu Lan , Haozhen Tan , Zhenyu Xu , Xiang Li , Guoxing Chen , Yan Meng , Haojin Zhu

Information workers' productivity is significantly influenced by their cognitive states and physiological responses. AI assistants such as ChatGPT, Copilot, and others have become integral components of knowledge-intensive workplaces. These…

Human-Computer Interaction · Computer Science 2026-05-12 Amog Rao , Utkarsh Agarwal , Amol Harsh , Siddharth Siddharth

Vision-Language-Action Models (VLAs) have shown remarkable progress towards embodied intelligence. While their architecture partially resembles that of Large Language Models (LLMs), VLAs exhibit higher complexity due to their multi-modal…

Robotics · Computer Science 2026-03-06 Hugo Buurmeijer , Carmen Amo Alonso , Aiden Swann , Marco Pavone

A promising effective human-robot interaction in assistive robotic systems is gaze-based control. However, current gaze-based assistive systems mainly help users with basic grasping actions, offering limited support. Moreover, the…

Robotics · Computer Science 2025-08-20 Zejia Zhang , Bo Yang , Xinxing Chen , Weizhuang Shi , Haoyuan Wang , Wei Luo , Jian Huang