English
Related papers

Related papers: VisionClaw: Always-On AI Agents through Smart Glas…

200 papers

Human intelligence naturally intertwines omni-modal perception -- spanning vision, audio, and language -- with complex reasoning and tool usage to interact with the world. However, current multi-modal LLMs are primarily confined to bi-modal…

Artificial Intelligence · Computer Science 2026-03-03 Xiaoxi Li , Wenxiang Jiao , Jiarui Jin , Shijian Wang , Guanting Dong , Jiajie Jin , Hao Wang , Yinuo Wang , Ji-Rong Wen , Yuan Lu , Zhicheng Dou

Large language model (LLM) agents are increasingly used for complex tasks, yet deployed agents often remain static, failing to adapt as user needs evolve. This creates a tension between the need for continuous service and the necessity of…

Machine Learning · Computer Science 2026-03-19 Peng Xia , Jianwen Chen , Xinyu Yang , Haoqin Tu , Jiaqi Liu , Kaiwen Xiong , Siwei Han , Shi Qiu , Haonian Ji , Yuyin Zhou , Zeyu Zheng , Cihang Xie , Huaxiu Yao

Robotic manipulators are increasingly used to assist individuals with mobility impairments in object retrieval. However, the predominant joystick-based control interfaces can be challenging due to high precision requirements and unintuitive…

Robotics · Computer Science 2025-10-28 Zitiantao Lin , Yongpeng Sang , Yang Ye

Image generation models have evolved from text-conditioned pixel synthesis toward multimodal agents endowed with visual comprehension and tool invocation capabilities. Yet, existing agents remain at the mercy of underlying black-box image…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Junyan Ye , Jun He , Zilong Huang , Dongzhi Jiang , Xuan Yang , Rui Chen , Weijia Li

There has been a surge of interest in assistive wearable agents: agents embodied in wearable form factors (e.g., smart glasses) who take assistive actions toward a user's goal/query (e.g. "Where did I leave my keys?"). In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Vijay Veerabadran , Fanyi Xiao , Nitin Kamra , Pedro Matias , Joy Chen , Caley Drooff , Brett D Roads , Riley Williams , Ethan Henderson , Xuanyi Zhao , Kevin Carlberg , Joseph Tighe , Karl Ridgeway

Virtual assistants (VAs) have become ubiquitous in daily life, integrated into smartphones and smart devices, sparking interest in AI companions that enhance user experiences and foster emotional connections. However, existing companions…

Human-Computer Interaction · Computer Science 2025-09-03 Xuetong Wang , Ching Christie Pang , Pan Hui

The transfer of manipulation skills from human demonstration to robotic execution is often hindered by a "domain gap" in sensing and morphology. This paper introduces MagiClaw, a versatile two-finger end-effector designed to bridge this…

Robotics · Computer Science 2025-09-24 Tianyu Wu , Xudong Han , Haoran Sun , Zishang Zhang , Bangchao Huang , Chaoyang Song , Fang Wan

Artificial intelligence has shown promise in medical imaging, yet most existing systems lack flexibility, interpretability, and adaptability - challenges especially pronounced in ophthalmology, where diverse imaging modalities are…

Engaging with AI assistants to gather essential information in a timely manner is becoming increasingly common. Traditional activation methods, like wake words such as Hey Siri, Ok Google, and Hey Alexa, are constrained by technical…

Human-Computer Interaction · Computer Science 2025-07-02 Zhang Qing , Rekimoto Jun

Vision-Language-Action (VLA) models have shown remarkable progress in embodied tasks recently, but most methods process visual observations independently at each timestep. This history-agnostic design treats robot manipulation as a Markov…

Machine Learning · Computer Science 2026-04-13 Lei Xiao , Jifeng Li , Juntao Gao , Feiyang Ye , Yan Jin , Jingjing Qian , Jing Zhang , Yong Wu , Xiaoyuan Yu

We have developed a system for automatic facial expression recognition, which runs on Google Glass and delivers real-time social cues to the wearer. We evaluate the system as a behavioral aid for children with Autism Spectrum Disorder…

Human-Computer Interaction · Computer Science 2020-02-18 Catalin Voss , Peter Washington , Nick Haber , Aaron Kline , Jena Daniels , Azar Fazel , Titas De , Beth McCarthy , Carl Feinstein , Terry Winograd , Dennis Wall

Learning action models from real-world human-centric interaction datasets is important towards building general-purpose intelligent assistants with efficiency. However, most existing datasets only offer specialist interaction category and…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Liang Xu , Chengqun Yang , Zili Lin , Fei Xu , Yifan Liu , Congsheng Xu , Yiyi Zhang , Jie Qin , Xingdong Sheng , Yunhui Liu , Xin Jin , Yichao Yan , Wenjun Zeng , Xiaokang Yang

We present Claw AI Lab, a lab-native autonomous research platform that advances automated research from a hidden prompt-to-paper pipeline into an interactive AI laboratory. Rather than centering the system around a single agent or a fixed…

Artificial Intelligence · Computer Science 2026-05-22 Fan Wu , Cheng Chen , Zhenshan Tan , Taiyu Zhang , Xinzhen Xu , Yanyu Qian , Dingcheng Gao , Lanyun Zhu , Qi Zhu , Yi Tan , Deyi Ji , Guosheng Lin , Tianrun Chen , Deheng Ye , Fayao Liu

Agentic artificial intelligence systems promise to accelerate scientific workflows, but neuroimaging poses unique challenges: heterogeneous modalities (sMRI, fMRI, dMRI, EEG), long multi-stage pipelines, and persistent reproducibility…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Cheng Wang , Zhibin He , Zhihao Peng , Shengyuan Liu , Yufan Hu , Yang Carl , He Lifang , Lichao Sun , Xiang Li , Yixuan Yuan

The rise of OpenClaw in early 2026 marks the moment when millions of users began deploying personal AI agents into their daily lives, delegating tasks ranging from travel planning to multi-step research. This scale of adoption signals that…

Artificial Intelligence · Computer Science 2026-04-14 Ningyan Zhu , Huacan Wang , Jie Zhou , Feiyu Chen , Shuo Zhang , Ge Chen , Chen Liu , Jiarou Wu , Wangyi Chen , Xiaofeng Mou , Yi Xu

With AI agents increasingly deployed as long-running systems, it becomes essential to autonomously construct and continuously evolve customized software to enable interaction within dynamic environments. Yet, existing benchmarks evaluate…

Vision-language-action (VLA) reasoning tasks require agents to interpret multimodal instructions, perform long-horizon planning, and act adaptively in dynamic environments. Existing approaches typically train VLA models in an end-to-end…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Chi-Pin Huang , Yueh-Hua Wu , Min-Hung Chen , Yu-Chiang Frank Wang , Fu-En Yang

Large language model (LLM) agents such as OpenClaw rely on reusable skills to perform complex tasks, yet these skills remain largely static after deployment. As a result, similar workflows, tool usage patterns, and failure modes are…

Artificial Intelligence · Computer Science 2026-04-10 Ziyu Ma , Shidong Yang , Yuxiang Ji , Xucong Wang , Yong Wang , Yiming Hu , Tongwen Huang , Xiangxiang Chu

Achieving generalizable manipulation in unconstrained environments requires the robot to proactively resolve information uncertainty, i.e., the capability of active perception. However, existing methods are often confined in limited types…

Robotics · Computer Science 2026-02-05 Jialiang Li , Yi Qiao , Yunhan Guo , Changwen Chen , Wenzhao Lian

We introduce WearVQA, the first benchmark specifically designed to evaluate the Visual Question Answering (VQA) capabilities of multi-model AI assistant on wearable devices like smart glasses. Unlike prior benchmarks that focus on…