English
Related papers

Related papers: VisionClaw: Always-On AI Agents through Smart Glas…

200 papers

In daily life, there are many scenarios that people need to tackle data-related tasks, such as filling out forms, analyzing Excel files, and visualize data report. However, the tools available for these tasks often fragment, requiring users…

Databases · Computer Science 2026-04-28 Huahang Li , Wentao Hu , Zhuoyue Wan , Chen Jason Zhang , Haoyang Li , Xiaoyong Wei

Vision-Language-Action (VLA) systems have shown strong potential for language-driven robotic manipulation. However, scaling them to long-horizon tasks remains challenging. Existing pipelines typically separate data collection, policy…

Current embodied intelligent systems still face a substantial gap between high-level reasoning and low-level physical execution in open-world environments. Although Vision-Language-Action (VLA) models provide strong perception and intuitive…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Dongjie Huo , Haoyun Liu , Guoqing Liu , Dekang Qi , Zhiming Sun , Maoguo Gao , Jianxin He , Yandan Yang , Xinyuan Chang , Feng Xiong , Xing Wei , Zhiheng Ma , Mu Xu

Large-scale real-world robot data collection is a prerequisite for bringing robots into everyday deployment. However, existing pipelines often rely on specialized handheld devices to bridge the embodiment gap, which not only increases…

Robotics · Computer Science 2026-04-10 Yanwen Zou , Chenyang Shi , Wenye Yu , Han Xue , Jun Lv , Ye Pan , Chuan Wen , Cewu Lu

What if accessing the web did not require a screen, a stable desk, or even free hands? For people navigating crowded cities, living with low vision, or experiencing cognitive overload, smart glasses coupled with AI agents could turn the web…

Human-Computer Interaction · Computer Science 2026-03-03 Sicheng Yang , Yukai Huang , Weitong Cai , Shitong Sun , Fengyi Fang , You He , Yiqiao Xie , Jiankang Deng , Hang Zhang , Jifei Song , Zhensong Zhang

Inspired by the development of OpenClaw, there is a growing demand for mobile-based personal agents capable of handling complex and intuitive interactions. In this technical report, we introduce X-OmniClaw, a unified mobile agent designed…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Xiaoming Ren , Ru Zhen , Chao Li , Yang Song , Qiuxia Hou , Yanhao Zhang , Peng Liu , Qi Qi , Quanlong Zheng , Qi Wu , Zhenyi Liao , Binqiang Pan , Haobo Ji , Haonan Lu

In embodied AI, visual perception should be active rather than passive: the system must decide where to look and at what scale to sense to acquire maximally informative data under pixel and spatial budget constraints. Existing vision models…

Robotics · Computer Science 2026-04-06 Jiashu Yang , Yifan Han , Yucheng Xie , Ning Guo , Wenzhao Lian

Smart glasses are emerging as a promising interface between humans and artificial intelligence (AI) agents, enabling first-person perception, contextual awareness, and real-time assistance. However, continuous offloading of visual data from…

Signal Processing · Electrical Eng. & Systems 2026-04-28 Peiwen Jiang , Fangyu Liu , Jiajia Guo , Chao-Kai Wen , Shi Jin , Jun Zhang

Emerging applications such as embodied intelligence, AI hardware, autonomous driving, and intelligent cockpits rely on a real-time perception-decision-action closed loop, posing stringent challenges for streaming video understanding.…

We present AI-Gram, a fully deployed, continuously operating social platform where every participant is an autonomous LLM-driven agent generating and responding to visual content. Unlike prior multi-agent simulations, AI-Gram operates as a…

Artificial Intelligence · Computer Science 2026-05-05 Andrew Shin

This paper presents an AI glasses system that integrates real-time voice processing, artificial intelligence(AI) agents, and cross-network streaming capabilities. The system employs dual-agent architecture where Agent 01 handles Automatic…

Sound · Computer Science 2026-01-13 Sheng-Kai Chen , Jyh-Horng Wu , Ching-Yao Lin , Yen-Ting Lin

We introduce Vinci, a real-time embodied smart assistant built upon an egocentric vision-language model. Designed for deployment on portable devices such as smartphones and wearable cameras, Vinci operates in an "always on" mode,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Yifei Huang , Jilan Xu , Baoqi Pei , Yuping He , Guo Chen , Lijin Yang , Xinyuan Chen , Yaohui Wang , Zheng Nie , Jinyao Liu , Guoshun Fan , Dechen Lin , Fang Fang , Kunpeng Li , Chang Yuan , Yali Wang , Yu Qiao , Limin Wang

Large language models (LLMs) have evolved AI assistants into autonomous reasoning engines that maintain context, invoke tools, and pursue long-horizon tasks. This has spurred Agent Operating Systems (Agent OS) as kernel-like layers for…

Human-Computer Interaction · Computer Science 2026-05-18 Heyuan Huang , Yeyi Guan , Jihong Wang , Mingzhi Wang , Jiamu Zhou , Xiangmou Qu , Jiaxin Yin , Xin Liao , Xingyu Lou , Jun Wang

The transition from optical identification of 2D quantum materials to practical device fabrication requires dynamic reasoning beyond the detection accuracy. While recent domain-specific Multimodal Large Language Models (MLLMs) successfully…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Sankalp Pandey , Xuan-Bac Nguyen , Hoang-Quan Nguyen , Tim Faltermeier , Nicholas Borys , Hugh Churchill , Khoa Luu

When language is utilized as a medium to store and communicate sensory information, there arises a kind of radical virtual reality, namely "the realities that are reduced into the same sentence are virtual/equivalent." In the current era,…

Human-Computer Interaction · Computer Science 2024-12-04 Goki Muramoto , Yuri Yasui , Hirosuke Asahi

The safety of autonomous AI agents is increasingly recognized as a critical open problem. As agents transition from passive text generators to active actors capable of executing shell commands, modifying files, calling APIs, and browsing…

Artificial Intelligence · Computer Science 2026-05-19 Ashwin Aravind

The integration of large language models (LLMs) with embodied agents has improved high-level reasoning capabilities; however, a critical gap remains between semantic understanding and physical execution. While vision-language-action (VLA)…

Robotics · Computer Science 2026-04-07 Rongfeng Zhao , Xuanhao Zhang , Zhaochen Guo , Xiang Shao , Zhongpan Zhu , Bin He , Jie Chen

The rapid advancement of AI-powered smart glasses-one of the hottest wearable devices-has unlocked new frontiers for multimodal interaction, with Visual Question Answering (VQA) over external knowledge sources emerging as a core…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Zhuohang Jiang , Xu Yuan , Haohao Qu , Shanru Lin , Kanglong Liu , Wenqi Fan , Qing Li

Embodied AI research is increasingly moving beyond single-task, single-environment policy learning toward multi-task, multi-scene, and multi-model settings. This shift substantially increases the engineering overhead and development time…

Robotics · Computer Science 2026-04-16 Xueyang Zhou , Yihan Sun , Xijie Gong , Guiyao Tie , Pan Zhou , Lichao Sun , Yongchao Chen

Recent advances in large vision-language models (VLMs) have demonstrated generalizable open-vocabulary perception and reasoning, yet their real-robot manipulation capability remains unclear for long-horizon, closed-loop execution in…

‹ Prev 1 2 3 10 Next ›