English
Related papers

Related papers: AOMGen: Photoreal, Physics-Consistent Demonstratio…

200 papers

Vision-Language-Action (VLA) models have emerged as a powerful paradigm for embodied intelligence, enabling robots to perform tasks based on natural language instructions and current visual input. However, existing VLA models struggle with…

Vision Language Action (VLA) models derive their generalization capability from diverse training data, yet collecting embodied robot interaction data remains prohibitively expensive. In contrast, human demonstration videos are far more…

Unifying diverse image generation tasks within a single framework remains a fundamental challenge in visual generation. While large language models (LLMs) achieve unification through task-agnostic data and generation, existing visual…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Yijing Lin , Mengqi Huang , Shuhan Zhuang , Zhendong Mao

Robot manipulation learning from human demonstrations offers a rapid means to acquire skills but often lacks generalization across diverse scenes and object placements. This limitation hinders real-world applications, particularly in…

The scaling of large language models to encode all the world's knowledge in model parameters is unsustainable and has exacerbated resource barriers. Retrieval-Augmented Generation (RAG) presents a potential solution, yet its application to…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Varun Nagaraj Rao , Siddharth Choudhary , Aditya Deshpande , Ravi Kumar Satzoda , Srikar Appalaraju

Unified conditional image generation remains difficult because different tasks depend on fundamentally different internal representations. Some require conceptual understanding for semantic synthesis, while others rely on localization cues…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 YuXin Song , Yu Lu , Haoyuan Sun , Huanjin Yao , Fanglong Liu , Yifan Sun , Haocheng Feng , Hang Zhou , Jingdong Wang

Ocular biometrics in the visible spectrum have emerged as a prominent modality due to their high accuracy, resistance to spoofing, and non-invasive nature. However, morphing attacks, synthetic biometric traits created by blending features…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Bharath Krishnamurthy , Ajita Rattani

Dexterous manipulation is essential for real-world robot autonomy, mirroring the central role of human hand coordination in daily activity. Humans rely on rich multimodal perception--vision, sound, and language-guided intent--to perform…

Lately, researchers in artificial intelligence have been really interested in how language and vision come together, giving rise to the development of multimodal models that aim to seamlessly integrate textual and visual information.…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Rajat Chawla , Arkajit Datta , Tushar Verma , Adarsh Jha , Anmol Gautam , Ayush Vatsal , Sukrit Chaterjee , Mukunda NS , Ishaan Bhola

The performance of robotic imitation learning is fundamentally limited by data quality and training strategies. Prevalent sampling strategies on RLBench suffer from severe keyframe redundancy and imbalanced temporal distribution, leading to…

Robotics · Computer Science 2026-03-03 Fanqi Pu , Lei Jiang , Wenming Yang

We present UniGen-1.5, a unified multimodal large language model (MLLM) for advanced image understanding, generation and editing. Building upon UniGen, we comprehensively enhance the model architecture and training pipeline to strengthen…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Rui Tian , Mingfei Gao , Haiming Gang , Jiasen Lu , Zhe Gan , Yinfei Yang , Zuxuan Wu , Afshin Dehghan

We introduce UniGen, a unified multimodal large language model (MLLM) capable of image understanding and generation. We study the full training pipeline of UniGen from a data-centric perspective, including multi-stage pre-training,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Rui Tian , Mingfei Gao , Mingze Xu , Jiaming Hu , Jiasen Lu , Zuxuan Wu , Yinfei Yang , Afshin Dehghan

Vision-language-action (VLA) models show potential for general robotic tasks, but remain challenging in spatiotemporally coherent manipulation, which requires fine-grained representations. Typically, existing methods embed 3D positions into…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Hanyu Zhou , Chuanhao Ma , Gim Hee Lee

Building embodied agents capable of accomplishing arbitrary tasks is a core objective towards achieving embodied artificial general intelligence (E-AGI). While recent work has advanced such general robot policies, their training and…

Robotics · Computer Science 2025-07-30 Liu Dai , Haina Wang , Weikang Wan , Hao Su

We present PhysGen, a novel image-to-video generation method that converts a single image and an input condition (e.g., force and torque applied to an object in the image) to produce a realistic, physically plausible, and temporally…

Computer Vision and Pattern Recognition · Computer Science 2024-09-30 Shaowei Liu , Zhongzheng Ren , Saurabh Gupta , Shenlong Wang

Recent studies on Vision-Language-Action (VLA) models have shifted from the end-to-end action-generation paradigm toward a pipeline involving task planning followed by action generation, demonstrating improved performance on various…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Chongkai Gao , Zixuan Liu , Zhenghao Chi , Junshan Huang , Xin Fei , Yiwen Hou , Yuxuan Zhang , Yudi Lin , Zhirui Fang , Zeyu Jiang , Lin Shao

It has been advocated that medical imaging systems and reconstruction algorithms should be assessed and optimized by use of objective measures of image quality that quantify the performance of an observer at specific diagnostic tasks. One…

Image and Video Processing · Electrical Eng. & Systems 2020-06-02 Weimin Zhou , Sayantan Bhadra , Frank J. Brooks , Hua Li , Mark A. Anastasio

Vision-Language-Action (VLA) models offer a pivotal approach to learning robotic manipulation at scale by repurposing large pre-trained Vision-Language-Models (VLM) to output robotic actions. However, adapting VLMs for robotic domains comes…

Robotics · Computer Science 2025-09-30 Rokas Bendikas , Daniel Dijkman , Markus Peschl , Sanjay Haresh , Pietro Mazzaglia

Despite recent advances in 3D human motion generation (MoGen) on standard benchmarks, existing text-to-motion models still face a fundamental bottleneck in their generalization capability. In contrast, adjacent generative fields, most…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Jing Lin , Ruisi Wang , Junzhe Lu , Ziqi Huang , Guorui Song , Ailing Zeng , Xian Liu , Chen Wei , Wanqi Yin , Qingping Sun , Zhongang Cai , Lei Yang , Ziwei Liu

In this work, we are dedicated to a new task, i.e., hand-object interaction image generation, which aims to conditionally generate the hand-object image under the given hand, object and their interaction status. This task is challenging and…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Hezhen Hu , Weilun Wang , Wengang Zhou , Houqiang Li