English
Related papers

Related papers: Memorized action chunking with Transformers: Imita…

200 papers

We propose a self-supervised spatio-temporal matching method, coined Motion-Aware Mask Propagation (MAMP), for video object segmentation. MAMP leverages the frame reconstruction task for training without the need for annotations. During…

Computer Vision and Pattern Recognition · Computer Science 2021-10-29 Bo Miao , Mohammed Bennamoun , Yongsheng Gao , Ajmal Mian

We study the problem of human action recognition using motion capture (MoCap) sequences. Unlike existing techniques that take multiple manual steps to derive standardized skeleton representations as model input, we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Xiaoyu Zhu , Po-Yao Huang , Junwei Liang , Celso M. de Melo , Alexander Hauptmann

Noninvasive optical imaging modalities can probe patient's tissue in 3D and over time generate gigabytes of clinically relevant data per sample. There is a need for AI models to analyze this data and assist clinical workflow. The lack of…

We present cross-view transformers, an efficient attention-based model for map-view semantic segmentation from multiple cameras. Our architecture implicitly learns a mapping from individual camera views into a canonical map-view…

Computer Vision and Pattern Recognition · Computer Science 2022-05-06 Brady Zhou , Philipp Krähenbühl

As the deep learning revolution marches on, masked modeling has emerged as a distinctive approach that involves predicting parts of the original data that are proportionally masked during training, and has demonstrated exceptional…

Image and Video Processing · Electrical Eng. & Systems 2025-06-25 Qinrong Cai , Yu Guan , Zhibo Chen , Dong Liang , Qiuyun Fan , Qiegen Liu

Bimanual manipulation presents unique challenges compared to unimanual tasks due to the complexity of coordinating two robotic arms. In this paper, we introduce InterACT: Inter-dependency aware Action Chunking with Hierarchical Attention…

Robotics · Computer Science 2024-10-17 Andrew Lee , Ian Chuang , Ling-Yuan Chen , Iman Soltani

Detection of tumors in metastatic colorectal cancer (mCRC) plays an essential role in the early diagnosis and treatment of liver cancer. Deep learning models backboned by fully convolutional neural networks (FCNNs) have become the dominant…

Image and Video Processing · Electrical Eng. & Systems 2023-09-01 Ramtin Mojtahedi , Mohammad Hamghalam , Richard K. G. Do , Amber L. Simpson

Image matting aims to predict alpha values of elaborate uncertainty areas of natural images, like hairs, smoke, and spider web. However, existing methods perform poorly when faced with highly transparent foreground objects due to the large…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Huanqia Cai , Fanglei Xue , Lele Xu , Lili Guo

Intraoperative ultrasound facilitates localisation of tumour boundaries during minimally invasive procedures. Autonomous ultrasound scanning systems have been recently proposed to improve scanning accuracy and reduce surgeons' cognitive…

Robotics · Computer Science 2018-03-19 Lin Zhang , Menglong Ye , Stamatia Giannarou , Philip Pratt , Guang-Zhong Yang

Efficient and fast reconstruction of anatomical structures plays a crucial role in clinical practice. Minimizing retrieval and processing times not only potentially enhances swift response and decision-making in critical scenarios but also…

Fine manipulation tasks, such as threading cable ties or slotting a battery, are notoriously difficult for robots because they require precision, careful coordination of contact forces, and closed-loop visual feedback. Performing these…

Robotics · Computer Science 2023-04-27 Tony Z. Zhao , Vikash Kumar , Sergey Levine , Chelsea Finn

Quantitative photoacoustic computed tomography (qPACT) is a promising imaging modality for estimating physiological parameters such as blood oxygen saturation. However, developing robust qPACT reconstruction methods remains challenging due…

Medical Physics · Physics 2025-10-07 Refik Mert Cam , Seonyeong Park , Umberto Villa , Mark A. Anastasio

Accurate segmentation of aortic vascular structures is critical for diagnosing and treating cardiovascular diseases.Traditional Transformer-based models have shown promise in this domain by capturing long-range dependencies between vascular…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Zhenxi Zhang , Fuchen Zheng , Adnan Iltaf , Yifei Han , Zhenyu Cheng , Yue Du , Bin Li , Tianyong Liu , Shoujun Zhou

Recent state-of-the-art performances of Vision Transformers (ViT) in computer vision tasks demonstrate that a general-purpose architecture, which implements long-range self-attention, could replace the local feature learning operations of…

Early detection and classifying brain tumors using Magnetic Resonance Imaging (MRI) images is highly important but difficult to extract in medical images. Convolutional Neural Networks (CNNs) are good at capturing both local texture and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Syed Ibad Hasnain , Muhammad Faris , Hafiza Syeda Yusra Tirmizi , Rabail Khowaja , Hafsa Israr

Convolutional networks (ConvNets) have achieved promising accuracy for various anatomical segmentation tasks. Despite the success, these methods can be sensitive to data appearance variations. Considering the large variability of scans…

Computer Vision and Pattern Recognition · Computer Science 2021-02-03 Yuan Liang , Weinan Song , Jiawei Yang , Liang Qiu , Kun Wang , Lei He

Brain tumor segmentation remains a significant challenge, particularly in the context of multi-modal magnetic resonance imaging (MRI) where missing modality images are common in clinical settings, leading to reduced segmentation accuracy.…

Image and Video Processing · Electrical Eng. & Systems 2024-06-14 Zhongao Sun , Jiameng Li , Yuhan Wang , Jiarong Cheng , Qing Zhou , Chun Li

Magnetic Resonance Imaging (MRI) plays a vital role in diagnosis, management and monitoring of many diseases. However, it is an inherently slow imaging technique. Over the last 20 years, parallel imaging, temporal encoding and compressed…

Deep learning object detection algorithm has been widely used in medical image analysis. Currently all the object detection tasks are based on the data annotated with object classes and their bounding boxes. On the other hand, medical…

Computer Vision and Pattern Recognition · Computer Science 2020-03-04 Li Xiao , Cheng Zhu , Junjun Liu , Chunlong Luo , Peifang Liu , Yi Zhao

In 3D human action recognition, limited supervised data makes it challenging to fully tap into the modeling potential of powerful networks such as transformers. As a result, researchers have been actively investigating effective…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Yunyao Mao , Jiajun Deng , Wengang Zhou , Yao Fang , Wanli Ouyang , Houqiang Li