English
Related papers

Related papers: DMAT: A Dynamic Mask-Aware Transformer for Human D…

200 papers

Transformer models typically calculate attention matrices using dot products, which have limitations when capturing nonlinear relationships between embedding vectors. We propose Neural Attention, a technique that replaces dot products with…

Machine Learning · Computer Science 2025-11-10 Andrew DiGiugno , Ausif Mahmood

Instance-aware segmentation of unseen objects is essential for a robotic system in an unstructured environment. Although previous works achieved encouraging results, they were limited to segmenting the only visible regions of unseen…

Robotics · Computer Science 2022-03-01 Seunghyeok Back , Joosoon Lee , Taewon Kim , Sangjun Noh , Raeyoung Kang , Seongho Bak , Kyoobin Lee

With the rapid development of deep learning, object detection and tracking play a vital role in today's society. Being able to identify and track all the pedestrians in the dense crowd scene with computer vision approaches is a typical…

Computer Vision and Pattern Recognition · Computer Science 2023-11-01 Yu Zhang , Huaming Chen , Wei Bao , Zhongzheng Lai , Zao Zhang , Dong Yuan

Transformer-based object detectors often struggle with occlusions, fine-grained localization, and computational inefficiency caused by fixed queries and dense attention. We propose DAMM, Dual-stream Attention with Multi-Modal queries, a…

Computer Vision and Pattern Recognition · Computer Science 2025-08-08 Noreen Anwar , Guillaume-Alexandre Bilodeau , Wassim Bouachir

For a complete comprehension of multi-person scenes, it is essential to go beyond basic tasks like detection and tracking. Higher-level tasks, such as understanding the interactions and social activities among individuals, are also crucial.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Mahsa Ehsanpour , Ian Reid , Hamid Rezatofighi

Recent approaches to jointly reconstruct 3D humans and objects from a single RGB image represent 3D shapes with template-based or coarse models, which fail to capture details of loose clothing on human bodies. In this paper, we introduce a…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Ayushi Dutta , Marco Pesavento , Marco Volino , Adrian Hilton , Armin Mustafa

Occlusion is a long-standing problem in computer vision, particularly in instance segmentation. ACM MMSports 2023 DeepSportRadar has introduced a dataset that focuses on segmenting human subjects within a basketball context and a…

Computer Vision and Pattern Recognition · Computer Science 2023-11-22 Son Nguyen , Mikel Lainsa , Hung Dao , Daeyoung Kim , Giang Nguyen

Without relevant human priors, neural networks may learn uninterpretable features. We propose Dynamics of Attention for Focus Transition (DAFT) as a human prior for machine reasoning. DAFT is a novel method that regularizes attention-based…

Machine Learning · Statistics 2019-12-24 Wonjae Kim , Yoonho Lee

The extraction of keypoint positions from input hand frames, known as 3D hand pose estimation, is crucial for various human-computer interaction applications. However, current approaches often struggle with the dynamic nature of…

Computer Vision and Pattern Recognition · Computer Science 2024-07-31 Wencan Cheng , Eunji Kim , Jong Hwan Ko

Unwanted camera occlusions, such as debris, dust, rain-drops, and snow, can severely degrade the performance of computer-vision systems. Dynamic occlusions are particularly challenging because of the continuously changing pattern. Existing…

Computer Vision and Pattern Recognition · Computer Science 2023-08-02 Rong Zou , Manasi Muglikar , Nico Messikommer , Davide Scaramuzza

Compositing human figures into scene images has broad applications in areas such as entertainment and advertising. However, existing methods often cannot handle occlusion of the inserted person by foreground objects and unnaturally place…

Graphics · Computer Science 2025-05-08 Shun Masuda , Yuki Endo , Yoshihiro Kanamori

3D human pose estimation has wide applications in fields such as intelligent surveillance, motion capture, and virtual reality. However, in real-world scenarios, issues such as occlusion, noise interference, and missing viewpoints can…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Jianbin Jiao , Xina Cheng , Kailun Yang , Xiangrong Zhang , Licheng Jiao

Deep imitation learning is promising for solving dexterous manipulation tasks because it does not require an environment model and pre-programmed robot behavior. However, its application to dual-arm manipulation tasks remains challenging.…

Robotics · Computer Science 2025-05-23 Heecheol Kim , Yoshiyuki Ohmura , Yasuo Kuniyoshi

This study addresses the problem of dynamic anomaly detection in accounting transactions and proposes a real-time detection method based on a Transformer to tackle the challenges of hidden abnormal behaviors and high timeliness requirements…

Machine Learning · Computer Science 2025-11-18 Yi Wang , Ruoyi Fang , Anzhuo Xie , Hanrui Feng , Jianlin Lai

A key challenge with procedure planning in instructional videos lies in how to handle a large decision space consisting of a multitude of action types that belong to various tasks. To understand real-world video content, an AI agent must…

Computer Vision and Pattern Recognition · Computer Science 2023-09-15 Fen Fang , Yun Liu , Ali Koksal , Qianli Xu , Joo-Hwee Lim

Despite its success in image synthesis, we observe that diffusion probabilistic models (DPMs) often lack contextual reasoning ability to learn the relations among object parts in an image, leading to a slow learning process. To solve this…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Shanghua Gao , Pan Zhou , Ming-Ming Cheng , Shuicheng Yan

We present X-MDPT ($\underline{Cross}$-view $\underline{M}$asked $\underline{D}$iffusion $\underline{P}$rediction $\underline{T}$ransformers), a novel diffusion model designed for pose-guided human image generation. X-MDPT distinguishes…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Trung X. Pham , Zhang Kang , Chang D. Yoo

One of the common and promising deep learning approaches used for medical image segmentation is transformers, as they can capture long-range dependencies among the pixels by utilizing self-attention. Despite being successful in medical…

Computer Vision and Pattern Recognition · Computer Science 2023-11-01 Md Motiur Rahman , Shiva Shokouhmand , Smriti Bhatt , Miad Faezipour

Person re-identification (re-ID) under various occlusions has been a long-standing challenge as person images with different types of occlusions often suffer from misalignment in image matching and ranking. Most existing methods tackle this…

Computer Vision and Pattern Recognition · Computer Science 2021-07-07 Mengxi Jia , Xinhua Cheng , Shijian Lu , Jian Zhang

Recent advances in decentralized deep learning algorithms have demonstrated cutting-edge performance on various tasks with large pre-trained models. However, a pivotal prerequisite for achieving this level of competitiveness is the…

Machine Learning · Computer Science 2024-04-15 Nastaran Saadati , Minh Pham , Nasla Saleem , Joshua R. Waite , Aditya Balu , Zhanhong Jiang , Chinmay Hegde , Soumik Sarkar