English
Related papers

Related papers: HDiffTG: A Lightweight Hybrid Diffusion-Transforme…

200 papers

Transformer architectures have become the model of choice in natural language processing and are now being introduced into computer vision tasks such as image classification, object detection, and semantic segmentation. However, in the…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Ce Zheng , Sijie Zhu , Matias Mendieta , Taojiannan Yang , Chen Chen , Zhengming Ding

We introduce (HPS) Human POSEitioning System, a method to recover the full 3D pose of a human registered with a 3D scan of the surrounding environment using wearable sensors. Using IMUs attached at the body limbs and a head mounted camera…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Vladimir Guzov , Aymen Mir , Torsten Sattler , Gerard Pons-Moll

Recent methods using diffusion models have made significant progress in human image generation with various control signals such as pose priors. However, existing efforts are still struggling to generate high-quality images with consistent…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Xiangchen Yin , Donglin Di , Lei Fan , Hao Li , Wei Chen , Xiaofei Gou , Yang Song , Xiao Sun , Xun Yang

Recently, 3D vision-based diffusion policies have shown strong capability in learning complex robotic manipulation skills. However, a common architectural mismatch exists in these models: a tiny yet efficient point-cloud encoder is often…

Robotics · Computer Science 2026-02-02 Jinhao Zhang , Zhexuan Zhou , Huizhe Li , Yichen Lai , Wenlong Xia , Haoming Song , Youmin Gong , Jie Mei

We propose a human pose estimation framework that solves the task in the regression-based fashion. Unlike previous regression-based methods, which often fall behind those state-of-the-art methods, we formulate the pose estimation task into…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Weian Mao , Yongtao Ge , Chunhua Shen , Zhi Tian , Xinlong Wang , Zhibin Wang

Estimation of 3D human pose from monocular image has gained considerable attention, as a key step to several human-centric applications. However, generalizability of human pose estimation models developed using supervision on large-scale…

Computer Vision and Pattern Recognition · Computer Science 2020-06-26 Jogendra Nath Kundu , Siddharth Seth , Rahul M , Mugalodi Rakesh , R. Venkatesh Babu , Anirban Chakraborty

Recent advances in diffusion transformers (DiTs) have set new standards in image generation, yet remain impractical for on-device deployment due to their high computational and memory costs. In this work, we present an efficient DiT…

3D pose estimation is a challenging problem in computer vision. Most of the existing neural-network-based approaches address color or depth images through convolution networks (CNNs). In this paper, we study the task of 3D human pose…

Computer Vision and Pattern Recognition · Computer Science 2022-12-27 Yufan Zhou , Haiwei Dong , Abdulmotaleb El Saddik

The integration of Diffusion Models into Intelligent Transportation Systems (ITS) is a substantial improvement in the detection of accidents. We present a novel hybrid model integrating guidance classification with diffusion techniques. By…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Siva Sai , Saksham Gupta , Vinay Chamola , Rajkumar Buyya

Medical image classification has developed rapidly under the impetus of the convolutional neural network (CNN). Due to the fixed size of the receptive field of the convolution kernel, it is difficult to capture the global features of…

Image and Video Processing · Electrical Eng. & Systems 2022-09-22 Xiangzuo Huo , Gang Sun , Shengwei Tian , Yan Wang , Long Yu , Jun Long , Wendong Zhang , Aolun Li

Real-time 6D object pose estimation is essential for many real-world applications, such as robotic grasping and augmented reality. To achieve an accurate object pose estimation from RGB images in real-time, we propose an effective and…

Computer Vision and Pattern Recognition · Computer Science 2022-04-21 Qi Guan , Zihao Sheng , Shibei Xue

Achieving high-quality High Dynamic Range (HDR) imaging on resource-constrained edge devices is a critical challenge in computer vision, as its performance directly impacts downstream tasks such as intelligent surveillance and autonomous…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Yu-Shen Huang , Tzu-Han Chen , Cheng-Yen Hsiao , Shaou-Gang Miaou

The pose-guided person image generation task requires synthesizing photorealistic images of humans in arbitrary poses. The existing approaches use generative adversarial networks that do not necessarily maintain realistic textures or need…

Computer Vision and Pattern Recognition · Computer Science 2023-03-02 Ankan Kumar Bhunia , Salman Khan , Hisham Cholakkal , Rao Muhammad Anwer , Jorma Laaksonen , Mubarak Shah , Fahad Shahbaz Khan

We present MoVNect, a lightweight deep neural network to capture 3D human pose using a single RGB camera. To improve the overall performance of the model, we apply the teacher-student learning method based knowledge distillation to 3D human…

Computer Vision and Pattern Recognition · Computer Science 2020-01-16 Dong-Hyun Hwang , Suntae Kim , Nicolas Monet , Hideki Koike , Soonmin Bae

In this work, we present SupResDiffGAN, a novel hybrid architecture that combines the strengths of Generative Adversarial Networks (GANs) and diffusion models for super-resolution tasks. By leveraging latent space representations and…

Image and Video Processing · Electrical Eng. & Systems 2025-04-21 Dawid Kopeć , Wojciech Kozłowski , Maciej Wizerkaniuk , Dawid Krutul , Jan Kocoń , Maciej Zięba

This paper introduces a novel approach to monocular 3D human pose estimation using contextualized representation learning with the Transformer-GCN dual-stream model. Monocular 3D human pose estimation is challenged by depth ambiguity,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Mingrui Ye , Lianping Yang , Hegui Zhu , Zenghao Zheng , Xin Wang , Yantao Lo

In recent years, diffusion models have demonstrated remarkable success in high-fidelity image synthesis. However, fine-tuning these models for specialized domains, such as medical imaging, remains challenging due to limited domain-specific…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Ruchir Namjoshi , Nagasai Thadishetty , Vignesh Kumar , Hemanth Venkateshwara

We present PoseDiff, a conditional diffusion model that unifies robot state estimation and control within a single framework. At its core, PoseDiff maps raw visual observations into structured robot states-such as 3D keypoints or joint…

Robotics · Computer Science 2025-11-03 Haozhuo Zhang , Michele Caprio , Jing Shao , Qiang Zhang , Jian Tang , Shanghang Zhang , Wei Pan

Recent work has showcased the significant potential of diffusion models in pose-guided person image synthesis. However, owing to the inconsistency in pose between the source and target images, synthesizing an image with a distinct pose,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-22 Fei Shen , Hu Ye , Jun Zhang , Cong Wang , Xiao Han , Wei Yang

The task of 2D human pose estimation is challenging as the number of keypoints is typically large (~ 17) and this necessitates the use of robust neural network architectures and training pipelines that can capture the relevant features from…

Machine Learning · Computer Science 2022-04-22 Kaushik Balakrishnan , Devesh Upadhyay