English
Related papers

Related papers: MEAT: Multiview Diffusion Model for Human Generati…

200 papers

Estimating human pose and shape from monocular images is a long-standing problem in computer vision. Since the release of statistical body models, 3D human mesh recovery has been drawing broader attention. With the same goal of obtaining…

Computer Vision and Pattern Recognition · Computer Science 2024-01-03 Yating Tian , Hongwen Zhang , Yebin Liu , Limin Wang

3D human mesh recovery from monocular RGB images aims to estimate anatomically plausible 3D human models for downstream applications, but remains challenging under partial or severe occlusions. Regression-based methods are efficient yet…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Yang Liu , Zhiyong Zhang

Diffusion models usher a new era of video editing, flexibly manipulating the video contents with text prompts. Despite the widespread application demand in editing human-centered videos, these models face significant challenges in handling…

Computer Vision and Pattern Recognition · Computer Science 2024-08-15 Xiaojing Zhong , Xinyi Huang , Xiaofeng Yang , Guosheng Lin , Qingyao Wu

We address the task of multi-view image editing from sparse input views, where the inputs can be seen as a mix of images capturing the scene from different viewpoints. The goal is to modify the scene according to a textual instruction while…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Daniel Gilo , Or Litany

Numerous pose-guided human editing methods have been explored by the vision community due to their extensive practical applications. However, most of these methods still use an image-to-image formulation in which a single image is given as…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Rishabh Jain , Mayur Hemani , Duygu Ceylan , Krishna Kumar Singh , Jingwan Lu , Mausoom Sarkar , Balaji Krishnamurthy

Transformer-based diffusion models have recently superseded traditional U-Net architectures, with multimodal diffusion transformers (MM-DiT) emerging as the dominant approach in state-of-the-art models like Stable Diffusion 3 and Flux.1.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Joonghyuk Shin , Alchan Hwang , Yujin Kim , Daneul Kim , Jaesik Park

Video generation using diffusion models is highly computationally intensive, with 3D attention in Diffusion Transformer (DiT) models accounting for over 80\% of the total computational resources. In this work, we introduce {\bf RainFusion},…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Aiyue Chen , Bin Dong , Jingru Li , Jing Lin , Kun Tian , Yiwu Yao , Gongyi Wang

We present an approach to generate a 360-degree view of a person with a consistent, high-resolution appearance from a single input image. NeRF and its variants typically require videos or images from different viewpoints. Most existing…

Computer Vision and Pattern Recognition · Computer Science 2023-11-16 Badour AlBahar , Shunsuke Saito , Hung-Yu Tseng , Changil Kim , Johannes Kopf , Jia-Bin Huang

Recent advances in text-to-image generation with diffusion models present transformative capabilities in image quality. However, user controllability of the generated image, and fast adaptation to new tasks still remains an open challenge,…

Computer Vision and Pattern Recognition · Computer Science 2023-02-17 Omer Bar-Tal , Lior Yariv , Yaron Lipman , Tali Dekel

The recent success of pre-trained diffusion models unlocks the possibility of the automatic generation of textures for arbitrary 3D meshes in the wild. However, these models are trained in the screen space, while converting them to a…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Hongkun Zhang , Zherong Pan , Congyi Zhang , Lifeng Zhu , Xifeng Gao

In this work, we aim to predict human eye fixation with view-free scenes based on an end-to-end deep learning architecture. Although Convolutional Neural Networks (CNNs) have made substantial improvement on human attention prediction, it is…

Computer Vision and Pattern Recognition · Computer Science 2018-03-26 Wenguan Wang , Jianbing Shen

Recent deep learning-based multi-view people detection (MVD) methods have shown promising results on existing datasets. However, current methods are mainly trained and evaluated on small, single scenes with a limited number of multi-view…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Qi Zhang , Yunfei Gong , Daijie Chen , Antoni B. Chan , Hui Huang

Diffusion-based video editing have reached impressive quality and can transform either the global style, local structure, and attributes of given video inputs, following textual edit prompts. However, such solutions typically incur heavy…

Computer Vision and Pattern Recognition · Computer Science 2024-09-02 Kumara Kahatapitiya , Adil Karjauv , Davide Abati , Fatih Porikli , Yuki M. Asano , Amirhossein Habibian

Mesh is an important and powerful type of data for 3D shapes and widely studied in the field of computer vision and computer graphics. Regarding the task of 3D shape representation, there have been extensive research efforts concentrating…

Computer Vision and Pattern Recognition · Computer Science 2018-11-29 Yutong Feng , Yifan Feng , Haoxuan You , Xibin Zhao , Yue Gao

In the domain of 3D content creation, achieving optimal mesh topology through AI models has long been a pursuit for 3D artists. Previous methods, such as MeshGPT, have explored the generation of ready-to-use 3D objects via mesh…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Xianglong He , Junyi Chen , Di Huang , Zexiang Liu , Xiaoshui Huang , Wanli Ouyang , Chun Yuan , Yangguang Li

Diffusion models (DMs) embark a new era of generative modeling and offer more opportunities for efficient generating high-quality and realistic data samples. However, their widespread use has also brought forth new challenges in model…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Jingyao Xu , Yuetong Lu , Yandong Li , Siyang Lu , Dongdong Wang , Xiang Wei

Color plays an important role in human visual perception, reflecting the spectrum of objects. However, the existing infrared and visible image fusion methods rarely explore how to handle multi-spectral/channel data directly and achieve high…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Jun Yue , Leyuan Fang , Shaobo Xia , Yue Deng , Jiayi Ma

Image classification models have achieved satisfactory performance on many datasets, sometimes even better than human. However, The model attention is unclear since the lack of interpretability. This paper investigates the fidelity and…

Computer Vision and Pattern Recognition · Computer Science 2020-09-30 Wenjia Xu , Jiuniu Wang , Yang Wang , Guangluan Xu , Wei Dai , Yirong Wu

In image classification, a significant problem arises from bias in the datasets. When it contains only specific types of images, the classifier begins to rely on shortcuts - simplistic and erroneous rules for decision-making. This leads to…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Minsuk Chang , Seokhyeon Park , Hyeon Jeon , Aeri Cho , Soohyun Lee , Jinwook Seo

Multiview detection uses multiple calibrated cameras with overlapping fields of views to locate occluded pedestrians. In this field, existing methods typically adopt a ``human modeling - aggregation'' strategy. To find robust pedestrian…

Computer Vision and Pattern Recognition · Computer Science 2023-01-09 Jiahao Ma , Zicheng Duan , Liang Zheng , Chuong Nguyen