English
Related papers

Related papers: Sign-IDD: Iconicity Disentangled Diffusion for Sig…

200 papers

Recent advances in Talking Head Generation (THG) have achieved impressive lip synchronization and visual quality through diffusion models; yet existing methods struggle to generate emotionally expressive portraits while preserving speaker…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Weipeng Tan , Chuming Lin , Chengming Xu , FeiFan Xu , Xiaobin Hu , Xiaozhong Ji , Junwei Zhu , Chengjie Wang , Yanwei Fu

Building upon recent structural disentanglement frameworks for sign language production, we propose A$^{2}$V-SLP, an alignment-aware variational framework that learns articulator-wise disentangled latent distributions rather than…

Machine Learning · Computer Science 2026-02-13 Sümeyye Meryem Taşyürek , Enis Mücahid İskender , Hacer Yalim Keles

Multi-modal stance detection (MSD) aims to determine an author's stance toward a given target using both textual and visual content. While recent methods leverage multi-modal fusion and prompt-based learning, most fail to distinguish…

Multimedia · Computer Science 2026-01-30 Zhiyu Xie , Fuqiang Niu , Genan Dai , Qianlong Wang , Li Dong , Bowen Zhang , Hu Huang

Although a significant progress has been witnessed in supervised person re-identification (re-id), it remains challenging to generalize re-id models to new domains due to the huge domain gaps. Recently, there has been a growing interest in…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Yang Zou , Xiaodong Yang , Zhiding Yu , B. V. K. Vijaya Kumar , Jan Kautz

Text-to-image diffusion models have made significant progress in generating naturalistic images from textual inputs, and demonstrate the capacity to learn and represent complex visual-semantic relationships. While these diffusion models…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Rushikesh Zawar , Shaurya Dewan , Prakanshul Saxena , Yingshan Chang , Andrew Luo , Yonatan Bisk

Domain generalization aims to enhance model robustness against unseen domains with embedding distribution shifts. While large-scale vision-language models like CLIP exhibit strong generalization, their direct image-text embedding alignment…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Kai Gan , Tong Wei

Instruction-guided image editing enables users to specify modifications using natural language, offering more flexibility and control. Among existing frameworks, Diffusion Transformers (DiTs) outperform U-Net-based diffusion models in…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Hui Liu , Bin Zou , Suiyun Zhang , Kecheng Chen , Rui Liu , Haoliang Li

We introduce the hfut-lmc team's solution to the SLRTP Sign Production Challenge. The challenge aims to generate semantically aligned sign language pose sequences from text inputs. To this end, we propose a Text-driven Diffusion Model (TDM)…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Jiayi He , Xu Wang , Ruobei Zhang , Shengeng Tang , Yaxiong Wang , Lechao Cheng

Generating consistent and high-quality images from given texts is essential for visual-language understanding. Although impressive results have been achieved in generating high-quality images, text-image consistency is still a major concern…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Zhaorui Tan , Xi Yang , Zihan Ye , Qiufeng Wang , Yuyao Yan , Anh Nguyen , Kaizhu Huang

Diffusion models have become the mainstream architecture for text-to-image generation, achieving remarkable progress in visual quality and prompt controllability. However, current inference pipelines generally lack interpretable semantic…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Zheqi Lv , Junhao Chen , Qi Tian , Keting Yin , Shengyu Zhang , Fei Wu

Although lip-to-speech synthesis (L2S) has achieved significant progress in recent years, current state-of-the-art methods typically rely on intermediate representations such as mel-spectrograms or discrete self-supervised learning (SSL)…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-13 Yifan Liang , Andong Li , Kang Yang , Guochen Yu , Fangkun Liu , Lingling Dai , Xiaodong Li , Chengshi Zheng

Despite progress in gloss-free Sign Language Translation (SLT), traditional single modality end-to-end approaches consistently fail on two critical components of natural signing: the precise recognition of high-speed fingerspelling and the…

Computation and Language · Computer Science 2025-12-05 Marshall Thomas , Edward Fish , Richard Bowden

Projecting the point cloud on the 2D spherical range image transforms the LiDAR semantic segmentation to a 2D segmentation task on the range image. However, the LiDAR range image is still naturally different from the regular 2D RGB image;…

Computer Vision and Pattern Recognition · Computer Science 2021-09-09 Yiming Zhao , Lin Bai , Xinming Huang

Face swapping aims to optimize realistic facial image generation by leveraging the identity of a source face onto a target face while preserving pose, expression, and context. However, existing methods, especially GAN-based methods, often…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Md Shohel Rana , Tanoy Debnath

Recently, diffusion-based methods for monocular 3D human pose estimation have achieved state-of-the-art (SOTA) performance by directly regressing the 3D joint coordinates from the 2D pose sequence. Although some methods decompose the task…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Qingyuan Cai , Xuecai Hu , Saihui Hou , Li Yao , Yongzhen Huang

Generative recommendation models employing Semantic IDs (SIDs) exhibit strong potential, yet their practical deployment is bottlenecked by the high inference latency of beam-expanded autoregressive decoding. In this work, we identify that…

Information Retrieval · Computer Science 2026-05-14 Zitian Guo , Yupeng Hou , Clark Mingxuan Ju , Neil Shah , Julian McAuley

Existing Score Distillation Sampling (SDS)-based methods have driven significant progress in text-to-3D generation. However, 3D models produced by SDS-based methods tend to exhibit over-smoothing and low-quality outputs. These issues arise…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Uy Dieu Tran , Minh Luu , Phong Ha Nguyen , Khoi Nguyen , Binh-Son Hua

Graphic design visually conveys information and data by creating and combining text, images and graphics. Two-stage methods that rely primarily on layout generation lack creativity and intelligence, making graphic design still…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Yadong Qu , Shancheng Fang , Yuxin Wang , Xiaorui Wang , Zhineng Chen , Hongtao Xie , Yongdong Zhang

Multimodal editing large models have demonstrated powerful editing capabilities across diverse tasks. However, a persistent and long-standing limitation is the decline in facial identity (ID) consistency during realistic portrait editing.…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Yuran Dong , Hang Dai , Mang Ye

Sign Language Production (SLP) is a challenging task, given the limited resources available and the inherent diversity within sign data. As a result, previous works have suffered from the problem of regression to the mean, leading to…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Harry Walsh , Ben Saunders , Richard Bowden