English
Related papers

Related papers: Adversarially-Refined VQ-GAN with Dense Motion Tok…

200 papers

Discretization of semantic features enables interoperability between semantic and digital communication systems, showing significant potential for practical applications. The fundamental difficulty in digitizing semantic features stems from…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Jianqiao Chen , Tingting Zhu , Huishi Song , Nan Ma , Xiaodong Xu

The area of Video Camouflaged Object Detection (VCOD) presents unique challenges in the field of computer vision due to texture similarities between target objects and their surroundings, as well as irregular motion patterns caused by both…

Computer Vision and Pattern Recognition · Computer Science 2024-02-05 Zifan Yu , Erfan Bank Tavakoli , Meida Chen , Suya You , Raghuveer Rao , Sanjeev Agarwal , Fengbo Ren

The cryo-electron microscopy (Cryo-EM) becomes popular for macromolecular structure determination. However, the 2D images which Cryo-EM detects are of high noise and often mixed with multiple heterogeneous conformations or contamination,…

Image and Video Processing · Electrical Eng. & Systems 2022-02-22 Hanlin Gu , Yin Xian , Ilona Christy Unarta , Yuan Yao

The rapid evolution of generative adversarial networks (GANs) and diffusion models has made synthetic media increasingly realistic, raising societal concerns around misinformation, identity fraud, and digital trust. Existing deepfake…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Sales Aribe

Many modern ViT backbones adopt spatial architectural designs, such as window attention, decomposed relative positional embeddings in SAM, and RoPE in DINOv3. Such architectures impose new challenges on token reduction, as the vast majority…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Wenyi Gong , Mieszko Lis

Token compression expedites the training and inference of Vision Transformers (ViTs) by reducing the number of the redundant tokens, e.g., pruning inattentive tokens or merging similar tokens. However, when applied to downstream tasks,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-14 Shibo Jie , Yehui Tang , Jianyuan Guo , Zhi-Hong Deng , Kai Han , Yunhe Wang

Fine-grained image search is still a challenging problem due to the difficulty in capturing subtle differences regardless of pose variations of objects from fine-grained categories. In practice, a dynamic inventory with new fine-grained…

Computer Vision and Pattern Recognition · Computer Science 2018-07-09 Kevin Lin , Fan Yang , Qiaosong Wang , Robinson Piramuthu

Video tokenizers are essential for latent video diffusion models, converting raw video data into spatiotemporally compressed latent spaces for efficient training. However, extending state-of-the-art video tokenizers to achieve a temporal…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Aniruddha Mahapatra , Long Mai , David Bourgin , Yitian Zhang , Feng Liu

Fine-grained action detection is an important task with numerous applications in robotics and human-computer interaction. Existing methods typically utilize a two-stage approach including extraction of local spatio-temporal features…

Computer Vision and Pattern Recognition · Computer Science 2019-11-11 Khoi-Nguyen C. Mac , Dhiraj Joshi , Raymond A. Yeh , Jinjun Xiong , Rogerio S. Feris , Minh N. Do

Large-scale image datasets are fundamental to deep learning, but their high storage demands pose challenges for deployment in resource-constrained environments. While existing approaches reduce dataset size by discarding samples, they often…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Chenyue Yu , Lingao Xiao , Jinhong Deng , Ivor W. Tsang , Yang He

We introduce Kernel Density Discrimination GAN (KDD GAN), a novel method for generative adversarial learning. KDD GAN formulates the training as a likelihood ratio optimization problem where the data distributions are written explicitly via…

Machine Learning · Computer Science 2021-07-14 Abdelhak Lemkhenter , Adam Bielski , Alp Eren Sari , Paolo Favaro

Simulating interactions between deformable bodies is vital in fields like material science, mechanical design, and robotics. While learning-based methods with Graph Neural Networks (GNNs) are effective at solving complex physical systems,…

Machine Learning · Computer Science 2025-07-21 Hao Wang , Yu Liu , Daniel Biggs , Haoru Wang , Jiandong Yu , Ping Huang

Recent advances in generative modeling and tokenization have driven significant progress in text-to-motion generation, leading to enhanced quality and realism in generated motions. However, effectively leveraging textual information for…

Computer Vision and Pattern Recognition · Computer Science 2025-02-05 Che-Jui Chang , Qingze Tony Liu , Honglu Zhou , Vladimir Pavlovic , Mubbasir Kapadia

Learning descriptive spatio-temporal object models from data is paramount for the task of semi-supervised video object segmentation. Most existing approaches mainly rely on models that estimate the segmentation mask based on a reference…

Computer Vision and Pattern Recognition · Computer Science 2019-03-29 Sergi Caelles , Albert Pumarola , Francesc Moreno-Noguer , Alberto Sanfeliu , Luc Van Gool

Gesture-based authentication has emerged as a non-intrusive, effective means of authenticating users on mobile devices. Typically, such authentication techniques have relied on classical machine learning techniques, but recently, deep…

Cryptography and Security · Computer Science 2021-10-28 Elliu Huang , Fabio Di Troia , Mark Stamp

Learning-based methods have proven successful in compressing geometric information for point clouds. For attribute compression, however, they still lag behind non-learning-based methods such as the MPEG G-PCC standard. To bridge this gap,…

Image and Video Processing · Electrical Eng. & Systems 2024-07-22 Xiaolong Mao , Hui Yuan , Xin Lu , Raouf Hamzaoui , Wei Gao

Although CNN has reached satisfactory performance in image-related tasks, using CNN to process videos is much more challenging due to the enormous size of raw video streams. In this work, we propose to use motion vectors and residuals from…

Image and Video Processing · Electrical Eng. & Systems 2019-10-08 Haoyuan Cao , Shining Yu , Jiashi Feng

Manipulating latent code in generative adversarial networks (GANs) for facial image synthesis mainly focuses on continuous attribute synthesis (e.g., age, pose and emotion), while discrete attribute synthesis (like face mask and eyeglasses)…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Zhou Kangneng , Zhu Xiaobin , Gao Daiheng , Lee Kai , Li Xinjie , Yin Xu-Cheng

Given the three dimensional complexity of a video signal, training a robust and diverse GAN based video generative model is onerous due to large stochasticity involved in data space. Learning disentangled representations of the data help to…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Sai Hemanth Kasaraneni

Human motion modeling is a classic problem in computer vision and graphics. Challenges in modeling human motion include high dimensional prediction as well as extremely complicated dynamics.We present a novel approach to human motion…

Computer Vision and Pattern Recognition · Computer Science 2018-05-03 Chen Li , Zhen Zhang , Wee Sun Lee , Gim Hee Lee