English
Related papers

Related papers: Learning Temporal Coherence via Self-Supervision f…

200 papers

Drawing inspiration from the achievements of natural language processing, we adopt self-supervised learning and utilize an equivariant graph neural network to develop a unified platform designed for training generative models capable of…

Materials Science · Physics 2024-08-21 Fangze Liu , Zhantao Chen , Tianyi Liu , Ruyi Song , Yu Lin , Joshua J. Turner , Chunjing Jia

From ecology to atmospheric sciences, many academic disciplines deal with data characterized by intricate spatio-temporal complexities, the modeling of which often requires specialized approaches. Generative models of these data are of…

Machine Learning · Computer Science 2021-10-01 Konstantin Klemmer , Tianlin Xu , Beatrice Acciaio , Daniel B. Neill

We explore whether useful temporal neural generative models can be learned from sequential data without back-propagation through time. We investigate the viability of a more neurocognitively-grounded approach in the context of unsupervised…

Machine Learning · Computer Science 2017-12-01 Alexander G. Ororbia , Patrick Haffner , David Reitter , C. Lee Giles

Recent self-supervision methods have found success in learning feature representations that could rival ones from full supervision, and have been shown to be beneficial to the model in several ways: for example improving models robustness…

Computer Vision and Pattern Recognition · Computer Science 2021-12-09 Michal Kucer , Diane Oyen , Garrett Kenyon

Generative adversarial networks (GANs) often suffer from unpredictable mode-collapsing during training. We study the issue of mode collapse of Boundary Equilibrium Generative Adversarial Network (BEGAN), which is one of the state-of-the-art…

Machine Learning · Computer Science 2018-08-23 Chia-Che Chang , Chieh Hubert Lin , Che-Rung Lee , Da-Cheng Juan , Wei Wei , Hwann-Tzong Chen

Video representation learning has been successful in video-text pre-training for zero-shot transfer, where each sentence is trained to be close to the paired video clips in a common feature space. For long videos, given a paragraph of…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Yuncong Yang , Jiawei Ma , Shiyuan Huang , Long Chen , Xudong Lin , Guangxing Han , Shih-Fu Chang

This paper proposes to learn reliable dense correspondence from videos in a self-supervised manner. Our learning process integrates two highly related tasks: tracking large image regions \emph{and} establishing fine-grained pixel-level…

Computer Vision and Pattern Recognition · Computer Science 2019-09-27 Xueting Li , Sifei Liu , Shalini De Mello , Xiaolong Wang , Jan Kautz , Ming-Hsuan Yang

Video generation has seen remarkable progress thanks to advancements in generative deep learning. However, generating long sequences remains a significant challenge. Generated videos should not only display coherent and continuous movement…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Jingbo Yang , Adrian G. Bors

We address the problem of video representation learning without human-annotated labels. While previous efforts address the problem by designing novel self-supervised tasks using video data, the learned features are merely on a…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Jiangliu Wang , Jianbo Jiao , Linchao Bao , Shengfeng He , Yunhui Liu , Wei Liu

Deep learning has become a standard approach for the modeling of audio effects, yet strictly black-box modeling remains problematic for time-varying systems. Unlike time-invariant effects, training models on devices with internal modulation…

Sound · Computer Science 2025-12-18 Yann Bourdin , Pierrick Legrand , Fanny Roche

Deep Neural Networks have recently demonstrated promising performance in binary change detection (CD) problems in remote sensing (RS), requiring a large amount of labeled multitemporal training samples. Since collecting such data is…

Image and Video Processing · Electrical Eng. & Systems 2020-07-08 Jose Luis Holgado Alvarez , Mahdyar Ravanbakhsh , Begüm Demir

Video classification is a challenging task in computer vision. Although Deep Neural Networks (DNNs) have achieved excellent performance in video classification, recent research shows adding imperceptible perturbations to clean videos can…

Machine Learning · Computer Science 2019-09-12 Xiaojun Jia , Xingxing Wei , Xiaochun Cao

Most of the existing works in video synthesis focus on generating videos using adversarial learning. Despite their success, these methods often require input reference frame or fail to generate diverse videos from the given data…

Image and Video Processing · Electrical Eng. & Systems 2020-04-21 Abhishek Aich , Akash Gupta , Rameswar Panda , Rakib Hyder , M. Salman Asif , Amit K. Roy-Chowdhury

Time series synthesis is an effective approach to ensuring the secure circulation of time series data. Existing time series synthesis methods typically perform temporal modeling based on random sequences to generate target sequences, which…

Machine Learning · Computer Science 2025-09-01 Xuan Hou , Shuhan Liu , Zhaohui Peng , Yaohui Chu , Yue Zhang , Yining Wang

This work introduces a novel system for the generation of images that contain multiple classes of objects. Recent work in Generative Adversarial Networks have produced high quality images, but many focus on generating images of a single…

Machine Learning · Computer Science 2019-11-11 Elijah D. Bolluyt , Cristina Comaniciu

Dynamic texture synthesis aims to generate sequences that are visually similar to a reference video texture and exhibit specific stationary properties in time. In this paper, we introduce a spatiotemporal generative adversarial network…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Xiangtian Li , Xiaobo Wang , Zhen Qi , Han Cao , Zhaoyang Zhang , Ao Xiang

Generative adversarial networks (GANs) studies have grown exponentially in the past few years. Their impact has been seen mainly in the computer vision field with realistic image and video manipulation, especially generation, making…

Machine Learning · Computer Science 2021-07-26 Eoin Brophy , Zhengwei Wang , Qi She , Tomas Ward

The two underlying requirements of face age progression, i.e. aging accuracy and identity permanence, are not well studied in the literature. This paper presents a novel generative adversarial network based approach to address the issues in…

Computer Vision and Pattern Recognition · Computer Science 2019-01-23 Hongyu Yang , Di Huang , Yunhong Wang , Anil K. Jain

The goal of unsupervised image-to-image translation is to map images from one domain to another without the ground truth correspondence between the two domains. State-of-art methods learn the correspondence using large numbers of unpaired…

Computer Vision and Pattern Recognition · Computer Science 2019-08-06 Dina Bashkirova , Ben Usman , Kate Saenko

Generative models make huge progress to the photorealistic image synthesis in recent years. To enable human to steer the image generation process and customize the output, many works explore the interpretable dimensions of the latent space…

Computer Vision and Pattern Recognition · Computer Science 2024-01-11 Jianyuan Wang , Lalit Bhagat , Ceyuan Yang , Yinghao Xu , Yujun Shen , Hongdong Li , Bolei Zhou