English
Related papers

Related papers: NSS-VAEs: Generative Scene Decomposition for Visua…

200 papers

Semantic segmentation and vision-based geolocalization in aerial images are challenging tasks in computer vision. Due to the advent of deep convolutional nets and the availability of relatively low cost UAVs, they are currently generating a…

Computer Vision and Pattern Recognition · Computer Science 2018-04-05 Alina Marcu , Dragos Costea , Emil Slusanschi , Marius Leordeanu

In this paper, we present a novel approach for training a Variational Autoencoder (VAE) on a highly imbalanced data set. The proposed training of a high-resolution VAE model begins with the training of a low-resolution core model, which can…

Computer Vision and Pattern Recognition · Computer Science 2019-12-19 Dmitry Utyamishev , Inna Partin-Vaisband

Semantic segmentation is a crucial step in many Earth observation tasks. Large quantity of pixel-level annotation is required to train deep networks for semantic segmentation. Earth observation techniques are applied to varieties of…

Computer Vision and Pattern Recognition · Computer Science 2021-08-11 Sudipan Saha , Lichao Mou , Muhammad Shahzad , Xiao Xiang Zhu

VAEs (Variational AutoEncoders) have proved to be powerful in the context of density modeling and have been used in a variety of contexts for creative purposes. In many settings, the data we model possesses continuous attributes that we…

Machine Learning · Computer Science 2017-07-18 Gaëtan Hadjeres , Frank Nielsen , François Pachet

Autonomous systems, such as self-driving cars, rely on reliable semantic environment perception for decision making. Despite great advances in video semantic segmentation, existing approaches ignore important inductive biases and lack…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Angel Villar-Corrales , Moritz Austermann , Sven Behnke

Traditional transformer-based semantic segmentation relies on quantized embeddings. However, our analysis reveals that autoencoder accuracy on segmentation mask using quantized embeddings (e.g. VQ-VAE) is 8% lower than continuous-valued…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Masud Ahmed , Zahid Hasan , Syed Arefinul Haque , Abu Zaher Md Faridee , Sanjay Purushotham , Suya You , Nirmalya Roy

Predicting the future is an important aspect for decision-making in robotics or autonomous driving systems, which heavily rely upon visual scene understanding. While prior work attempts to predict future video pixels, anticipate activities…

Computer Vision and Pattern Recognition · Computer Science 2019-12-13 Hsu-kuang Chiu , Ehsan Adeli , Juan Carlos Niebles

Vision Transformer (ViT) suffers from data scarcity in semi-supervised learning (SSL). To alleviate this issue, inspired by masked autoencoder (MAE), which is a data-efficient self-supervised learner, we propose Semi-MAE, a pure ViT-based…

Computer Vision and Pattern Recognition · Computer Science 2023-01-05 Haojie Yu , Kang Zhao , Xiaoming Xu

Syntactic information contains structures and rules about how text sentences are arranged. Incorporating syntax into text modeling methods can potentially benefit both representation learning and generation. Variational autoencoders (VAEs)…

Computation and Language · Computer Science 2019-08-28 Yijun Xiao , William Yang Wang

Approximating distributions over complicated manifolds, such as natural images, are conceptually attractive. The deep latent variable model, trained using variational autoencoders and generative adversarial networks, is now a key technique…

Computer Vision and Pattern Recognition · Computer Science 2019-10-08 Wenju Xu , Shawn Keshmiri , Guanghui Wang

Visual localization is of great importance in robotics and computer vision. Recently, scene coordinate regression based methods have shown good performance in visual localization in small static scenes. However, it still estimates camera…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Zhaoyang Huang , Han Zhou , Yijin Li , Bangbang Yang , Yan Xu , Xiaowei Zhou , Hujun Bao , Guofeng Zhang , Hongsheng Li

Recently, there has been an upsurge in the research on maritime vision, where a lot of works are influenced by the application of computer vision for Unmanned Surface Vehicles (USVs). Various sensor modalities such as camera, radar, and…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Linh Trinh , Ali Anwar , Siegfried Mercelis

Learning a robust video Variational Autoencoder (VAE) is essential for reducing video redundancy and facilitating efficient video generation. Directly applying image VAEs to individual frames in isolation can result in temporal…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Yazhou Xing , Yang Fei , Yingqing He , Jingye Chen , Jiaxin Xie , Xiaowei Chi , Qifeng Chen

Recently, a generative variational autoencoder (VAE) has been proposed for speech enhancement to model speech statistics. However, this approach only uses clean speech in the training phase, making the estimation particularly sensitive to…

Audio and Speech Processing · Electrical Eng. & Systems 2021-05-18 Huajian Fang , Guillaume Carbajal , Stefan Wermter , Timo Gerkmann

The integrative analysis of histopathological images and genomic data has received increasing attention for survival prediction of human cancers. However, the existing studies always hold the assumption that full modalities are available.…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Junjie Zhou , Jiao Tang , Yingli Zuo , Peng Wan , Daoqiang Zhang , Wei Shao

Semantic segmentation of satellite imagery is crucial for Earth observation applications, but remains constrained by limited labelled training data. While self-supervised pretraining methods like Masked Autoencoders (MAE) have shown…

Computer Vision and Pattern Recognition · Computer Science 2025-07-17 John Waithaka , Moise Busogi

Scene categorization is a useful precursor task that provides prior knowledge for many advanced computer vision tasks with a broad range of applications in content-based image indexing and retrieval systems. Despite the success of data…

Computer Vision and Pattern Recognition · Computer Science 2022-10-28 Saravanabalagi Ramachandran , Jonathan Horgan , Ganesh Sistu , John McDonald

Geostationary hyperspectral satellites generate terabytes of data daily, creating critical challenges for storage, transmission, and distribution to the scientific community. We present a variational autoencoder (VAE) approach that achieves…

Machine Learning · Computer Science 2025-11-25 Core Francisco Park , Manuel Perez-Carrasco , Caroline Nowlan , Cecilia Garraffo

Intelligent behaviour in the real-world requires the ability to acquire new knowledge from an ongoing sequence of experiences while preserving and reusing past knowledge. We propose a novel algorithm for unsupervised representation learning…

To improve the efficiency of surgical trajectory segmentation for robot learning in robot-assisted minimally invasive surgery, this paper presents a fast unsupervised method using video and kinematic data, followed by a promoting procedure…

Computer Vision and Pattern Recognition · Computer Science 2018-10-02 Zhenzhou Shao , Hongfa Zhao , Jiexin Xie , Ying Qu , Yong Guan , Jindong Tan