English
Related papers

Related papers: Language-Informed Hyperspectral Image Synthesis fo…

200 papers

Federated learning is a machine learning paradigm that enables decentralized clients to collaboratively learn a shared model while keeping all the training data local. While considerable research has focused on federated image generation,…

Machine Learning · Computer Science 2025-05-06 Chen Hu , Hanchi Ren , Jingjing Deng , Xianghua Xie , Xiaoke Ma

In hyperspectral remote sensing field, some downstream dense prediction tasks, such as semantic segmentation (SS) and change detection (CD), rely on supervised learning to improve model performance and require a large amount of manually…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Wendi Liu , Pei Yang , Wenhui Hong , Xiaoguang Mei , Jiayi Ma

We investigate the problem of producing diverse solutions to an image super-resolution problem. From a probabilistic perspective, this can be done by sampling from the posterior distribution of an inverse problem, which requires the…

Computer Vision and Pattern Recognition · Computer Science 2024-01-10 Jean Prost , Antoine Houdard , Andrés Almansa , Nicolas Papadakis

Learning from an imbalanced distribution presents a major challenge in predictive modeling, as it generally leads to a reduction in the performance of standard algorithms. Various approaches exist to address this issue, but many of them…

Machine Learning · Computer Science 2024-12-11 Samuel Stocksieker , Denys Pommeret , Arthur Charpentier

Accurate and robust medical image classification is a challenging task, especially in application domains where available annotated datasets are small and present high imbalance between target classes. Considering that data acquisition is…

Computer Vision and Pattern Recognition · Computer Science 2024-10-02 Neil De La Fuente , Mireia Majó , Irina Luzko , Henry Córdova , Gloria Fernández-Esparrach , Jorge Bernal

While hierarchical variational autoencoders (VAEs) have achieved great density estimation on image modeling tasks, samples from their prior tend to look less convincing than models with similar log-likelihood. We attribute this to learned…

Machine Learning · Computer Science 2022-10-20 Eric Luhman , Troy Luhman

The Variational Auto-Encoder (VAE) is one of the most used unsupervised machine learning models. But although the default choice of a Gaussian distribution for both the prior and posterior represents a mathematically convenient distribution…

Machine Learning · Statistics 2022-09-28 Tim R. Davidson , Luca Falorsi , Nicola De Cao , Thomas Kipf , Jakub M. Tomczak

Weakly-supervised semantic segmentation (WSSS), which aims to train segmentation models solely using image-level labels, has achieved significant attention. Existing methods primarily focus on generating high-quality pseudo labels using…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Wangyu Wu , Tianhong Dai , Xiaowei Huang , Fei Ma , Jimin Xiao

By decomposing the image formation process into a sequential application of denoising autoencoders, diffusion models (DMs) achieve state-of-the-art synthesis results on image data and beyond. Additionally, their formulation allows for a…

Computer Vision and Pattern Recognition · Computer Science 2022-04-14 Robin Rombach , Andreas Blattmann , Dominik Lorenz , Patrick Esser , Björn Ommer

Variational autoencoders (VAE) encode data into lower-dimensional latent vectors before decoding those vectors back to data. Once trained, one can hope to detect out-of-distribution (abnormal) latent vectors, but several issues arise when…

Machine Learning · Computer Science 2026-05-12 Alejandro Ascarate , Leo Lebrat , Rodrigo Santa Cruz , Clinton Fookes , Olivier Salvado

The variational autoencoder (VAE) is a simple and efficient generative artificial intelligence method for modeling complex probability distributions of various types of data, such as images and texts. However, it suffers some main…

Machine Learning · Computer Science 2025-02-14 Xi Chen , Shaofan Li

Diffusion models have recently received a surge of interest due to their impressive performance for image restoration, especially in terms of noise robustness. However, existing diffusion-based methods are trained on a large amount of…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Yuchun Miao , Lefei Zhang , Liangpei Zhang , Dacheng Tao

Variation Autoencoder (VAE) has become a powerful tool in modeling the non-linear generative process of data from a low-dimensional latent space. Recently, several studies have proposed to use VAE for unsupervised clustering by using…

Machine Learning · Computer Science 2021-06-29 Qingyu Zhao , Nicolas Honnorat , Ehsan Adeli , Kilian M. Pohl

Generating realistic 3D Human-Human Interaction (HHI) requires coherent modeling of the physical plausibility of the agents and their interaction semantics. Existing methods compress all motion information into a single latent…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Zichen Geng , Zeeshan Hayder , Bo Miao , Jian Liu , Wei Liu , Ajmal Mian

Diffusion models are widely recognized for their ability to generate high-fidelity images. Despite the excellent performance and scalability of the Diffusion Transformer (DiT) architecture, it applies fixed compression across different…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Weinan Jia , Mengqi Huang , Nan Chen , Lei Zhang , Zhendong Mao

Spatio-temporal compression of videos, utilizing networks such as Variational Autoencoders (VAE), plays a crucial role in OpenAI's SORA and numerous other video generative models. For instance, many LLM-like video models learn the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Sijie Zhao , Yong Zhang , Xiaodong Cun , Shaoshu Yang , Muyao Niu , Xiaoyu Li , Wenbo Hu , Ying Shan

Image encoders, a fundamental component of vision-language models (VLMs), are typically pretrained independently before being aligned with a language model. This standard paradigm results in encoders that process images agnostically,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Raghuveer Thirukovalluru , Xiaochuang Han , Bhuwan Dhingra , Emily Dinan , Maha Elbayad

We present Qwen-Image-VAE-2.0, a suite of high-compression Variational Autoencoders (VAEs) that achieve significant advances in both reconstruction fidelity and diffusability. To address the reconstruction bottlenecks of high compression,…

Semantic image synthesis is a process for generating photorealistic images from a single semantic mask. To enrich the diversity of multimodal image synthesis, previous methods have controlled the global appearance of an output image by…

Computer Vision and Pattern Recognition · Computer Science 2021-06-30 Yuki Endo , Yoshihiro Kanamori

Latent generative models have emerged as a leading approach for high-quality image synthesis. These models rely on an autoencoder to compress images into a latent space, followed by a generative model to learn the latent distribution. We…

Machine Learning · Computer Science 2025-08-05 Theodoros Kouzelis , Ioannis Kakogeorgiou , Spyros Gidaris , Nikos Komodakis