English
Related papers

Related papers: Minuet: A Diffusion Autoencoder for Compact Semant…

200 papers

Latent diffusion models (LDMs) enable high-fidelity synthesis by operating in learned latent spaces. However, training state-of-the-art LDMs requires complex staging: a tokenizer must be trained first, before the diffusion model can be…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Shivam Duggal , Xingjian Bai , Zongze Wu , Richard Zhang , Eli Shechtman , Antonio Torralba , Phillip Isola , William T. Freeman

Latent diffusion models have emerged as the leading approach for generating high-quality images and videos, utilizing compressed latent representations to reduce the computational burden of the diffusion process. While recent advancements…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Ivan Skorokhodov , Sharath Girish , Benran Hu , Willi Menapace , Yanyu Li , Rameen Abdal , Sergey Tulyakov , Aliaksandr Siarohin

LIDAR semantic segmentation, which assigns a semantic label to each 3D point measured by the LIDAR, is becoming an essential task for many robotic applications such as autonomous driving. Fast and efficient semantic segmentation methods are…

Computer Vision and Pattern Recognition · Computer Science 2021-04-28 Iñigo Alonso , Luis Riazuelo , Luis Montesano , Ana C. Murillo

Accurate and fast scene understanding is one of the challenging task for autonomous driving, which requires to take full advantage of LiDAR point clouds for semantic segmentation. In this paper, we present a \textbf{concise} and…

Computer Vision and Pattern Recognition · Computer Science 2022-07-27 Hui-Xian Cheng , Xian-Feng Han , Guo-Qiang Xiao

Recently, a number of methods have emerged to detect galaxy clusters solely through their weak lensing signal. Using the recently-introduced wavelet multi-scale detection method, we focus here on the potential for the use of tomographic…

Cosmology and Nongalactic Astrophysics · Physics 2026-03-12 L. Chappuis , S. Pires , G. W. Pratt , G. Leroy , A. Daurelle , C. Giocoli , C. Carbone

In hierarchical galaxy formation models, galaxies evolve through mergers and accretions. Tidally-disrupted debris from these processes can remain as diffuse, faint structures, which can provide useful insight into the assembly history of…

We present DELIGHT, or Deep Learning Identification of Galaxy Hosts of Transients, a new algorithm designed to automatically and in real-time identify the host galaxies of extragalactic transients. The proposed algorithm receives as input…

In this study we develop dimension-reduction techniques to accelerate diffusion model inference in the context of synthetic data generation. The idea is to integrate compressed sensing into diffusion models (hence, CSDM): First, compress…

Machine Learning · Statistics 2025-09-30 Zhengyi Guo , Jiatu Li , Wenpin Tang , David D. Yao

Decoding visual stimuli from brain recordings aims to deepen our understanding of the human visual system and build a solid foundation for bridging human and computer vision through the Brain-Computer Interface. However, reconstructing…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Zijiao Chen , Jiaxin Qing , Tiange Xiang , Wan Lin Yue , Juan Helen Zhou

The existence of galaxy intrinsic clustering severely hampers the weak lensing reconstruction from cosmic magnification. In paper I \citep{Yang2011}, we proposed a minimal variance estimator to overcome this problem. By utilizing the…

Cosmology and Nongalactic Astrophysics · Physics 2016-09-21 Xinjuan Yang , Pengjie Zhang , Jun Zhang , Yu Yu

(Abridged) Weak gravitational lensing is an ideal probe of the dark universe. In recent years, several linear methods have been developed to reconstruct the density distribution in the Universe in three dimensions, making use of photometric…

Cosmology and Nongalactic Astrophysics · Physics 2015-06-03 Adrienne Leonard , François-Xavier Dupé , Jean-Luc Starck

Observational astronomy relies on visual feature identification to detect critical astrophysical phenomena. While machine learning (ML) increasingly automates this process, models often struggle with generalization in large-scale surveys…

Astrophysics of Galaxies · Physics 2026-01-15 Chenrui Ma , Zechang Sun , Tao Jing , Zheng Cai , Yuan-Sen Ting , Song Huang , Mingyu Li

To address the challenge of estimating redshifts when only single-band images are available, this study introduces a deep learning model named ViT-MDNz. Leveraging robust statistical priors learned from large-scale data concerning the…

Astrophysics of Galaxies · Physics 2026-02-27 Zhijian Luo , Yangyang Li , Jianzhen Chen , Qishen Cao , Duo Cao , Shaohua Zhang , Hubing Xiao , Chenggang Shu

Line intensity mapping (LIM) is an emerging observational method to study the large-scale structure of the Universe and its evolution. LIM does not resolve individual sources but probes the fluctuations of integrated line emissions. A…

Astrophysics of Galaxies · Physics 2020-06-03 Kana Moriwaki , Nina Filippova , Masato Shirasaki , Naoki Yoshida

In the current golden age of multimedia, human visualization is no longer the single main target, with the final consumer often being a machine which performs some processing or computer vision tasks. In both cases, deep learning plays a…

Computer Vision and Pattern Recognition · Computer Science 2023-11-20 Abdelrahman Seleem , André F. R. Guarda , Nuno M. M. Rodrigues , Fernando Pereira

Upcoming large astronomical surveys are expected to capture an unprecedented number of strong gravitational lensing systems. Deep learning is emerging as a promising practical tool for the detection and quantification of these galaxy-scale…

We introduce Motion2VecSets, a 4D diffusion model for dynamic surface reconstruction from point cloud sequences. While existing state-of-the-art methods have demonstrated success in reconstructing non-rigid objects using neural field…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Wei Cao , Chang Luo , Biao Zhang , Matthias Nießner , Jiapeng Tang

Masked Image Generation Models (MIGMs) have achieved great success, yet their efficiency is hampered by the multiple steps of bi-directional attention. In fact, there exists notable redundancy in their computation: when sampling discrete…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Kaiwen Zhu , Quansheng Zeng , Yuandong Pu , Shuo Cao , Xiaohui Li , Yi Xin , Qi Qin , Jiayang Li , Yu Qiao , Jinjin Gu , Yihao Liu

Latent diffusion models (LDMs) power state-of-the-art high-resolution generative image models. LDMs learn the data distribution in the latent space of an autoencoder (AE) and produce images by mapping the generated latents into RGB image…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Tariq Berrada , Pietro Astolfi , Melissa Hall , Marton Havasi , Yohann Benchetrit , Adriana Romero-Soriano , Karteek Alahari , Michal Drozdzal , Jakob Verbeek

Due to the unprecedented depth of the upcoming ground-based Legacy Survey of Space and Time (LSST) at the Vera C. Rubin Observatory, approximately two-thirds of the galaxies are likely to be affected by blending - the overlap of physically…

Instrumentation and Methods for Astrophysics · Physics 2025-09-10 Biswajit Biswas , Eric Aubourg , Alexandre Boucaud , Axel Guinot , Junpeng Lao , Cécile Roucelle , the LSST Dark Energy Science Collaboration