English
Related papers

Related papers: Gaussian-Constrained LeJEPA Representations for Un…

200 papers

Gaussian Splatting has rapidly emerged as a transformative technique for real-time 3D scene representation, offering a highly efficient and expressive alternative to Neural Radiance Fields (NeRF). Its ability to render complex scenes with…

Graphics · Computer Science 2025-08-20 Mahmoud Chick Zaouali , Todd Charter , Yehor Karpichev , Brandon Haworth , Homayoun Najjaran

Joint-Embedding Predictive Architectures (JEPA) learn view-invariant representations and admit projection-based distribution matching for collapse prevention. Existing approaches regularize representations towards isotropic Gaussian…

Machine Learning · Computer Science 2026-05-29 Yilun Kuang , Yash Dagade , Tim G. J. Rudner , Randall Balestriero , Yann LeCun

Image-based Joint-Embedding Predictive Architecture (I-JEPA) offers a promising approach to visual self-supervised learning through masked feature prediction. However with the inherent visual uncertainty at masked positions, feature…

Machine Learning · Computer Science 2026-05-06 Chen Huang , Xianhang Li , Vimal Thilak , Etai Littwin , Josh Susskind

Image-to-point cross-modal learning has emerged to address the scarcity of large-scale 3D datasets in 3D representation learning. However, current methods that leverage 2D data often result in large, slow-to-train models, making them…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Avishka Perera , Kumal Hewagamage , Saeedha Nazar , Kavishka Abeywardana , Hasitha Gallella , Ranga Rodrigo , Mohamed Afham

Recent breakthroughs in self-supervised Joint-Embedding Predictive Architectures (JEPAs) have established that regularizing Euclidean representations toward isotropic Gaussian priors yields provable gains in training stability and…

Machine Learning · Computer Science 2025-12-23 Eric Zimmermann , Harley Wiltzer , Justin Szeto , David Alvarez-Melis , Lester Mackey

3D Gaussians have recently emerged as an effective scene representation for real-time splatting and accurate novel-view synthesis, motivating several works to adapt multi-view structure prediction networks to regress per-pixel 3D Gaussians…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Mehdi Hosseinzadeh , Shin-Fang Chng , Yi Xu , Simon Lucey , Ian Reid , Ravi Garg

3D Gaussian Splatting (3DGS) has recently emerged as a powerful scene representation and is increasingly used for visual localization and pose refinement. However, despite its high-quality differentiable rendering, the robustness of…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Mangyu Kong , Jaewon Lee , Seongwon Lee , Euntai Kim

This paper demonstrates an approach for learning highly semantic image representations without relying on hand-crafted data-augmentations. We introduce the Image-based Joint-Embedding Predictive Architecture (I-JEPA), a non-generative…

Computer Vision and Pattern Recognition · Computer Science 2023-04-14 Mahmoud Assran , Quentin Duval , Ishan Misra , Piotr Bojanowski , Pascal Vincent , Michael Rabbat , Yann LeCun , Nicolas Ballas

Recently, generalizable human Gaussian splatting from sparse-view inputs has been actively studied for the photorealistic human rendering. Most existing methods rely on explicit geometric constraints or predefined structural representations…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Jingi Kim , Wonjun Kim

The significance of informative and robust point representations has been widely acknowledged for 3D scene understanding. Despite existing self-supervised pre-training counterparts demonstrating promising performance, the model collapse and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-12 Lei Yao , Yi Wang , Yi Zhang , Moyun Liu , Lap-Pui Chau

Joint Embedding Predictive Architectures (JEPA) offer a scalable paradigm for self-supervised learning by predicting latent representations rather than reconstructing high-entropy observations. However, existing formulations rely on…

Machine Learning · Computer Science 2026-01-22 Yongchao Huang

3D Gaussian Splatting (3DGS) has emerged as a powerful and efficient 3D representation for novel view synthesis. This paper extends 3DGS capabilities to inpainting, where masked objects in a scene are replaced with new contents that blend…

Computer Vision and Pattern Recognition · Computer Science 2025-04-28 Mingxuan Cui , Qing Guo , Yuyi Wang , Hongkai Yu , Di Lin , Qin Zou , Ming-Ming Cheng , Xi Li

The introduction of 3D Gaussian Splatting (3DGS) has advanced novel view synthesis by utilizing Gaussians to represent scenes. Encoding Gaussian point features with anchor embeddings has significantly enhanced the performance of newer 3DGS…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Junyan Su , Baozhu Zhao , Xiaohan Zhang , Qi Liu

Novel view synthesis for underwater scene reconstruction presents unique challenges due to complex light-media interactions. Optical scattering and absorption in water body bring inhomogeneous medium attenuation interference that disrupts…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Jieyu Yuan , Yujun Li , Yuanlin Zhang , Chunle Guo , Xiongxin Tang , Ruixing Wang , Chongyi Li

Robust 3D representation learning forms the perceptual foundation of spatial intelligence, enabling downstream tasks in scene understanding and embodied AI. However, learning such representations directly from unposed multi-view images…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Bo Zhou , Qiuxia Lai , Zeren Sun , Xiangbo Shu , Yazhou Yao , Wenguan Wang

We present a novel approach for 3D indoor scene reconstruction that combines 3D Gaussian Splatting (3DGS) with mesh representations. We use meshes for the room layout of the indoor scene, such as walls, ceilings, and floors, while employing…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Jiyeop Kim , Jongwoo Lim

Video Prediction is an interesting and challenging task of predicting future frames from a given set context frames that belong to a video sequence. Video prediction models have found prospective applications in Maneuver Planning, Health…

Computer Vision and Pattern Recognition · Computer Science 2020-11-18 P Aditya Sreekar , Ujjwal Tiwari , Anoop Namboodiri

In 3D reconstruction, the problem of inverse rendering, namely recovering the illumination of the scene and the material properties, is fundamental. Existing Gaussian Splatting-based methods primarily target static scenes and often assume…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Joanna Kaleta , Piotr Wójcik , Kacper Marzol , Tomasz Trzciński , Kacper Kania , Marek Kowalski

Single-image 3D scene reconstruction presents significant challenges due to its inherently ill-posed nature and limited input constraints. Recent advances have explored two promising directions: multiview generative models that train on 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Junlin Hao , Peiheng Wang , Haoyang Wang , Xinggong Zhang , Zongming Guo

Existing methods for self-supervised representation learning of geospatial regions and map entities rely extensively on the design of pretext tasks, often involving augmentations or heuristic sampling of positive and negative pairs based on…

Machine Learning · Computer Science 2025-03-11 Theodor Lundqvist , Ludvig Delvret