English
Related papers

Related papers: Generalization Guarantees for Multi-View Represent…

200 papers

A crucial aspect in reliable machine learning is to design a deployable system in generalizing new related but unobserved environments. Domain generalization aims to alleviate such a prediction gap between the observed and unseen…

Machine Learning · Computer Science 2021-06-01 Changjian Shui , Boyu Wang , Christian Gagné

Variational inference with a factorized Gaussian posterior estimate is a widely used approach for learning parameters and hidden variables. Empirically, a regularizing effect can be observed that is poorly understood. In this work, we show…

Machine Learning · Computer Science 2019-09-04 Julius Kunze , Louis Kirsch , Hippolyt Ritter , David Barber

Anomaly Detection (AD) in images is a fundamental computer vision problem and refers to identifying images and image substructures that deviate significantly from the norm. Popular AD algorithms commonly try to learn a model of normality…

Computer Vision and Pattern Recognition · Computer Science 2020-10-26 Oliver Rippel , Patrick Mertens , Dorit Merhof

Modeling latent variables with priors and hyperpriors is an essential problem in variational image compression. Formally, trade-off between rate and distortion is handled well if priors and hyperpriors precisely describe latent variables.…

Computer Vision and Pattern Recognition · Computer Science 2022-03-23 Xiaosu Zhu , Jingkuan Song , Lianli Gao , Feng Zheng , Heng Tao Shen

While self-supervised learning techniques are often used to mining implicit knowledge from unlabeled data via modeling multiple views, it is unclear how to perform effective representation learning in a complex and inconsistent context. To…

Computer Vision and Pattern Recognition · Computer Science 2023-08-10 Jiangmeng Li , Wenwen Qiang , Changwen Zheng , Bing Su , Farid Razzak , Ji-Rong Wen , Hui Xiong

Recent work in unsupervised learning has focused on efficient inference and learning in latent variables models. Training these models by maximizing the evidence (marginal likelihood) is typically intractable. Thus, a common approximation…

Machine Learning · Computer Science 2021-02-15 Linh Tran , Maja Pantic , Marc Peter Deisenroth

Training a fine-grained image recognition model with limited data presents a significant challenge, as the subtle differences between categories may not be easily discernible amidst distracting noise patterns. One commonly employed strategy…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Avraham Chapman , Haiming Xu , Lingqiao Liu

3D Gaussian Splatting (3DGS) has demonstrated impressive novel view synthesis performance. While conventional methods require per-scene optimization, more recently several feed-forward methods have been proposed to generate pixel-aligned…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Shengjun Zhang , Xin Fei , Fangfu Liu , Haixu Song , Yueqi Duan

The flexibility of decision boundaries in neural networks that are unguided by training data is a well-known problem typically resolved with generalization methods. A surprising result from recent knowledge distillation (KD) literature is…

Machine Learning · Computer Science 2024-10-28 HeeSeung Jung , Kangil Kim , Hoyong Kim , Jong-Hun Shin

Unsupervised representation learning via generative modeling is a staple to many computer vision applications in the absence of labeled data. Variational Autoencoders (VAEs) are powerful generative models that learn representations useful…

Machine Learning · Computer Science 2020-03-24 Riddhish Bhalodia , Iain Lee , Shireen Elhabian

Analyzing neural network dynamics via stochastic gradient descent (SGD) is crucial to building theoretical foundations for deep learning. Previous work has analyzed structured inputs within the \textit{hidden manifold model}, often under…

Machine Learning · Statistics 2025-12-01 Jaeyong Bae , Hawoong Jeong

How much does having visual priors about the world (e.g. the fact that the world is 3D) assist in learning to perform downstream motor tasks (e.g. delivering a package)? We study this question by integrating a generic perceptual skill set…

Computer Vision and Pattern Recognition · Computer Science 2019-04-23 Alexander Sax , Bradley Emi , Amir R. Zamir , Leonidas Guibas , Silvio Savarese , Jitendra Malik

Expectation Maximization (EM) is the standard method to learn Gaussian mixtures. Yet its classic, centralized form is often infeasible, due to privacy concerns and computational and communication bottlenecks. Prior work dealt with data…

Machine Learning · Computer Science 2022-01-26 Pedro Valdeira , Cláudia Soares , João Xavier

The field of self-supervised 3D representation learning has emerged as a promising solution to alleviate the challenge presented by the scarcity of extensive, well-annotated datasets. However, it continues to be hindered by the lack of…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Yunsong Wang , Na Zhao , Gim Hee Lee

Visual Reinforcement Learning (RL) agents trained on limited views face significant challenges in generalizing their learned abilities to unseen views. This inherent difficulty is known as the problem of $\textit{view generalization}$. In…

Machine Learning · Computer Science 2023-09-28 Sizhe Yang , Yanjie Ze , Huazhe Xu

Latent traversal is a popular approach to visualize the disentangled latent representations. Given a bunch of variations in a single unit of the latent representation, it is expected that there is a change in a single factor of variation of…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Xinqi Zhu , Chang Xu , Dacheng Tao

Learning from previously collected data via behavioral cloning or offline reinforcement learning (RL) is a powerful recipe for scaling generalist agents by avoiding the need for expensive online learning. Despite strong generalization in…

Building sample-efficient agents that generalize out-of-distribution (OOD) in real-world settings remains a fundamental unsolved problem on the path towards achieving higher-level cognition. One particularly promising approach is to begin…

Distributed learning provides an attractive framework for scaling the learning task by sharing the computational load over multiple nodes in a network. Here, we investigate the performance of distributed learning for large-scale linear…

Machine Learning · Statistics 2021-11-03 Martin Hellkvist , Ayça Özçelikkale , Anders Ahlén

Unsupervised and self-supervised learning approaches have become a crucial tool to learn representations for downstream prediction tasks. While these approaches are widely used in practice and achieve impressive empirical gains, their…

Machine Learning · Computer Science 2020-10-23 Siddhant Garg , Yingyu Liang