English
Related papers

Related papers: Improving Content-Invariance in Gated Autoencoders…

200 papers

Image registration is an ill-posed inverse problem which often requires regularisation on the solution space. In contrast to most of the current approaches which impose explicit regularisation terms such as smoothness, in this paper we…

Image and Video Processing · Electrical Eng. & Systems 2020-07-09 Chen Qin , Shuo Wang , Chen Chen , Huaqi Qiu , Wenjia Bai , Daniel Rueckert

Graph autoencoders (GAEs), as a kind of generative self-supervised learning approach, have shown great potential in recent years. GAEs typically rely on distance-based criteria, such as mean-square-error (MSE), to reconstruct the input…

Machine Learning · Computer Science 2024-06-26 Ge Chen , Yulan Hu , Sheng Ouyang , Yong Liu , Cuicui Luo

Variational autoencoders learn unsupervised data representations, but these models frequently converge to minima that fail to preserve meaningful semantic information. For example, variational autoencoders with autoregressive decoders often…

Machine Learning · Computer Science 2019-05-21 Bryan Seybold , Emily Fertig , Alex Alemi , Ian Fischer

An effective unsupervised hashing algorithm leads to compact binary codes preserving the neighborhood structure of data as much as possible. One of the most established schemes for unsupervised hashing is to reduce the dimensionality of…

Computer Vision and Pattern Recognition · Computer Science 2021-10-04 Sobhan Hemati , H. R. Tizhoosh

In this work, we propose Regularization-by-Equivariance (REV), a novel structure-adaptive regularization scheme for solving imaging inverse problems under incomplete measurements. This regularization scheme utilizes the equivariant…

Optimization and Control · Mathematics 2022-02-15 Junqi Tang

Regularization is a critical technique for ensuring well-posedness in solving inverse problems with incomplete measurement data. Traditionally, the regularization term is designed based on prior knowledge of the unknown signal's…

Numerical Analysis · Mathematics 2024-12-16 Bosu Choi , Jihun Han , Yoonsang Lee

Vector-Quantized Variational Autoencoders (VQ-VAE)[1] provide an unsupervised model for learning discrete representations by combining vector quantization and autoencoders. In this paper, we study the use of VQ-VAE for representation…

Image and Video Processing · Electrical Eng. & Systems 2019-03-05 Hanwei Wu , Markus Flierl

Regularization is essential in deep learning to enhance generalization and mitigate overfitting. However, conventional techniques often rely on heuristics, making them less reliable or effective across diverse settings. We propose Self…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Xiuding Cai , Yaoyao Zhu , Linjie Fu , Dong Miao , Yu Yao

Existing rotation-invariant point cloud masked autoencoders (MAE) rely on random masking strategies that overlook geometric structure and semantic coherence. Random masking treats patches independently, failing to capture spatial…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Xuanhua Yin , Dingxin Zhang , Yu Feng , Shunqi Mao , Jianhui Yu , Weidong Cai

Learning embeddings that are invariant to the pose of the object is crucial in visual image retrieval and re-identification. The existing approaches for person, vehicle, or animal re-identification tasks suffer from high intra-class…

Computer Vision and Pattern Recognition · Computer Science 2020-08-27 Olga Moskvyak , Frederic Maire , Feras Dayoub , Mahsa Baktashmotlagh

Image segmentation is to extract meaningful objects from a given image. For degraded images due to occlusions, obscurities or noises, the accuracy of the segmentation result can be severely affected. To alleviate this problem, prior…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Daoping Zhang , Lok Ming Lui

Variational autoencoders optimize an objective that combines a reconstruction loss (the distortion) and a KL term (the rate). The rate is an upper bound on the mutual information, which is often interpreted as a regularizer that controls…

Deep generative models have achieved remarkable success in various data domains, including images, time series, and natural languages. There remain, however, substantial challenges for combinatorial structures, including graphs. One of the…

Machine Learning · Computer Science 2018-09-21 Tengfei Ma , Jie Chen , Cao Xiao

Diverse inverse problems in imaging can be cast as variational problems composed of a task-specific data fidelity term and a regularization term. In this paper, we propose a novel learnable general-purpose regularizer exploiting recent…

Optimization and Control · Mathematics 2020-02-19 Erich Kobler , Alexander Effland , Karl Kunisch , Thomas Pock

Understanding the orientation of geological structures is crucial for analyzing the complexity of the Earths' subsurface. For instance, information about geological structure orientation can be incorporated into local anisotropic…

Geophysics · Physics 2024-09-10 Ali Gholami , Silvia Gazzola

Manifold alignment (MA) involves a set of techniques for learning shared representations across domains, yet many traditional MA methods are incapable of performing out-of-sample extension, limiting their real-world applicability. We…

Machine Learning · Computer Science 2025-09-30 Jake S. Rhodes , Adam G. Rustad , Marshall S. Nielsen , Morgan Chase McClellan , Dallan Gardner , Dawson Hedges

Autoencoders represent an effective approach for computing the underlying factors characterizing datasets of different types. The latent representation of autoencoders have been studied in the context of enabling interpolation between data…

Machine Learning · Computer Science 2020-10-23 Alon Oring , Zohar Yakhini , Yacov Hel-Or

Regularization techniques are widely employed in optimization-based approaches for solving ill-posed inverse problems in data analysis and scientific computing. These methods are based on augmenting the objective with a penalty function,…

Optimization and Control · Mathematics 2021-06-08 Yong Sheng Soh , Venkat Chandrasekaran

Regularization is a core component of modern inverse problems, as it helps establish the well-posedness of the solution of interest. Popular regularization approaches include variational regularization and iterative regularization. The…

Optimization and Control · Mathematics 2025-08-08 Jie Gao , Cesare Molinari , Silvia Villa , Jingwei Liang

Popular rotated detection methods usually use five parameters (coordinates of the central point, width, height, and rotation angle) to describe the rotated bounding box and l1-loss as the loss function. In this paper, we argue that the…

Computer Vision and Pattern Recognition · Computer Science 2019-12-23 Wen Qian , Xue Yang , Silong Peng , Yue Guo , Junchi Yan