English
Related papers

Related papers: Regularizing Autoencoder-Based Matrix Completion M…

200 papers

Unsupervised feature learning often finds low-dimensional embeddings that capture the structure of complex data. For tasks for which prior expert topological knowledge is available, incorporating this into the learned representation may…

Machine Learning · Computer Science 2022-03-08 Robin Vandaele , Bo Kang , Jefrey Lijffijt , Tijl De Bie , Yvan Saeys

Neural networks have proven successful at learning from complex data distributions by acting as universal function approximators. However, they are often overconfident in their predictions, which leads to inaccurate and miscalibrated…

Machine Learning · Computer Science 2021-02-23 Jeffrey Willette , Juho Lee , Sung Ju Hwang

In modern deep learning, the models are learned by applying gradient updates using an optimizer, which transforms the updates based on various statistics. Optimizers are often hand-designed and tuning their hyperparameters is a big part of…

Machine Learning · Computer Science 2024-10-08 Gus Kristiansen , Mark Sandler , Andrey Zhmoginov , Nolan Miller , Anirudh Goyal , Jihwan Lee , Max Vladymyrov

Network embedding is an effective technique to learn the low-dimensional representations of nodes in networks. Real-world networks are usually with multiplex or having multi-view representations from different relations. Recently, there has…

Machine Learning · Computer Science 2022-03-08 Qifan Wang , Yi Fang , Anirudh Ravula , Ruining He , Bin Shen , Jingang Wang , Xiaojun Quan , Dongfang Liu

We solve the Matrix Completion (MC) problem based on manifold optimization by incorporating the side information under which the columns of the intended matrix are drawn from a union of low dimensional subspaces. It is proved that this side…

Optimization and Control · Mathematics 2019-08-20 Mohamad Mahdi Mohades , Mohammad Hossein Kahaei

One approach to parametric and adaptive model reduction is via the interpolation of orthogonal bases, subspaces or positive definite system matrices. In all these cases, the sampled inputs stem from matrix sets that feature a geometric…

Numerical Analysis · Mathematics 2022-12-16 Ralf Zimmermann

We consider multi-task learning, which simultaneously learns related prediction tasks, to improve generalization performance. We factorize a coefficient matrix as the product of two matrices based on a low-rank assumption. These matrices…

Machine Learning · Statistics 2018-08-14 Jun-Yong Jeong , Chi-Hyuck Jun

In this article, we will look at autoencoders. This article covers the mathematics and the fundamental concepts of autoencoders. We will discuss what they are, what the limitations are, the typical use cases, and we will look at some…

Machine Learning · Computer Science 2022-01-12 Umberto Michelucci

Purpose: This work aims at developing a generalizable MRI reconstruction model in the meta-learning framework. The standard benchmarks in meta-learning are challenged by learning on diverse task distributions. The proposed network learns…

Computer Vision and Pattern Recognition · Computer Science 2021-10-05 Wanyu Bian , Yunmei Chen , Xiaojing Ye , Qingchao Zhang

Recent advances in semi-supervised learning methods rely on estimating the categories of unlabeled data using a model trained on the labeled data (pseudo-labeling) and using the unlabeled data for various consistency-based regularization.…

Machine Learning · Computer Science 2019-06-14 Chia-Wen Kuo , Chih-Yao Ma , Jia-Bin Huang , Zsolt Kira

Quadratic programming is a workhorse of modern nonlinear optimization, control, and data science. Although regularized methods offer convergence guarantees under minimal assumptions on the problem data, they can exhibit the slow…

Optimization and Control · Mathematics 2026-05-18 Jeremy Bertoncini , Alberto De Marchi , Matthias Gerdts , Simon Gottschalk

In this chapter we provide a theoretically founded investigation of state-of-the-art learning approaches for inverse problems from the point of view of spectral reconstruction operators. We give an extended definition of regularization…

Numerical Analysis · Mathematics 2024-06-05 Martin Burger , Samira Kabri

Developing and fielding complex systems requires proof that they are reliably correct with respect to their design and operating requirements. Especially for autonomous systems which exhibit unanticipated emergent behavior, fully…

Software Engineering · Computer Science 2024-02-28 Matthew Litton , Doron Drusinsky , James Bret Michael

Sensor and control data of modern mechatronic systems are often available as heterogeneous time series with different sampling rates and value ranges. Suitable classification and regression methods from the field of supervised machine…

Machine Learning · Computer Science 2021-04-09 Karl-Philipp Kortmann , Moritz Fehsenfeld , Mark Wielitzka

Autoencoders can be challenged by spatially non-uniform sampling of image content. This is common in medical imaging, biology, and physics, where informative patterns occur rarely at specific image coordinates, as background dominates these…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Alejandro Castañeda Garcia , Jan van Gemert , Daan Brinks , Nergis Tömen

In this paper, we introduce a novel theoretical framework for multi-task regression, applying random matrix theory to provide precise performance estimations, under high-dimensional, non-Gaussian data distributions. We formulate a…

Multi-modal brain functional connectivity (FC) data have shown great potential for providing insights into individual variations in behavioral and cognitive traits. The joint learning of multi-modal imaging data can utilize the intrinsic…

Quantitative Methods · Quantitative Biology 2019-01-18 Li Xiao , Julia M. Stephen , Tony W. Wilson , Vince D. Calhoun , Yu-Ping Wang

Counterfactual explanations for machine learning models are used to find minimal interventions to the feature values such that the model changes the prediction to a different output or a target output. A valid counterfactual explanation…

Machine Learning · Computer Science 2023-03-23 Shravan Kumar Sajja , Sumanta Mukherjee , Satyam Dwivedi

Bayesian matrix completion has been studied based on a low-rank matrix factorization formulation with promising results. However, little work has been done on Bayesian matrix completion based on the more direct spectral regularization…

Numerical Analysis · Computer Science 2016-05-31 Yang Song , Jun Zhu

Despite the recent developments that allowed neural networks to achieve impressive performance on a variety of applications, these models are intrinsically affected by the problem of overgeneralization, due to their partitioning of the full…

Artificial Intelligence · Computer Science 2020-02-11 Giacomo Spigler