English
Related papers

Related papers: Automatic Subspace Learning via Principal Coeffici…

200 papers

Learning structures of 3D shapes is a fundamental problem in the field of computer graphics and geometry processing. We present a simple yet interpretable unsupervised method for learning a new structural representation in the form of 3D…

Computer Vision and Pattern Recognition · Computer Science 2020-03-27 Nenglun Chen , Lingjie Liu , Zhiming Cui , Runnan Chen , Duygu Ceylan , Changhe Tu , Wenping Wang

Despite the rapid development of computational hardware, the treatment of large and high dimensional data sets is still a challenging problem. This paper provides a twofold contribution to the topic. First, we propose a Gaussian Mixture…

To extract robust deep representations from long sequential modeling of speech data, we propose a self-supervised learning approach, namely Contrastive Separative Coding (CSC). Our key finding is to learn such representations by separating…

Audio and Speech Processing · Electrical Eng. & Systems 2021-03-02 Jun Wang , Max W. Y. Lam , Dan Su , Dong Yu

Principal component analysis (PCA) is a classical dimension reduction method which projects data onto the principal subspace spanned by the leading eigenvectors of the covariance matrix. However, it behaves poorly when the number of…

Statistics Theory · Mathematics 2013-05-27 Zongming Ma

Recently, self-supervised representation learning gives further development in multimedia technology. Most existing self-supervised learning methods are applicable to packaged data. However, when it comes to streamed data, they are…

Computer Vision and Pattern Recognition · Computer Science 2022-11-03 Zhiwei Lin , Yongtao Wang , Hongxiang Lin

We propose regularizing the empirical loss for semi-supervised learning by acting on both the input (data) space, and the weight (parameter) space. We show that the two are not equivalent, and in fact are complementary, one affecting the…

Machine Learning · Computer Science 2018-05-24 Safa Cicek , Stefano Soatto

Visual place recognition is a key to unlocking spatial navigation for animals, humans and robots. While state-of-the-art approaches are trained in a supervised manner and therefore hardly capture the information needed for generalizing to…

Computer Vision and Pattern Recognition · Computer Science 2023-12-25 Mohamed Adel Musallam , Vincent Gaudillière , Djamila Aouada

In the realm of statistical learning, the increasing volume of accessible data and increasing model complexity necessitate robust methodologies. This paper explores two branches of robust Bayesian methods in response to this trend. The…

Methodology · Statistics 2024-12-02 Masahiro Tanaka

The development of fast and accurate image reconstruction algorithms is a central aspect of computed tomography. In this paper, we investigate this issue for the sparse data problem in photoacoustic tomography (PAT). We develop a direct and…

Computer Vision and Pattern Recognition · Computer Science 2018-08-31 Stephan Antholzer , Markus Haltmeier , Johannes Schwab

As a widely used method in machine learning, principal component analysis (PCA) shows excellent properties for dimensionality reduction. It is a serious problem that PCA is sensitive to outliers, which has been improved by numerous Robust…

Machine Learning · Computer Science 2020-11-24 Shenglan Liu , Yang Yu

While recent research in image understanding has often focused on recognizing more types of objects, understanding more about the objects is just as important. Recognizing object parts and attributes has been extensively studied before, yet…

Computer Vision and Pattern Recognition · Computer Science 2021-12-03 David Novotny , Diane Larlus , Andrea Vedaldi

The autoencoder is an effective unsupervised learning model which is widely used in deep learning. It is well known that an autoencoder with a single fully-connected hidden layer, a linear activation function and a squared error cost…

Machine Learning · Statistics 2019-01-01 Elad Plaut

Manifold learning is a hot research topic in the field of computer science and has many applications in the real world. A main drawback of manifold learning methods is, however, that there is no explicit mappings from the input data…

Computer Vision and Pattern Recognition · Computer Science 2010-01-18 Hong Qiao , Peng Zhang , Di Wang , Bo Zhang

Learning the embedding space, where semantically similar objects are located close together and dissimilar objects far apart, is a cornerstone of many computer vision applications. Existing approaches usually learn a single metric in the…

Computer Vision and Pattern Recognition · Computer Science 2019-06-17 Artsiom Sanakoyeu , Vadim Tschernezki , Uta Büchler , Björn Ommer

Principal component analysis (PCA) is a well-known linear dimension-reduction method that has been widely used in data analysis and modeling. It is an unsupervised learning technique that identifies a suitable linear subspace for the input…

Machine Learning · Statistics 2021-09-10 Shaojie Xu , Joel Vaughan , Jie Chen , Agus Sudjianto , Vijayan Nair

The rapid expansion in the size of new datasets has created a need for fast and efficient parameter-learning techniques. Compressive learning is a framework that enables efficient processing by using random, non-linear features to project…

Machine Learning · Computer Science 2025-08-18 Daniel Mas Montserrat , David Bonet , Maria Perera , Xavier Giró-i-Nieto , Alexander G. Ioannidis

Unsupervised anomaly detection (AD) is a major topic in the field of Cyber-Physical Production Systems (CPPSs). A closely related concern is dimensionality reduction (DR) which is: 1) often used as a preprocessing step in an AD solution, 2)…

Machine Learning · Computer Science 2020-10-29 Benedikt Eiteneuer , Nemanja Hranisavljevic , Oliver Niggemann

Exploiting internal spatial geometric constraints of sparse LiDARs is beneficial to depth completion, however, has been not explored well. This paper proposes an efficient method to learn geometry-aware embedding, which encodes the local…

Computer Vision and Pattern Recognition · Computer Science 2022-06-02 Wenchao Du , Hu Chen , Hongyu Yang , Yi Zhang

Joint Embedding Predictive Architectures (JEPAs) learn representations able to solve numerous downstream tasks out-of-the-box. JEPAs combine two objectives: (i) a latent-space prediction term, i.e., the representation of a slightly…

Machine Learning · Computer Science 2025-10-08 Randall Balestriero , Nicolas Ballas , Mike Rabbat , Yann LeCun

Recent advancements in machine learning have transformed the discovery of physical laws, moving from manual derivation to data-driven methods that simultaneously learn both the structure and parameters of governing equations. This shift…

Machine Learning · Computer Science 2024-10-15 Hillary Hauger , Philipp Scholl , Gitta Kutyniok