English
Related papers

Related papers: Compressed Subspace Learning Based on Canonical An…

200 papers

The Johnson-Lindenstrauss Lemma states that there exist linear maps that project a set of points of a vector space into a space of much lower dimension such that the Euclidean distance between these points is approximately preserved. This…

Optimization and Control · Mathematics 2023-01-18 Pierre-Louis Poirion , Bruno F. Lourenço , Akiko Takeda

Recent breakthroughs in self-supervised learning show that such algorithms learn visual representations that can be transferred better to unseen tasks than joint-training methods relying on task-specific supervision. In this paper, we found…

Machine Learning · Computer Science 2021-06-29 Hyuntak Cha , Jaeho Lee , Jinwoo Shin

The focus of this paper is on detection theory for union of subspaces (UoS). To this end, generalized likelihood ratio tests (GLRTs) are presented for detection of signals conforming to the UoS model and detection of the corresponding…

Signal Processing · Electrical Eng. & Systems 2019-01-23 Muhammad Asad Lodhi , Waheed U. Bajwa

Addressing Out-Of-Distribution (OOD) Segmentation and Zero-Shot Semantic Segmentation (ZS3) is challenging, necessitating segmenting unseen classes. Existing strategies adapt the class-agnostic Mask2Former (CA-M2F) tailored to specific…

Computer Vision and Pattern Recognition · Computer Science 2024-02-09 Hao Zhang , Fang Li , Lu Qi , Ming-Hsuan Yang , Narendra Ahuja

The Johnson-Lindenstrauss (JL) lemma is a cornerstone of dimensionality reduction in Euclidean space, but its applicability to non-Euclidean data has remained limited. This paper extends the JL lemma beyond Euclidean geometry to handle…

Data Structures and Algorithms · Computer Science 2025-10-28 Chengyuan Deng , Jie Gao , Kevin Lu , Feng Luo , Cheng Xin

The impressive growth of data throughput in optical microscopy has triggered a widespread use of supervised learning (SL) models running on compressed image datasets for efficient automated analysis. However, since lossy image compression…

Only learning one projection matrix from original samples to the corresponding binary labels is too strict and will consequentlly lose some intrinsic geometric structures of data. In this paper, we propose a novel transition subspace…

Computer Vision and Pattern Recognition · Computer Science 2019-06-17 Zhe Chen , Xiao-Jun Wu , Josef Kittler

In continual learning (CL), a learner is faced with a sequence of tasks, arriving one after the other, and the goal is to remember all the tasks once the continual learning experience is finished. The prior art in CL uses episodic memory,…

Machine Learning · Computer Science 2020-12-09 Arslan Chaudhry , Naeemullah Khan , Puneet K. Dokania , Philip H. S. Torr

The Continuous Spontaneous Localization (CSL) model strives to describe the quantum-to-classical transition from the viewpoint of collapse models. However, its original formulation suffers from a fundamental inconsistency in that it is…

Quantum Physics · Physics 2018-10-17 J. Nobakht , M. Carlesso , S. Donadi , M. Paternostro , A. Bassi

We propose a low-rank transformation-learning framework to robustify subspace clustering. Many high-dimensional data, such as face images and motion sequences, lie in a union of low-dimensional subspaces. The subspace clustering problem has…

Computer Vision and Pattern Recognition · Computer Science 2013-08-02 Qiang Qiu , Guillermo Sapiro

Random sampling is a fundamental tool in modern machine learning and numerical linear algebra for reducing the computational cost of large-scale matrix problems. Existing analyses, however, rely primarily on subspace embedding guarantees,…

Numerical Analysis · Mathematics 2026-05-26 Chengmei Niu , Sachin Garg , Michał Dereziński , Zhenyu Liao

A low-rank transformation learning framework for subspace clustering and classification is here proposed. Many high-dimensional data, such as face images and motion sequences, approximately lie in a union of low-dimensional subspaces. The…

Computer Vision and Pattern Recognition · Computer Science 2014-03-11 Qiang Qiu , Guillermo Sapiro

Self-supervised learning (SSL) has made enormous progress and largely narrowed the gap with the supervised ones, where the representation learning is mainly guided by a projection into an embedding space. During the projection, current…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Lang Huang , Shan You , Mingkai Zheng , Fei Wang , Chen Qian , Toshihiko Yamasaki

Reconstruction and joint embedding have emerged as two leading paradigms in Self Supervised Learning (SSL). Reconstruction methods focus on recovering the original sample from a different view in input space. On the other hand, joint…

Machine Learning · Computer Science 2025-10-15 Hugues Van Assel , Mark Ibrahim , Tommaso Biancalani , Aviv Regev , Randall Balestriero

Learning good image representations that are beneficial to downstream tasks is a challenging task in computer vision. As such, a wide variety of self-supervised learning approaches have been proposed. Among them, contrastive learning has…

Computer Vision and Pattern Recognition · Computer Science 2023-02-06 Yun Yue , Fangzhou Lin , Kazunori D Yamada , Ziming Zhang

How does the geometric representation of a dataset change after the application of each randomly initialized layer of a neural network? The celebrated Johnson--Lindenstrauss lemma answers this question for linear fully-connected neural…

Machine Learning · Computer Science 2022-03-08 Ido Nachum , Jan Hązła , Michael Gastpar , Anatoly Khina

Contrastive Learning (CL) has been successfully applied to classification and other downstream tasks related to concrete concepts, such as objects contained in the ImageNet dataset. No attempts seem to have been made so far in applying this…

Machine Learning · Computer Science 2025-05-30 Daniel N. Nissani

Compressed sensing (CS) computed tomography has been proven to be important for several clinical applications, such as sparse-view computed tomography (CT), digital tomosynthesis and interior tomography. Traditional compressed sensing…

Medical Physics · Physics 2020-12-15 Yi Zhang , Hu Chen , Wenjun Xia , Yang Chen , Baodong Liu , Yan Liu , Huaiqiang Sun , Jiliu Zhou

Contrastive learning (CL) aims to preserve relational structure between samples by learning representations that reflect a similarity graph. Yet, the geometry of the resulting embeddings remains poorly understood. Here we show that weighted…

Machine Learning · Computer Science 2026-05-15 Raphael Vock , Edouard Duchesnay , Benoit Dufumier

Emphasis in the tensor literature on random embeddings (tools for low-distortion dimension reduction) for the canonical polyadic (CP) tensor decomposition has left analogous results for the more expressive Tucker decomposition comparatively…

Machine Learning · Statistics 2024-06-14 Matthew Pietrosanu , Bei Jiang , Linglong Kong