English
Related papers

Related papers: Exploring the Limitations of Structured Orthogonal…

200 papers

We propose a batchwise monotone algorithm for dictionary learning. Unlike the state-of-the-art dictionary learning algorithms which impose sparsity constraints on a sample-by-sample basis, we instead treat the samples as a batch, and impose…

Machine Learning · Computer Science 2015-02-03 Huan Wang , John Wright , Daniel Spielman

We investigate compositional structures in data embeddings from pre-trained vision-language models (VLMs). Traditionally, compositionality has been associated with algebraic operations on embeddings of words from a pre-existing vocabulary.…

Machine Learning · Computer Science 2024-01-12 Matthew Trager , Pramuditha Perera , Luca Zancato , Alessandro Achille , Parminder Bhatia , Stefano Soatto

We propose a novel sparse dictionary learning method for planar shapes in the sense of Kendall, namely configurations of landmarks in the plane considered up to similitudes. Our shape dictionary method provides a good trade-off between…

Image and Video Processing · Electrical Eng. & Systems 2020-01-14 Anna Song , Virginie Uhlmann , Julien Fageot , Michael Unser

In the probabilistic topic models, the quantity of interest---a low-rank matrix consisting of topic vectors---is hidden in the text corpus matrix, masked by noise, and the Singular Value Decomposition (SVD) is a potentially useful tool for…

Methodology · Statistics 2016-08-17 Zheng Tracy Ke

Two-stage orthogonalization is essential in numerical algorithms such as Krylov subspace methods. For this task we need to orthogonalize a matrix $A$ against another matrix $V$ with orthonormal columns. A common approach is to employ the…

Numerical Analysis · Mathematics 2026-03-24 Zhuang-Ao He , Meiyue Shao

Existing recurrent neural language models often fail to capture higher-level structure present in text: for example, rhyming patterns present in poetry. Much prior work on poetry generation uses manually defined constraints which are…

Computation and Language · Computer Science 2019-09-17 Harsh Jhamtani , Sanket Vaibhav Mehta , Jaime Carbonell , Taylor Berg-Kirkpatrick

Deep learning algorithms demonstrate a surprising ability to learn high-dimensional tasks from limited examples. This is commonly attributed to the depth of neural networks, enabling them to build a hierarchy of abstract, low-dimensional…

Machine Learning · Computer Science 2024-07-04 Francesco Cagnetta , Leonardo Petrini , Umberto M. Tomasini , Alessandro Favero , Matthieu Wyart

Our goal in this paper is to discover near duplicate patterns in large collections of artworks. This is harder than standard instance mining due to differences in the artistic media (oil, pastel, drawing, etc), and imperfections inherent in…

Computer Vision and Pattern Recognition · Computer Science 2019-03-11 Xi Shen , Alexei A. Efros , Mathieu Aubry

This paper develops fast and efficient algorithms for computing Tucker decomposition with a given multilinear rank. By combining random projection and the power scheme, we propose two efficient randomized versions for the truncated…

Numerical Analysis · Mathematics 2023-03-22 Maolin Che , Yimin Wei , Hong Yan

Large language models must satisfy hard orthographic constraints during controlled text generation, yet systematic cross-family evaluation remains limited. We evaluate 39 configurations spanning three model families (Qwen3, Claude Haiku…

Computation and Language · Computer Science 2026-05-05 Bryan E. Tuck , Rakesh M. Verma

A novel matrix approximation problem is considered herein: observations based on a few fully sampled columns and quasi-polynomial structural side information are exploited. The framework is motivated by quantum chemistry problems wherein…

Signal Processing · Electrical Eng. & Systems 2023-05-23 Jeongmin Chae , Praneeth Narayanamurthy , Selin Bac , Shaama Mallikarjun Sharada , Urbashi Mitra

Matrix product operators allow efficient descriptions (or realizations) of states on a 1D lattice. We consider the task of learning a realization of minimal dimension from copies of an unknown state, such that the resulting operator is…

Quantum Physics · Physics 2025-03-07 Marco Fanizza , Niklas Galke , Josep Lumbreras , Cambyse Rouzé , Andreas Winter

We consider the problem of learning low-rank tensors from partial observations with structural constraints, and propose a novel factorization of such tensors, which leads to a simpler optimization problem. The resulting problem is an…

Machine Learning · Computer Science 2023-05-16 Jayadev Naram , Tanmay Kumar Sinha , Pawan Kumar

In this paper we propose a method for the approximation of high-dimensional functions over finite intervals with respect to complete orthonormal systems of polynomials. An important tool for this is the multivariate classical analysis of…

Numerical Analysis · Mathematics 2022-01-31 Daniel Potts , Michael Schmischke

Structural learning, a method to estimate the parameters for discrete energy minimization, has been proven to be effective in solving computer vision problems, especially in 3D scene parsing. As the complexity of the models increases,…

Computer Vision and Pattern Recognition · Computer Science 2017-01-13 Mengtian Li , Daniel Huber

We aim at enforcing hard constraints to impose a global structure on sequences generated from Markov models. In this report, we study the complexity of sampling Markov sequences under two classes of constraints: Binary Equalities and…

Computational Complexity · Computer Science 2017-11-29 Stephane Rivaud , François Pachet

We discuss the feasibility of the following learning problem: given unmatched samples from two domains and nothing else, learn a mapping between the two, which preserves semantics. Due to the lack of paired samples and without any…

Machine Learning · Computer Science 2020-01-16 Tomer Galanti , Lior Wolf , Sagie Benaim

Dense word embeddings, which encode semantic meanings of words to low dimensional vector spaces have become very popular in natural language processing (NLP) research due to their state-of-the-art performances in many NLP tasks. Word…

Computation and Language · Computer Science 2018-07-20 Lutfi Kerem Senel , Ihsan Utlu , Veysel Yucesoy , Aykut Koc , Tolga Cukur

We describe new results and algorithms for two different, but related, problems which deal with circulant matrices: learning shift-invariant components from training data and calculating the shift (or alignment) between two given signals.…

Machine Learning · Computer Science 2019-07-02 Cristian Rusu

Predicting the structure of multi-protein complexes is a grand challenge in biochemistry, with major implications for basic science and drug discovery. Computational structure prediction methods generally leverage pre-defined structural…

Biomolecules · Quantitative Biology 2021-01-26 Stephan Eismann , Raphael J. L. Townshend , Nathaniel Thomas , Milind Jagota , Bowen Jing , Ron O. Dror