English
Related papers

Related papers: Factorization-free Orthogonal Projection onto the …

200 papers

We study the problem of estimating precision matrices in Gaussian distributions that are multivariate totally positive of order two ($\mathrm{MTP}_2$). The precision matrix in such a distribution is an M-matrix. This problem can be…

Machine Learning · Computer Science 2023-10-24 Jian-Feng Cai , José Vinícius de M. Cardoso , Daniel P. Palomar , Jiaxi Ying

Matrix decompositions are ubiquitous in machine learning, including applications in dimensionality reduction, data compression and deep learning algorithms. Typical solutions for matrix decompositions have polynomial complexity which…

Machine Learning · Computer Science 2024-03-13 Łukasz Struski , Paweł Morkisz , Przemysław Spurek , Samuel Rodriguez Bernabeu , Tomasz Trzciński

We propose a fast approximate algorithm for large graph matching. A new projected fixed-point method is defined and a new doubly stochastic projection is adopted to derive the algorithm. Previous graph matching algorithms suffer from high…

Computer Vision and Pattern Recognition · Computer Science 2012-08-13 Yao Lu , Kaizhu Huang , Cheng-Lin Liu

Randomized smoothing is currently the state-of-the-art method that provides certified robustness for deep neural networks. However, due to its excessively conservative nature, this method of incomplete verification often cannot achieve an…

Machine Learning · Computer Science 2023-12-29 Bo-Han Kung , Shang-Tse Chen

Square matrices appear in many machine learning problems and models. Optimization over a large square matrix is expensive in memory and in time. Therefore an economic approximation is needed. Conventional approximation approaches factorize…

Machine Learning · Computer Science 2021-09-20 Ruslan Khalitov , Tong Yu , Lei Cheng , Zhirong Yang

This paper presents a point-wise divergence-free projection method for numerical approximations of photonic quasicrystals problems. The original three-dimensional quasiperiodic Maxwell's system is transformed into a periodic one in higher…

Numerical Analysis · Mathematics 2024-09-10 Zixuan Gao , Zhenli Xu , Zhiguo Yang

For many applications in signal processing and machine learning, we are tasked with minimizing a large sum of convex functions subject to a large number of convex constraints. In this paper, we devise a new random projection method (RPM) to…

Optimization and Control · Mathematics 2024-04-08 Zhichun Yang , Fu-quan Xia , Kai Tu , Man-Chung Yue

Reduced graphene oxide (rGO) exhibits strong anisotropic light absorption and high compatibility with photonic integrated chips, making it a promising material for implementing high performance onchip polarization selective devices. The…

Polyhedral projection is a main operation of the polyhedron abstract domain.It can be computed via parametric linear programming (PLP), which is more efficient than the classic Fourier-Motzkin elimination method.In prior work, PLP was done…

Optimization and Control · Mathematics 2019-11-25 Hang Yu , David Monniaux

Discrete orthogonal matrices have several applications in information technology, such as in coding and cryptography. It is often challenging to generate discrete orthogonal matrices. A common approach widely in use is to discretize…

Discrete Mathematics · Computer Science 2021-08-26 Ka-Hou Chan , Wei Ke , Sio-Kei Im

In this paper, two 8-point multiplication-free DCT approximations based on the Chen's factorization are proposed and their fast algorithms are also derived. Both transformations are assessed in terms of computational cost, error energy, and…

Signal Processing · Electrical Eng. & Systems 2022-07-26 C. J. Tablada , T. L. T. da Silveira , R. J. Cintra , F. M. Bayer

In the context of Omni-Directional Image (ODI) Super-Resolution (SR), the unique challenge arises from the non-uniform oversampling characteristics caused by EquiRectangular Projection (ERP). Considerable efforts in designing complex…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Xuelin Shen , Yitong Wang , Silin Zheng , Kang Xiao , Wenhan Yang , Xu Wang

Convolutional Neural Networks (CNNs) have proven to be a powerful state-of-the-art method for image classification tasks. One drawback however is the high computational complexity and high memory consumption of CNNs which makes them…

Computer Vision and Pattern Recognition · Computer Science 2021-02-04 Rishabh Goyal , Joaquin Vanschoren , Victor van Acht , Stephan Nijssen

Correspondence problems are often modelled as quadratic optimization problems over permutations. Common scalable methods for approximating solutions of these NP-hard problems are the spectral relaxation for non-convex energies and the…

Graphics · Computer Science 2017-05-18 Nadav Dym , Haggai Maron , Yaron Lipman

Projected gradient descent has been proved efficient in many optimization and machine learning problems. The weighted $\ell_1$ ball has been shown effective in sparse system identification and features selection. In this paper we propose…

Machine Learning · Computer Science 2020-09-08 Guillaume Perez , Sebastian Ament , Carla Gomes , Michel Barlaud

We develop \emph{geometric optimisation} on the manifold of Hermitian positive definite (HPD) matrices. In particular, we consider optimising two types of cost functions: (i) geodesically convex (g-convex); and (ii) log-nonexpansive (LN).…

Functional Analysis · Mathematics 2018-06-04 Suvrit Sra , Reshad Hosseini

In constrained convex optimization, existing methods based on the ellipsoid or cutting plane method do not scale well with the dimension of the ambient space. Alternative approaches such as Projected Gradient Descent only provide a…

Optimization and Control · Mathematics 2021-11-11 Zakaria Mhammedi

Let $\mathcal{T}$ be a rooted and weighted tree, where the weight of any node is equal to the sum of the weights of its children. The popular Treemap algorithm visualizes such a tree as a hierarchical partition of a square into rectangles,…

Computational Geometry · Computer Science 2013-12-17 Mark de Berg , Krzysztof Onak , Anastasios Sidiropoulos

We present GOFMM (geometry-oblivious FMM), a novel method that creates a hierarchical low-rank approximation, "compression," of an arbitrary dense symmetric positive definite (SPD) matrix. For many applications, GOFMM enables an approximate…

Numerical Analysis · Computer Science 2017-07-04 Chenhan D. Yu , James Levitt , Severin Reiz , George Biros

The \emph{top-$k$-sum} operator computes the sum of the largest $k$ components of a given vector. The Euclidean projection onto the top-$k$-sum sublevel set serves as a crucial subroutine in iterative methods to solve composite…

Optimization and Control · Mathematics 2026-03-26 Jake Roth , Ying Cui