English
Related papers

Related papers: TELET: A Monotonic Algorithm to Design Large Dimen…

200 papers

We introduce the first learning-based dense matching algorithm, termed Equirectangular Projection-Oriented Dense Kernelized Feature Matching (EDM), specifically designed for omnidirectional images. Equirectangular projection (ERP) images,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-03 Dongki Jung , Jaehoon Choi , Yonghan Lee , Somi Jeong , Taejae Lee , Dinesh Manocha , Suyong Yeon

Deep neural networks (DNN) have shown remarkable success in a variety of machine learning applications. The capacity of these models (i.e., number of parameters), endows them with expressive power and allows them to reach the desired…

Machine Learning · Computer Science 2022-04-12 Arturo Marban , Daniel Becking , Simon Wiedemann , Wojciech Samek

An equiangular tight frame (ETF) is a finite sequence of equal norm vectors in a Hilbert space that achieves equality in the Welch bound, and so has minimal coherence. The binder of an ETF is the set of all subsets of its indices whose…

Functional Analysis · Mathematics 2025-07-22 Matthew Fickus , Evan C. Lake

Ternary quantization has emerged as a powerful technique for reducing both computational and memory footprint of large language models (LLM), enabling efficient real-time inference deployment without significantly compromising model…

Hardware Architecture · Computer Science 2025-09-18 Zhirui Huang , Rui Ma , Shijie Cao , Ran Shu , Ian Wang , Ting Cao , Chixiao Chen , Yongqiang Xiong

We study several interesting examples of Biangular Tight Frames (BTFs) - basis-like sets of unit vectors admitting exactly two distinct frame angles (ie, pairwise absolute inner products) - and examine their relationships with Equiangular…

Functional Analysis · Mathematics 2017-03-17 John I. Haas , Jameson Cahill , Janet Tremain , Peter G. Casazza

Parameter-efficient fine-tuning (PEFT) has become a popular way to adapt large pre-trained models to new tasks. Most PEFT methods update only a small subset of parameters while freezing the rest, avoiding redundant computation. As they…

Machine Learning · Computer Science 2025-08-25 Sungmin Kang , Jisoo Kim , Salman Avestimehr , Sunwoo Lee

In this paper, we develop a novel procedure for low-rank tensor regression, namely \emph{\underline{I}mportance \underline{S}ketching \underline{L}ow-rank \underline{E}stimation for \underline{T}ensors} (ISLET). The central idea behind…

Machine Learning · Statistics 2020-05-11 Anru Zhang , Yuetian Luo , Garvesh Raskutti , Ming Yuan

An equiangular tight frame (ETF) is a sequence of vectors in a Hilbert space that achieves equality in the Welch bound and so has minimal coherence. More generally, an equichordal tight fusion frame (ECTFF) is a sequence of equi-dimensional…

Functional Analysis · Mathematics 2021-05-11 Matthew Fickus , Joseph W. Iverson , John Jasper , Emily J. King

A computationally efficient method is presented for approximate optimization of cutting pattern of frame-supported and pneumatic membrane structures. The plane cutting sheet is generated by minimizing the error from the shape obtained by…

Optimization and Control · Mathematics 2017-12-14 Makoto Ohsaki , Jun Fujiwara , Fumiyoshi Takeda

We consider a randomised implementation of the finite element method (FEM) for elliptic partial differential equations on high-dimensional models. This is motivated by applications where model predictions are essential for real-time process…

Numerical Analysis · Mathematics 2019-07-30 Yue Wu , Dimitris Kamilis , Nick Polydorides

In this paper, we develop a framework to design sensing matrices for compressive sensing applications that lead to good mean squared error (MSE) performance subject to sensing cost constraints. By capitalizing on the MSE of the oracle…

Information Theory · Computer Science 2021-01-28 Wei Chen , Miguel R. D. Rodrigues , Ian Wassell

As large language models (LLMs) become more prevalent, there is a growing need for new and improved quantization methods that can meet the computationalast layer demands of these modern architectures while maintaining the accuracy. In this…

Computation and Language · Computer Science 2023-10-18 Wenhua Cheng , Yiyang Cai , Kaokao Lv , Haihao Shen

In this research, we propose a new low-precision framework, TENT, to leverage the benefits of a tapered fixed-point numerical format in TinyML models. We introduce a tapered fixed-point quantization algorithm that matches the numerical…

Machine Learning · Computer Science 2021-04-07 Hamed F. Langroudi , Vedant Karia , Tej Pandit , Dhireesha Kudithipudi

Tactile sensing is fundamental to robotic systems, enabling interactions through physical contact in multiple tasks. Despite its importance, achieving high-resolution, large-area tactile sensing remains challenging. Electrical Impedance…

Robotics · Computer Science 2025-09-18 Huazhi Dong , Ronald B. Liu , Sihao Teng , Delin Hu , Peisan , E , Francesco Giorgio-Serchi , Yunjie Yang

In this paper, we propose a new approach -- the Tempered Finite Element Method (TFEM) -- that extends the Finite Element Method (FEM) to classes of meshes that include zero-measure or nearly degenerate elements for which standard FEM…

Numerical Analysis · Mathematics 2024-11-27 Antoine Quiriny , Václav Kučera , Jonathan Lambrechts , Nicolas Moës , Jean-François Remacle

Dropout is a popular regularization technique in deep learning. Yet, the reason for its success is still not fully understood. This paper provides a new interpretation of Dropout from a frame theory perspective. By drawing a connection to…

Machine Learning · Computer Science 2020-08-20 Dor Bank , Raja Giryes

In big data applications, classical ensemble learning is typically infeasible on the raw input data and dimensionality reduction techniques are necessary. To this end, novel framework that generalises classic flat-view ensemble learning to…

Signal Processing · Electrical Eng. & Systems 2018-12-18 Ilia Kisil , Ahmad Moniri , Danilo P. Mandic

In this work, we show that a complex equiangular tight frame (ETF) composed by $N$ vectors in dimension $d$ exists if and only if a certain bistochastic matrix, univocally determined by $N$ and $d$, belongs to a special class of…

Mathematical Physics · Physics 2017-06-07 Dardo Goyeneche , Ondrej Turek

Turbulence mitigation (TM) is highly ill-posed due to the stochastic nature of atmospheric turbulence. Most methods rely on multiple frames recorded by conventional cameras to capture stable patterns in natural scenarios. However, they…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Xiaoran Zhang , Jian Ding , Yuxing Duan , Haoyue Liu , Gang Chen , Yi Chang , Luxin Yan

This work proposes the extended functional tensor train (EFTT) format for compressing and working with multivariate functions on tensor product domains. Our compression algorithm combines tensorized Chebyshev interpolation with a low-rank…

Numerical Analysis · Mathematics 2024-05-30 Christoph Strössner , Bonan Sun , Daniel Kressner