English
Related papers

Related papers: FC2T2: The Fast Continuous Convolutional Taylor Tr…

200 papers

Recent studies of the computational power of recurrent neural networks (RNNs) reveal a hierarchy of RNN architectures, given real-time and finite-precision assumptions. Here we study auto-regressive Transformers with linearised attention,…

Machine Learning · Computer Science 2023-10-26 Kazuki Irie , Róbert Csordás , Jürgen Schmidhuber

Fluorescence molecular tomography (FMT) is a sensitive optical imaging technology widely used in biomedical research. However, the ill-posedness of the inverse problem poses a huge challenge to FMT reconstruction. Although end-to-end deep…

Image and Video Processing · Electrical Eng. & Systems 2025-03-18 Peng Zhang , Qianqian Xue , Xingyu Liu , Guanglei Zhang , Wenjian Wang , Jiye Liang

Deep learning algorithms provide a new paradigm to study high-dimensional dynamical behaviors, such as those in fusion plasma systems. Development of novel model reduction methods, coupled with detection of abnormal modes with plasma…

Computational Physics · Physics 2024-04-29 Zhe Bai , Xishuo Wei , William Tang , Leonid Oliker , Zhihong Lin , Samuel Williams

Filtered back projection (FBP) is a commonly used technique in tomographic image reconstruction demonstrating acceptable quality. The classical direct implementations of this algorithm require the execution of $\Theta(N^3)$ operations,…

Image and Video Processing · Electrical Eng. & Systems 2020-07-14 Anastasiya Dolmatova , Marina Chukalina , Dmitry Nikolaev

Adapting Foundation Models (FMs) for downstream tasks through Federated Learning (FL) emerges a promising strategy for protecting data privacy and valuable FMs. Existing methods fine-tune FM by allocating sub-FM to clients in FL, however,…

Machine Learning · Computer Science 2024-04-30 Zhaopeng Peng , Xiaoliang Fan , Yufan Chen , Zheng Wang , Shirui Pan , Chenglu Wen , Ruisheng Zhang , Cheng Wang

We consider finite approximations of a fractal generated by an iterated function system of affine transformations on $\mathbb{R}^d$ as a discrete set of data points. Considering a signal supported on this finite approximation, we propose a…

Functional Analysis · Mathematics 2016-07-14 Calvin Hotchkiss , Eric S. Weber

In the first part of this paper, we define a deep convolutional neural network connected with the fractional Fourier transform (FrFT) using the $\theta$-translation operator, the translation operator associated with the FrFT. Subsequently,…

Functional Analysis · Mathematics 2024-08-14 M. H. A. Biswas , P. Massopust , R. Ramakrishnan

The Fast Proximal Gradient Method (FPGM) and the Monotone FPGM (MFPGM) for minimization of nonsmooth convex functions are introduced and applied to tomographic image reconstruction. Convergence properties of the sequence of objective…

Optimization and Control · Mathematics 2020-08-25 Elias S. Helou , Marcelo V. W. Zibetti , Gabor T. Herman

Recent medical image segmentation methods apply implicit neural representation (INR) to the decoder for achieving a continuous coordinate decoding to tackle the drawback of conventional discrete grid-based data representations. However, the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Jiahao Yu , Li Chen

Click-through rate (CTR) prediction plays a critical role in recommender systems and online advertising. The data used in these applications are multi-field categorical data, where each feature belongs to one field. Field information is…

Information Retrieval · Computer Science 2021-03-22 Yang Sun , Junwei Pan , Alex Zhang , Aaron Flores

Kernel methods are a highly effective and widely used collection of modern machine learning algorithms. A fundamental limitation of virtually all such methods are computations involving the kernel matrix that naively scale quadratically…

Machine Learning · Computer Science 2021-06-09 John Paul Ryan , Sebastian Ament , Carla P. Gomes , Anil Damle

In this paper, we develop novel techniques that can be used to alter the architecture of a neural network, while maintaining the function it represents. Such operations are known as function preserving transforms and have proven useful in…

Machine Learning · Computer Science 2024-10-16 Michael Painter

The emergence of extremely large-scale antenna arrays (ELAA) in millimeter-wave (mmWave) communications, particularly in high-mobility scenarios, highlights the importance of near-field beam prediction. Unlike the conventional far-field…

Signal Processing · Electrical Eng. & Systems 2025-10-28 Wang Liu , Cunhua Pan , Hong Ren , Wei Zhang , Cheng-Xiang Wang , Jiangzhou Wang

The use of integral equation methods for the efficient numerical solution of PDE boundary value problems requires two main tools: quadrature rules for the evaluation of layer potential integral operators with singular kernels, and fast…

Numerical Analysis · Mathematics 2017-06-28 Manas Rachh , Andreas Klöckner , Michael O'Neil

Tucker decomposition is proposed to reduce the memory requirement of the far-fields in the fast multipole method (FMM)-accelerated surface integral equation simulators. It is particularly used to compress the far-fields of FMM groups, which…

Computational Physics · Physics 2021-04-09 Cheng Qian , Mingyu Wang , Abdulkadir C. Yucel

We present techniques for speeding up the test-time evaluation of large convolutional networks, designed for object recognition tasks. These models deliver impressive accuracy but each image evaluation requires millions of floating point…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Remi Denton , Wojciech Zaremba , Joan Bruna , Yann LeCun , Rob Fergus

We develop a fast and accurate method for 3D alignment, recovering the rotation and translation that best align a reference volume with a noisy observation. Classical matched filtering evaluates cross-correlation over a large discretized…

Signal Processing · Electrical Eng. & Systems 2026-03-17 Fabian Kruse , Valentin Debarnot , Vinith Kishore , Ivan Dokmanić

Despite recent advances in multi-scale deep representations, their limitations are attributed to expensive parameters and weak fusion modules. Hence, we propose an efficient approach to fuse multi-scale deep representations, called…

Computer Vision and Pattern Recognition · Computer Science 2016-11-18 Yu Liu , Yanming Guo , Michael S. Lew

The nonlinear Fourier transform (NFT) has recently gained significant attention in fiber optic communications and other engineering fields. Although several numerical algorithms for computing the NFT have been published, the design of…

Signal Processing · Electrical Eng. & Systems 2019-10-17 Shrinivas Chimmalgi , Peter J. Prins , Sander Wahls

Non-line-of-Sight (NLOS) imaging systems collect light at a diffuse relay surface and input this measurement into computational algorithms that output a 3D volumetric reconstruction. These algorithms utilize the Fast Fourier Transform (FFT)…

Image and Video Processing · Electrical Eng. & Systems 2025-01-14 Talha Sultan , Alex Bocchieri , Chaoying Gu , Xiaochun Liu , Pavel Polynkin , Andreas Velten