English
Related papers

Related papers: Machine Learning Techniques for Data Reduction of …

200 papers

Transformer architectures have achieved remarkable success across language, vision, and multimodal tasks, and there is growing demand for them to address in-context compositional learning tasks. In these tasks, models solve the target…

Machine Learning · Computer Science 2025-11-26 Wei Chen , Jingxi Yu , Zichen Miao , Qiang Qiu

Matched filtering for signal detection in noisy data requires template banks that capture variation in signal waveforms while minimizing computational cost. Dimensionality reduction of signal waveforms can be important for building…

General Relativity and Quantum Cosmology · Physics 2025-11-20 Giovanni Cabass , Digvijay Wadekar , Matias Zaldarriaga , Zihan Zhou

The transfer of tensors from/to memory during neural network training dominates time and energy. To improve energy efficiency and performance, research has been exploring ways to use narrower data representations. So far, these attempts…

The ability to reconstruct fine-grained network session data, including individual packets, from coarse-grained feature vectors is crucial for improving network security models. However, the large-scale collection and storage of raw network…

Machine Learning · Computer Science 2025-04-16 Mark Cheung , Sridhar Venkatesan

We consider the tensor completion problem of predicting the missing entries of a tensor. The commonly used CP model has a triple product form, but an alternate family of quadratic models, which are the sum of pairwise products instead of a…

Machine Learning · Computer Science 2023-08-01 Hongyang R. Zhang , Vatsal Sharan , Moses Charikar , Yingyu Liang

Many machine learning models use the manipulation of dimensions as a driving force to enable models to identify and learn important features in data. In the case of sequential data this manipulation usually happens on the token dimension…

Machine Learning · Computer Science 2023-10-24 Daniel Biermann , Fabrizio Palumbo , Morten Goodwin , Ole-Christoffer Granmo

CFD is widely used in physical system design and optimization, where it is used to predict engineering quantities of interest, such as the lift on a plane wing or the drag on a motor vehicle. However, many systems of interest are…

Fluid thermodynamics underpins atmospheric dynamics, climate science, industrial applications, and energy systems. However, direct numerical simulations (DNS) of such systems can be computationally prohibitive. To address this, we present a…

Fluid Dynamics · Physics 2026-02-11 Luca Menicali , Andrew Grace , David H. Richter , Stefano Castruccio

Spectral compressive imaging (SCI) is able to encode the high-dimensional hyperspectral image to a 2D measurement, and then uses algorithms to reconstruct the spatio-spectral data-cube. At present, the main bottleneck of SCI is the…

Image and Video Processing · Electrical Eng. & Systems 2023-07-04 Lishun Wang , Zongliang Wu , Yong Zhong , Xin Yuan

Topological data analysis (TDA) has emerged as one of the most promising techniques to reconstruct the unknown shapes of high-dimensional spaces from observed data samples. TDA, thus, yields key shape descriptors in the form of persistent…

Machine Learning · Statistics 2017-11-15 Wei Guo , Krithika Manohar , Steven L. Brunton , Ashis G. Banerjee

Artificial Neural Networks (ANNs) require significant amounts of data and computational resources to achieve high effectiveness in performing the tasks for which they are trained. To reduce resource demands, various techniques, such as…

Neural and Evolutionary Computing · Computer Science 2024-12-04 A. Stolarek , W. Jaworek

The CP decomposition for high dimensional non-orthogonal spiked tensors is an important problem with broad applications across many disciplines. However, previous works with theoretical guarantee typically assume restrictive incoherence…

Machine Learning · Statistics 2022-09-20 Yuefeng Han , Cun-Hui Zhang

This paper proposes a supervised dimension reduction methodology for tensor data which has two advantages over most image-based prognostic models. First, the model does not require tensor data to be complete which expands its application to…

Machine Learning · Computer Science 2023-06-06 Chengyu Zhou , Xiaolei Fang

The widespread use of multisensor technology and the emergence of big data sets have brought the necessity to develop more versatile tools to represent higher-order data with multiple aspects and high dimensionality. Data in the form of…

Signal Processing · Electrical Eng. & Systems 2018-06-27 Ali Zare , Alp Ozdemir , Mark A. Iwen , Selin Aviyente

In learning-based approaches to image compression, codecs are developed by optimizing a computational model to minimize a rate-distortion objective. Currently, the most effective learned image codecs take the form of an entropy-constrained…

Image and Video Processing · Electrical Eng. & Systems 2020-07-20 David Minnen , Saurabh Singh

Autoencoders are a widespread tool in machine learning to transform high-dimensional data into a lowerdimensional representation which still exhibits the essential characteristics of the input. The encoder provides an embedding from the…

Machine Learning · Computer Science 2021-04-28 Juliane Braunsmann , Marko Rajković , Martin Rumpf , Benedikt Wirth

In this work, we describe a new data-driven approach for inverse problems that exploits technologies from machine learning, in particular autoencoder network structures. We consider a paired autoencoder framework, where two autoencoders are…

Machine Learning · Computer Science 2025-01-27 Emma Hart , Julianne Chung , Matthias Chung

Large-scale numerical simulations often produce high-dimensional gridded data that is challenging to process for downstream applications. A prime example is numerical weather prediction, where atmospheric processes are modeled using…

Machine Learning · Computer Science 2025-02-10 Jieyu Chen , Kevin Höhlein , Sebastian Lerch

Variational auto-encoder frameworks have demonstrated success in reducing complex nonlinear dynamics in molecular simulation to a single non-linear embedding. In this work, we illustrate how this non-linear latent embedding can be used as a…

Machine Learning · Statistics 2018-01-03 Mohammad M. Sultan , Hannah K. Wayment-Steele , Vijay S. Pande

With the great progress of 3D sensing and acquisition technology, the volume of point cloud data has grown dramatically, which urges the development of efficient point cloud compression methods. In this paper, we focus on the task of…

Machine Learning · Computer Science 2024-10-24 Kai Liu , Kang You , Pan Gao , Manoranjan Paul