English
Related papers

Related papers: Reducing multi-dimensional information into a 1-d …

200 papers

Sufficient dimension reduction methods often require stringent conditions on the joint distribution of the predictor, or, when such conditions are not satisfied, rely on marginal transformation or reweighting to fulfill them approximately.…

Statistics Theory · Mathematics 2009-04-27 Bing Li , Yuexiao Dong

Randomized dimensionality reduction is a widely-used algorithmic technique for speeding up large-scale Euclidean optimization problems. In this paper, we study dimension reduction for a variety of maximization problems, including…

Data Structures and Algorithms · Computer Science 2025-06-03 Jie Gao , Rajesh Jayaram , Benedikt Kolbe , Shay Sapir , Chris Schwiegelshohn , Sandeep Silwal , Erik Waingarten

Using dimensional reduction we construct an effective 3D theory of the Minimal Supersymmetric Standard Model at finite temperature. The final effective theory is obtained after three successive stages of integration out of massive…

High Energy Physics - Phenomenology · Physics 2011-05-05 Marta Losada

Physical theories that depend on many parameters or are tested against data from many different experiments pose unique challenges to statistical inference. Many models in particle physics, astrophysics and cosmology fall into one or both…

We propose a modified, high-dimensional version of a recent dimension estimation procedure that determines the dimension via the introduction of augmented noise variables into the data. Our asymptotic results show that the proposal is…

Statistics Theory · Mathematics 2025-02-07 Una Radojicic , Joni Virta

The unprecedented prowess of measurement techniques provides a detailed, multi-scale look into the depths of living systems. Understanding these avalanches of high-dimensional data -- by distilling underlying principles and mechanisms --…

Other Quantitative Biology · Quantitative Biology 2021-08-16 Jean-Pierre Eckmann , Tsvi Tlusty

Many inverse problems in nuclear fusion and high-energy astrophysics research, such as the optimization of tokamak reactor geometries or the inference of black hole parameters from interferometric images, necessitate high-dimensional…

Machine Learning · Computer Science 2025-05-09 Jonathan Gorard , Ammar Hakim , Hong Qin , Kyle Parfrey , Shantenu Jha

We consider the problem of extracting a low-dimensional, linear latent variable structure from high-dimensional random variables. Specifically, we show that under mild conditions and when this structure manifests itself as a linear space…

Machine Learning · Statistics 2015-10-14 Xiongzhi Chen , John D. Storey

Previous studies have used numerical methods to optimize the hyperpolarizability of a one-dimensional quantum system. These studies were used to suggest properties of one-dimensional organic molecules, such as the degree of modulation of…

Optics · Physics 2015-05-18 Urszula B. Szafruga , Mark G. Kuzyk , David S. Watkins

We introduce an optimization technique to discriminate signal and background in any phenomeno- logical study based on the cut and count-based method. The core ideas behind this technique are the introduction of a ranking scheme that can…

High Energy Physics - Phenomenology · Physics 2026-05-19 Baradhwaj Coleppa , Gokul B. Krishna , Agnivo Sarkar , Sujay Shil

It is widely believed that one signal can carry maximum one bit of information, and minimum KTlog2 energy is required to transmit or to erase a bit. Here it is shown four bits of information can be transmitted by one signal in four…

General Physics · Physics 2007-05-23 Arindam Mitra

Modern data sets, such as those in healthcare and e-commerce, are often derived from many individuals or systems but have insufficient data from each source alone to separately estimate individual, often high-dimensional, model parameters.…

Machine Learning · Computer Science 2024-11-14 Maryann Rui , Thibaut Horel , Munther Dahleh

The description of complex physical phenomena often involves sophisticated models that rely on a large number of parameters, with many dimensions and scales. One practical way to simplify that kind of models is to discard some of the…

Soft Condensed Matter · Physics 2025-11-11 Simone Rusconi , Christina Schenk , Razvan Ceuca , Arghir Zarnescu , Elena Akhmatskaya

Denoising has always been theoretically considered as removal of high frequency disturbances having Gaussian distribution. Here we relax this assumption and the method used here is completely different from traditional thresholding schemes.…

Information Theory · Computer Science 2016-01-19 Vibhor Kumar , Jukka Heikkonen

We propose a two-sample test for high-dimensional means that requires neither distributional nor correlational assumptions, besides some weak conditions on the moments and tail properties of the elements in the random vectors. This…

Methodology · Statistics 2019-04-17 Kaijie Xue , Fang Yao

Principal component analysis continues to be a powerful tool in dimension reduction of high dimensional data. We assume a variance-diverging model and use the high-dimension, low-sample-size asymptotics to show that even though the…

Statistics Theory · Mathematics 2020-09-28 Sungkyu Jung

The scalability of statistical estimators is of increasing importance in modern applications. One approach to implementing scalable algorithms is to compress data into a low dimensional latent space using dimension reduction methods. In…

Machine Learning · Statistics 2015-04-14 Gregory Darnell , Stoyan Georgiev , Sayan Mukherjee , Barbara E Engelhardt

One of the most complex tasks of decision making and planning is to gather information. This task becomes even more complex when the state is high-dimensional and its belief cannot be expressed with a parametric distribution. Although the…

Artificial Intelligence · Computer Science 2022-09-26 Gilad Rotman , Vadim Indelman

The 21-cm forest, composed of spectral absorption features from high-redshift background radio sources, provides a unique probe for studying small-scale structures during the epoch of reionization. It is particularly sensitive to detecting…

Cosmology and Nongalactic Astrophysics · Physics 2025-09-11 Yue Shao , Tian-Yang Sun , Meng-Lin Zhao , Xin Zhang

This article considers a novel and widely applicable approach to modeling high-dimensional dependent data when a large number of explanatory variables are available and the signal-to-noise ratio is low. We postulate that a $p$-dimensional…

Methodology · Statistics 2024-12-09 Zhaoxing Gao , Ruey S. Tsay