English
Related papers

Related papers: Dataset-Adaptive Dimensionality Reduction

200 papers

To overcome the curses of dimensionality and modeling of Dynamic Programming (DP) methods to solve Markov Decision Process (MDP) problems, Reinforcement Learning (RL) methods are adopted in practice. Contrary to traditional RL algorithms…

Machine Learning · Computer Science 2021-08-24 Arghyadip Roy , Vivek Borkar , Abhay Karandikar , Prasanna Chaporkar

Dimension reduction (DR) is commonly utilized to capture the intrinsic structure and transform high-dimensional data into low-dimensional space while retaining meaningful properties of the original data. It is used in various applications,…

Machine Learning · Computer Science 2022-11-29 Zelin Zang , Shenghui Cheng , Linyan Lu , Hanchen Xia , Liangyu Li , Yaoting Sun , Yongjie Xu , Lei Shang , Baigui Sun , Stan Z. Li

In image Super-Resolution (SR), relying on large datasets for training is a double-edged sword. While offering rich training material, they also demand substantial computational and storage resources. In this work, we analyze dataset…

Image and Video Processing · Electrical Eng. & Systems 2024-06-11 Brian B. Moser , Federico Raue , Andreas Dengel

In this work, we address a foundational question in the theoretical analysis of the Deep Ritz Method (DRM) under the over-parameteriztion regime: Given a target precision level, how can one determine the appropriate number of training…

Numerical Analysis · Mathematics 2024-07-15 Yuling Jiao , Ruoxuan Li , Peiying Wu , Jerry Zhijian Yang , Pingwen Zhang

Dimensionality reduction (DR) is an important technique for data exploration and knowledge discovery. However, most of the main DR methods are either linear (e.g., PCA), do not provide an explicit mapping between the original data and its…

Neural and Evolutionary Computing · Computer Science 2022-03-15 Thomas Uriot , Marco Virgolin , Tanja Alderliesten , Peter Bosman

Dimensionality Reduction (DR) techniques are commonly used for the visual exploration and analysis of high-dimensional data due to their ability to project datasets of high-dimensional points onto the 2D plane. However, projecting datasets…

Machine Learning · Computer Science 2025-11-19 Jaume Ros , Alessio Arleo , Fernando Paulovich

We first show that the commonly used dimensionality reduction (DR) methods such as t-SNE and LargeVis poorly capture the global structure of the data in the low dimensional embedding. We show this via a number of tests for the DR methods…

Machine Learning · Computer Science 2018-03-05 Ehsan Amid , Manfred K. Warmuth

We conduct a theoretical study of various solution methods for the adaptive fractionation problem. The two messages of this paper are: (i) dynamic programming (DP) is a useful framework for adaptive radiation therapy, particularly adaptive…

Medical Physics · Physics 2012-02-16 Jagdish Ramakrishnan , David Craft , Thomas Bortfeld , John N. Tsitsiklis

Complex design problems are common in the scientific and industrial fields. In practice, objective functions or constraints of these problems often do not have explicit formulas, and can be estimated only at a set of sampling points through…

Optimization and Control · Mathematics 2022-10-12 Lulu Zhang , Zhi-Qin John Xu , Yaoyu Zhang

Real-world datasets are often of high dimension and effected by the curse of dimensionality. This hinders their comprehensibility and interpretability. To reduce the complexity feature selection aims to identify features that are crucial to…

Machine Learning · Computer Science 2023-04-18 Maximilian Stubbemann , Tobias Hille , Tom Hanika

In this work we show that the classification performance of high-dimensional structural MRI data with only a small set of training examples is improved by the usage of dimension reduction methods. We assessed two different dimension…

Machine Learning · Computer Science 2015-05-27 Andreas Grünauer , Markus Vincze

Due to the lack of a large-scale reflection removal dataset with diverse real-world scenes, many existing reflection removal methods are trained on synthetic data plus a small amount of real-world data, which makes it difficult to evaluate…

Computer Vision and Pattern Recognition · Computer Science 2021-08-10 Chenyang Lei , Xuhua Huang , Chenyang Qi , Yankun Zhao , Wenxiu Sun , Qiong Yan , Qifeng Chen

An analysis of high-dimensional data can offer a detailed description of a system but is often challenged by the curse of dimensionality. General dimensionality reduction techniques can alleviate such difficulty by extracting a few…

Methodology · Statistics 2021-09-28 Di Bo , Hoon Hwangbo , Vinit Sharma , Corey Arndt , Stephanie C. TerMaath

In this work, we study distance metric learning (DML) for high dimensional data. A typical approach for DML with high dimensional data is to perform the dimensionality reduction first before learning the distance metric. The main…

Machine Learning · Computer Science 2015-09-16 Qi Qian , Rong Jin , Lijun Zhang , Shenghuo Zhu

We explore two primary classes of approaches to dimensionality reduction (DR): Independent Dimensionality Reduction (IDR) and Simultaneous Dimensionality Reduction (SDR). In IDR methods, of which Principal Components Analysis is a…

Machine Learning · Statistics 2024-10-28 Eslam Abdelaleem , Ahmed Roman , K. Michael Martini , Ilya Nemenman

We propose a new randomized optimization method for high-dimensional problems which can be seen as a generalization of coordinate descent to random subspaces. We show that an adaptive sampling strategy for the random subspace significantly…

Optimization and Control · Mathematics 2019-12-19 Jonathan Lacotte , Mert Pilanci , Marco Pavone

The learning inefficiency of reinforcement learning (RL) from scratch hinders its practical application towards continuous robotic tracking control, especially for high-dimensional robots. This work proposes a data-informed residual…

Systems and Control · Electrical Eng. & Systems 2024-06-10 Cong Li , Fangzhou Liu , Yongchao Wang , Martin Buss

Dimensionality reduction (DR) algorithms compress high-dimensional data into a lower dimensional representation while preserving important features of the data. DR is a critical step in many analysis pipelines as it enables visualisation,…

Machine Learning · Statistics 2023-05-26 Aditya Ravuri , Francisco Vargas , Vidhi Lalchand , Neil D. Lawrence

Large high-dimensional datasets are becoming more and more popular in an increasing number of research areas. Processing the high dimensional data incurs a high computational cost and is inherently inefficient since many of the values that…

Computer Vision and Pattern Recognition · Computer Science 2013-05-01 Alon Schclar

Dataset distillation, a training-aware data compression technique, has recently attracted increasing attention as an effective tool for mitigating costs of optimization and data storage. However, progress remains largely empirical.…

Machine Learning · Computer Science 2026-03-31 Yuri Kinoshita , Naoki Nishikawa , Taro Toyoizumi