English
Related papers

Related papers: Sufficient dimension reduction for classification …

200 papers

Stochastic Gradient Descent (SGD) is among the simplest and most popular methods in optimization. The convergence rate for SGD has been extensively studied and tight analyses have been established for the running average scheme, but the…

Optimization and Control · Mathematics 2021-06-29 Daogao Liu , Zhou Lu

Computing optimal transport (OT) for general high-dimensional data has been a long-standing challenge. Despite much progress, most of the efforts including neural network methods have been focused on the static formulation of the OT…

Machine Learning · Statistics 2025-03-12 Chen Xu , Xiuyuan Cheng , Yao Xie

This paper investigates the connection between neural networks and sufficient dimension reduction (SDR), demonstrating that neural networks inherently perform SDR in regression tasks under appropriate rank regularizations. Specifically, the…

Machine Learning · Statistics 2024-12-30 Shuntuo Xu , Zhou Yu

Forward uncertainty quantification in dynamical systems is challenging due to non-smooth or locally oscillating nonlinear behaviors. Spline dimensional decomposition (SDD) addresses such nonlinearity by partitioning input coordinates via…

Machine Learning · Statistics 2025-06-18 Yeonsu Kim , Junhan Lee , Bingran Wang , John T. Hwang , Dongjin Lee

Recent advancements in Direct Preference Optimization (DPO) have significantly enhanced the alignment of Large Language Models (LLMs) with human preferences, owing to its simplicity and effectiveness. However, existing methods typically…

Computation and Language · Computer Science 2024-10-28 Shilong Li , Yancheng He , Hui Huang , Xingyuan Bu , Jiaheng Liu , Hangyu Guo , Weixun Wang , Jihao Gu , Wenbo Su , Bo Zheng

Sufficient dimension reduction (SDR) is a valuable approach for handling high-dimensional data. Outer Product Gradient (OPG) is an popular approach. However, because of focusing the mean regression function, OPG may ignore some directions…

Methodology · Statistics 2024-07-31 Zheng Li , Chong Ding , Wei Gao

Optimal transport (OT) is a powerful geometric and probabilistic tool for finding correspondences and measuring similarity between two distributions. Yet, its original formulation relies on the existence of a cost function between the…

Machine Learning · Statistics 2020-11-09 Ievgen Redko , Titouan Vayer , Rémi Flamary , Nicolas Courty

Microtransit offers opportunities to enhance urban mobility by combining the reliability of public transit and the flexibility of ride-sharing. This paper optimizes the design and operations of a deviated fixed-route microtransit system…

Optimization and Control · Mathematics 2025-06-12 Bernardo Martin-Iradi , Alexandria Schmid , Kayla Cummings , Alexandre Jacquillat

Applications such as unbalanced and fully shuffled regression can be approached by optimizing regularized optimal transport (OT) distances, such as the entropic OT and Sinkhorn distances. A common approach for this optimization is to use a…

Numerical Analysis · Mathematics 2024-10-22 Xingjie Li , Fei Lu , Molei Tao , Felix X. -F. Ye

Semi-supervised learning provides an effective paradigm for leveraging unlabeled data to improve a model's performance. Among the many strategies proposed, graph-based methods have shown excellent properties, in particular since they allow…

Machine Learning · Statistics 2021-03-29 Mourad El Hamri , Younès Bennani

With the rapid development of data collection techniques, complex data objects that are not in the Euclidean space are frequently encountered in new statistical applications. Fr\'echet regression model (Peterson & M\"uller 2019) provides a…

Methodology · Statistics 2022-12-08 Qi Zhang , Lingzhou Xue , Bing Li

Optimization algorithms are pivotal in advancing various scientific and industrial fields but often encounter obstacles such as trapping in local minima, saddle points, and plateaus (flat regions), which makes the convergence to reasonable…

Optimization and Control · Mathematics 2026-01-15 Amir M. Vahedi , Horea T. Ilies

High-dimensional compositional data, such as those from human microbiome studies, pose unique statistical challenges due to the simplex constraint and excess zeros. While dimension reduction is indispensable for analyzing such data,…

Methodology · Statistics 2025-09-09 Junyoung Park , Cheolwoo Park , Jeongyoun Ahn

Optimal Transport, a theory for optimal allocation of resources, is widely used in various fields such as astrophysics, machine learning, and imaging science. However, many applications impose elementwise constraints on the transport plan…

Optimization and Control · Mathematics 2022-06-28 Zixuan Cang , Qing Nie , Yanxiang Zhao

In this paper, we address the problem of Domain Adaptation (DA) using Optimal Transport (OT) on Riemannian manifolds. We model the difference between two domains by a diffeomorphism and use the polar factorization theorem to claim that OT…

Machine Learning · Computer Science 2020-07-28 Or Yair , Felix Dietrich , Ronen Talmon , Ioannis G. Kevrekidis

Popularly used eigendecomposition-based criteria such as BIC type, ratio estimation and principal component-based criterion often underdetermine model dimensionality for regressions or the number of factors for factor models. This…

Statistics Theory · Mathematics 2016-08-17 Xuehu Zhu , Tao Wang , Lixing Zhu

To deploy machine learning models in the real world, researchers have proposed many OOD detection algorithms to help models identify unknown samples during the inference phase and prevent them from making untrustworthy predictions. Unlike…

Machine Learning · Computer Science 2025-02-25 Heng Gao , Zhuolin He , Jian Pu

This paper investigates the Sensor Network Localization (SNL) problem, which seeks to determine sensor locations based on known anchor locations and partially given anchors-sensors and sensors-sensors distances. Two primary methods for…

Optimization and Control · Mathematics 2023-08-09 Mingyu Lei , Jiayu Zhang , Yinyu Ye

In this study, an efficient reanalysis strategy for dynamic topology optimization is proposed. Compared with other related studies, an online successive dynamic reanalysis method and POD-based approximate dynamic displacement strategy are…

Numerical Analysis · Mathematics 2023-05-16 Shuhao Li , Hu Wang , Jichao Yin , Daozhen Guo , Guangyao Li

We introduce a formulation of optimal transport problem for distributions on function spaces, where the stochastic map between functional domains can be partially represented in terms of an (infinite-dimensional) Hilbert-Schmidt operator…

Machine Learning · Statistics 2023-08-29 Jiacheng Zhu , Aritra Guha , Dat Do , Mengdi Xu , XuanLong Nguyen , Ding Zhao