English
Related papers

Related papers: High-Dimensional Importance-Weighted Information C…

200 papers

In this paper, we propose a new Soft Confidence-Weighted (SCW) online learning scheme, which enables the conventional confidence-weighted learning method to handle non-separable cases. Unlike the previous confidence-weighted learning…

Machine Learning · Computer Science 2012-06-22 Jialei Wang , Peilin Zhao , Steven C. H. Hoi

Greedy algorithms, particularly the orthogonal greedy algorithm (OGA), have proven effective in training shallow neural networks for fitting functions and solving partial differential equations (PDEs). In this paper, we extend the…

Numerical Analysis · Mathematics 2025-01-07 Ye Lin , Jiwei Jia , Young Ju Lee , Ran Zhang

Information divergence that measures the difference between two nonnegative matrices or tensors has found its use in a variety of machine learning problems. Examples are Nonnegative Matrix/Tensor Factorization, Stochastic Neighbor…

Machine Learning · Computer Science 2014-06-06 Onur Dikmen , Zhirong Yang , Erkki Oja

Decisions under uncertainty or with multiple objectives usually require the decision maker to formulate a preference regarding risks or trade-offs. If this preference is known, the ordered weighted averaging (OWA) criterion can be applied…

Optimization and Control · Mathematics 2023-08-02 Werner Baak , Marc Goerigk , Michael Hartisch

We study the fundamental problem of selecting optimal features for model construction. This problem is computationally challenging on large datasets, even with the use of greedy algorithm variants. To address this challenge, we extend the…

A crucial task for a randomized controlled trial (RCT) is to specify a statistical method that can yield an efficient estimator and powerful test for the treatment effect. A novel and effective strategy to obtain efficient and powerful…

The generalized linear models (GLMs) are widely used in statistical analysis and the related design issues are undoubtedly challenging. The state-of-the-art works mostly apply to design criteria on the estimates of regression coefficients.…

Methodology · Statistics 2020-04-21 Yiou Li , Xinwei Deng

Covariate shift relaxes the widely-employed independent and identically distributed (IID) assumption by allowing different training and testing input distributions. Unfortunately, common methods for addressing covariate shift by trying to…

Machine Learning · Computer Science 2018-01-02 Anqi Liu , Brian D. Ziebart

The recent paper by Byrd & Lipton (2019), based on empirical observations, raises a major concern on the impact of importance weighting for the over-parameterized deep learning models. They observe that as long as the model can separate the…

Machine Learning · Computer Science 2021-03-30 Da Xu , Yuting Ye , Chuanwei Ruan

Comparing structured data from possibly different metric-measure spaces is a fundamental task in machine learning, with applications in, e.g., graph classification. The Gromov-Wasserstein (GW) discrepancy formulates a coupling between the…

Machine Learning · Computer Science 2022-07-12 Hongwei Jin , Zishun Yu , Xinhua Zhang

Due to its speed and simplicity, subgradient descent is one of the most used optimization algorithms in convex machine learning algorithms. However, tuning its learning rate is probably its most severe bottleneck to achieve consistent good…

Machine Learning · Computer Science 2023-07-25 Keyi Chen , Francesco Orabona

In this paper a class of combinatorial optimization problems with uncertain costs is discussed. The uncertainty is modeled by specifying a discrete scenario set containing $K$ distinct cost scenarios. The Ordered Weighted Averaging (OWA for…

Data Structures and Algorithms · Computer Science 2014-11-17 Adam Kasperski , Pawel Zielinski

Meta-learning has been proposed as a promising machine learning topic in recent years, with important applications to image classification, robotics, computer games, and control systems. In this paper, we study the problem of using…

Systems and Control · Electrical Eng. & Systems 2024-05-28 Yunian Pan , Quanyan Zhu

In this paper, we initiate the study of the weighted paging problem with predictions. This continues the recent line of work in online algorithms with predictions, particularly that of Lykouris and Vassilvitski (ICML 2018) and Rohatgi (SODA…

Data Structures and Algorithms · Computer Science 2020-06-18 Zhihao Jiang , Debmalya Panigrahi , Kevin Sun

Covariate balance is crucial in obtaining unbiased estimates of treatment effects in observational studies. Methods based on inverse probability weights have been widely used to estimate treatment effects with observational data. Machine…

Methodology · Statistics 2021-04-08 Michele Santacatterina

Let $G$ be an undirected bipartite graph with positive integer weights on the edges. We refine the existing decomposition theorem originally proposed by Kao et al., for computing maximum weight bipartite matching. We apply it to design an…

Discrete Mathematics · Computer Science 2019-12-11 Shibsankar Das

A key feature of determinantal sampling designs is their capacity to provide known and parametrisable inclusion probabilities at any order. This paper aims to demonstrate how to effectively leverage this characteristic, highlighting its…

Methodology · Statistics 2025-08-27 Vincent Loons

In this work, we consider the problem of imbalanced data in a regression framework when the imbalanced phenomenon concerns continuous or discrete covariates. Such a situation can lead to biases in the estimates. In this case, we propose a…

Machine Learning · Statistics 2023-02-21 Samuel Stocksieker , Denys Pommeret , Arthur Charpentier

We build the time series of optimal realized portfolio weights from high-frequency data and we suggest a novel Dynamic Conditional Weights (DCW) model for their dynamics. DCW is benchmarked against popular model-based and model-free…

Statistical Finance · Quantitative Finance 2020-04-28 Fabrizio Cipollini , Giampiero M. Gallo , Alessandro Palandri

Meta-learning has been proposed as a promising machine learning topic in recent years, with important applications to image classification, robotics, computer games, and control systems. In this paper, we study the problem of using…

Systems and Control · Electrical Eng. & Systems 2025-03-04 Yunian Pan , Tao Li , Quanyan Zhu