English
Related papers

Related papers: The only admissible way of merging arbitrary e-val…

200 papers

In this work, we explore the limitations of combining models by averaging intermediate features, referred to as model merging, and propose a new direction for achieving collective model intelligence through what we call compatible…

Machine Learning · Computer Science 2024-11-05 Jyothish Pari , Samy Jelassi , Pulkit Agrawal

The rate of uniform convergence in extreme value statistics is non-universal and can be arbitrarily slow. Further, the relative error can be unbounded in the tail of the approximation, leading to difficulty in extrapolating the extreme…

Statistics Theory · Mathematics 2014-12-05 Ashivni Shekhawat

This paper proposes the first distributed algorithm that solves the weight-balancing problem using only finite rate and simplex communications among nodes, compliant with the directed nature of the graph edges. It is proved that the…

Optimization and Control · Mathematics 2020-03-03 Chang-Shen Lee , Nicolò Michelusi , Gesualdo Scutari

We propose a methodology for computing single and multi-asset European option prices, and more generally expectations of scalar functions of (multivariate) random variables. This new approach combines the ability of Monte Carlo simulation…

Computational Finance · Quantitative Finance 2019-10-21 Damir Filipović , Kathrin Glau , Yuji Nakatsukasa , Francesco Statti

One of the most important aspects in any treatment of uncertain information is the rule of combination for updating the degrees of uncertainty. The theory of belief functions uses the Dempster rule to combine two belief functions defined by…

Artificial Intelligence · Computer Science 2013-04-05 Michael S. K. M. Wong , P. Lingras

Linear combination is a potent data fusion method in information retrieval tasks, thanks to its ability to adjust weights for diverse scenarios. However, achieving optimal weight training has traditionally required manual relevance…

Information Retrieval · Computer Science 2023-09-25 Qiuyu Xu , Yidong Huang , Shengli Wu , Adrian Moore

Given that distributed systems face adversarial behaviors such as eavesdropping and cyberattacks, how to ensure the evidence fusion result is credible becomes a must-be-addressed topic. Different from traditional research that assumes nodes…

Cryptography and Security · Computer Science 2024-12-10 Chaoxiong Ma , Yan Liang

Model merging aims to combine multiple task-specific expert models into a single model without joint retraining, offering a practical alternative to multi-task learning when data access or computational budget is limited. Existing methods,…

Machine Learning · Computer Science 2026-05-14 Kaiyang Li , Shaobo Han , Qing Su , Shihao Ji

Normal mean-variance mixture distributions are widely applied to simplify a model's implementation and improve their computational efficiency under the Maximum Likelihood (ML) approach. Especially for distributions with normal mean-variance…

Methodology · Statistics 2015-06-18 Thanakorn Nitithumbundit , Jennifer S. K. Chan

Variable selection in cluster analysis is important yet challenging. It can be achieved by regularization methods, which realize a trade-off between the clustering accuracy and the number of selected variables by using a lasso-type penalty.…

Methodology · Statistics 2016-12-23 Marbac Matthieu , Sedki Mohammed

This work unifies the analysis of various randomized methods for solving linear and nonlinear inverse problems by framing the problem in a stochastic optimization setting. By doing so, we show that many randomized methods are variants of a…

Numerical Analysis · Mathematics 2023-06-21 Jonathan Wittmer , C. G. Krishnanunni , Hai V. Nguyen , Tan Bui-Thanh

Conditional ceteris paribus preference networks (CP-nets) are commonly used to capture qualitative conditional preferences. In many use cases, when the preferential structure of an agent is incomplete, information from other preferential…

Multiagent Systems · Computer Science 2021-09-22 Stijn Henckens , Mostafa Mohajeri Parizi , Giovanni Sileno

We present a new model-based integrative method for clustering objects given both vectorial data, which describes the feature of each object, and network data, which indicates the similarity of connected objects. The proposed general model…

Machine Learning · Statistics 2017-10-25 Yunchuan Kong , Xiaodan Fan

The algorithm of Gutwenger et al. to insert an edge $e$ in linear time into a planar graph $G$ with a minimal number of crossings on $e$, is a helpful tool for designing heuristics that minimize edge crossings in drawings of general graphs.…

Data Structures and Algorithms · Computer Science 2018-08-01 Marcel Radermacher , Ignaz Rutter

We propose new variational principles for traffic assignment problems. So to find equillibrium we have to solve large-scale convex optimization problem of special type. We propose some kind of "algebra" on different models and corresponding…

Optimization and Control · Mathematics 2017-02-28 Alexander Gasnikov

Finite population inference is a central goal in survey sampling. Probability sampling is the main statistical approach to finite population inference. Challenges arise due to high cost and increasing non-response rates. Data integration…

Methodology · Statistics 2020-01-13 Shu Yang , Jae Kwang Kim

The adjoint method is an efficient way to numerically compute gradients in optimization problems with constraints, but is only formulated to differentiable cost and constraint functions on real variables. With the introduction of complex…

Optimization and Control · Mathematics 2026-01-21 Andrew Zheng , Adam R. Stinchcombe

We study the limiting behavior of multiple ergodic averages involving several not necessarily commuting measure preserving transformations. We work on two types of averages, one that uses iterates along combinatorial parallelepipeds, and…

Dynamical Systems · Mathematics 2011-02-09 Qing Chu , Nikos Frantzikinakis

Model merging combines multiple fine-tuned models into a single model by adding their weight updates, providing a lightweight alternative to retraining. Existing methods primarily target resolving conflicts between task updates, leaving the…

Machine Learning · Computer Science 2026-05-22 Yayuan Li , Ze Peng , Jian Zhang , Jintao Guo , Yue Duan , Yinghuan Shi

Umbrella sampling efficiently yields equilibrium averages that depend on exploring rare states of a model by biasing simulations to windows of coordinate values and then combining the resulting data with physical weighting. Here, we…

Statistical Mechanics · Physics 2016-09-21 Erik Thiede , Brian Van Koten , Jonathan Weare , Aaron R. Dinner