English
Related papers

Related papers: Switching between Hidden Markov Models using Fixed…

200 papers

Dynamic algorithm selection aims to exploit the complementarity of multiple optimization algorithms by switching between them during the search. While these kinds of dynamic algorithms have been shown to have potential to outperform their…

Artificial Intelligence · Computer Science 2023-02-21 Diederick Vermetten , Hao Wang , Kevin Sim , Emma Hart

We consider the problem of prediction with expert advice when the losses of the experts have low-dimensional structure: they are restricted to an unknown $d$-dimensional subspace. We devise algorithms with regret bounds that are independent…

Machine Learning · Computer Science 2016-05-24 Elad Hazan , Tomer Koren , Roi Livni , Yishay Mansour

As the size of modern data sets exceeds the disk and memory capacities of a single computer, machine learning practitioners have resorted to parallel and distributed computing. Given that optimization is one of the pillars of machine…

Machine Learning · Statistics 2019-12-10 Biyi Fang , Diego Klabjan

Recently, segmentation neural networks have been significantly improved by demonstrating very promising accuracies on public benchmarks. However, these models are very heavy and generally suffer from low inference speed, which limits their…

Computer Vision and Pattern Recognition · Computer Science 2018-10-22 Jiafeng Xie , Bing Shuai , Jian-Fang Hu , Jingyang Lin , Wei-Shi Zheng

Societies often rely on human experts to take a wide variety of decisions affecting their members, from jail-or-release decisions taken by judges and stop-and-frisk decisions taken by police officers to accept-or-reject decisions taken by…

Machine Learning · Statistics 2018-05-29 Isabel Valera , Adish Singla , Manuel Gomez Rodriguez

Federated learning is a distributed machine learning paradigm designed to protect user data privacy, which has been successfully implemented across various scenarios. In traditional federated learning, the entire parameter set of local…

Machine Learning · Computer Science 2024-11-07 Haolin Wang , Xuefeng Liu , Jianwei Niu , Wenkai Guo , Shaojie Tang

In distributed processing, agents generally collect data generated by the same underlying unknown model (represented by a vector of parameters) and then solve an estimation or inference task cooperatively. In this paper, we consider the…

Information Theory · Computer Science 2015-06-16 Sheng-Yuan Tu , Ali H. Sayed

The success of a cross-sectional systematic strategy depends critically on accurately ranking assets prior to portfolio construction. Contemporary techniques perform this ranking step either with simple heuristics or by sorting outputs from…

Trading and Market Microstructure · Quantitative Finance 2020-12-15 Daniel Poh , Bryan Lim , Stefan Zohren , Stephen Roberts

We study the problem of expert advice under partial bandit feedback setting and create a sequential minimax optimal algorithm. Our algorithm works with a more general partial monitoring setting, where, in contrast to the classical bandit…

Machine Learning · Computer Science 2022-04-15 Kaan Gokcesu , Hakan Gokcesu

An efficient and flexible engine for computing fixed points is critical for many practical applications. In this paper, we firstly present a goal-directed fixed point computation strategy in the logic programming paradigm. The strategy…

Programming Languages · Computer Science 2007-05-23 Hai-Feng Guo , Gopal Gupta

The problem of heterogeneous clients in federated learning has recently drawn a lot of attention. Spectral model sharding, i.e., partitioning the model parameters into low-rank matrices based on the singular value decomposition, has been…

Machine Learning · Computer Science 2024-11-01 Denis Korzhenkov , Christos Louizos

Recommender systems are widely used for suggesting books, education materials, and products to users by exploring their behaviors. In reality, users' preferences often change over time, leading to studies on time-dependent recommender…

Information Retrieval · Computer Science 2024-12-17 Haidong Zhang , Wancheng Ni , Xin Li , Yiping Yang

We consider the problem of binary prediction with expert advice in settings where experts have agency and seek to maximize their credibility. This paper makes three main contributions. First, it defines a model to reason formally about…

Computer Science and Game Theory · Computer Science 2021-03-16 Tim Roughgarden , Okke Schrijvers

This paper discusses a data-driven, empirically-based framework to make algorithmic decisions or recommendations without expert knowledge. We improve the performance of two algorithmic case studies: the selection of a pivot rule for the…

Machine Learning · Computer Science 2021-09-30 Imran Adham , Jesus De Loera , Zhenyang Zhang

We investigate an existing distributed algorithm for learning sparse signals or data over networks. The algorithm is iterative and exchanges intermediate estimates of a sparse signal over a network. This learning strategy using exchange of…

Machine Learning · Statistics 2017-09-25 Ahmed Zaki , Partha P. Mitra , Lars K. Rasmussen , Saikat Chatterjee

Making judicious channel access and transmission scheduling decisions is essential for improving performance as well as energy and spectral efficiency in multichannel wireless systems. This problem has been a subject of extensive study in…

Machine Learning · Computer Science 2015-04-07 Yang Liu , Mingyan Liu

Learning-to-Defer (L2D) methods route each query either to a predictive model or to external experts. While existing work studies this problem in batch settings, real-world deployments require handling streaming data, changing expert…

Machine Learning · Statistics 2026-05-29 Dang Hoang Duy , Yannis Montreuil , Maxime Meyer , Axel Carlier , Lai Xing Ng , Wei Tsang Ooi

We study an online linear classification problem, in which the data is generated by strategic agents who manipulate their features in an effort to change the classification outcome. In rounds, the learner deploys a classifier, and an…

Machine Learning · Computer Science 2017-10-24 Jinshuo Dong , Aaron Roth , Zachary Schutzman , Bo Waggoner , Zhiwei Steven Wu

A change points detection aims to catch an abrupt disorder in data distribution. Common approaches assume that there are only two fixed distributions for data: one before and another after a change point. Real-world data are richer than…

Machine Learning · Computer Science 2022-04-18 Alexander Stepikin , Evgenia Romanenkova , Alexey Zaytsev

In this paper, we focus on the question of the extent to which online learning can benefit from distributed computing. We focus on the setting in which $N$ agents online-learn cooperatively, where each agent only has access to its own data.…

Machine Learning · Computer Science 2019-08-17 Hua Ouyang , Alexander Gray