English
Related papers

Related papers: Optimizing F-measure: A Tale of Two Approaches

200 papers

The typical multi-task learning methods for spatio-temporal data prediction involve low-rank tensor computation. However, such a method have relatively weak performance when the task number is small, and we cannot integrate it into…

Machine Learning · Computer Science 2019-10-14 Qichen Li , Jiaxin Pei , Jianding Zhang , Bo Han

Spoken language understanding (SLU) datasets, like many other machine learning datasets, usually suffer from the label imbalance problem. Label imbalance usually causes the learned model to replicate similar biases at the output which…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-11 Leda Sarı , Mark Hasegawa-Johnson

In the last years decision-focused learning framework, also known as predict-and-optimize, have received increasing attention. In this setting, the predictions of a machine learning model are used as estimated cost coefficients in the…

Machine Learning · Computer Science 2022-06-20 Jayanta Mandi , Víctor Bucarey , Maxime Mulamba , Tias Guns

Reinforcement learning can greatly benefit from the use of options as a way of encoding recurring behaviours and to foster exploration. An important open problem is how can an agent autonomously learn useful options when solving particular…

Machine Learning · Computer Science 2020-01-07 Manuel Del Verme , Bruno Castro da Silva , Gianluca Baldassarre

The quality of an induced model by a learning algorithm is dependent on the quality of the training data and the hyper-parameters supplied to the learning algorithm. Prior work has shown that improving the quality of the training data…

Machine Learning · Statistics 2014-03-14 Michael R. Smith , Tony Martinez , Christophe Giraud-Carrier

Parameter estimation in logistic regression is a well-studied problem with the Newton-Raphson method being one of the most prominent optimization techniques used in practice. A number of monotone optimization methods including…

Computation · Statistics 2023-04-11 Nicholas C. Henderson , Zhongzhe Ouyang

This paper introduces a probabilistic framework to estimate parameters of an acquisition function given observed human behavior that can be modeled as a collection of sample paths from a Bayesian optimization procedure. The methodology…

Human-Computer Interaction · Computer Science 2022-02-04 Nathan Sandholtz , Yohsuke Miyamoto , Luke Bornn , Maurice Smith

The Expectation Maximization (EM) algorithm is the default algorithm for inference in latent variable models. As in any other field of machine learning, applications of latent variable models to very large datasets make the use of advanced…

Optimization and Control · Mathematics 2021-11-11 Aymeric Dieuleveut , Gersende Fort , Eric Moulines , Geneviève Robin

Energy-based models (EBMs) are versatile density estimation models that directly parameterize an unnormalized log density. Although very flexible, EBMs lack a specified normalization constant of the model, making the likelihood of the model…

Machine Learning · Computer Science 2024-02-20 Louis Grenioux , Éric Moulines , Marylou Gabrié

Can we allow humans to pick among different, yet reasonably similar, decisions? Are we able to construct optimization problems whose outcome are sets of feasible, close-to-optimal decisions for human users to pick from, instead of a single,…

Optimization and Control · Mathematics 2024-03-07 Andrea Simonetto

One of the most important problems in system identification and statistics is how to estimate the unknown parameters of a given model. Optimization methods and specialized procedures, such as Empirical Minimization (EM) can be used in case…

Methodology · Statistics 2024-02-09 Braghadeesh Lakshminarayanan , Cristian R. Rojas

Though data augmentation has become a standard component of deep neural network training, the underlying mechanism behind the effectiveness of these techniques remains poorly understood. In practice, augmentation policies are often chosen…

Machine Learning · Computer Science 2020-06-08 Raphael Gontijo-Lopes , Sylvia J. Smullin , Ekin D. Cubuk , Ethan Dyer

The fundamental theorem of statistical learning states that for binary classification problems, any Empirical Risk Minimization (ERM) learning rule has close to optimal sample complexity. In this paper we seek for a generic optimal learner…

Machine Learning · Computer Science 2014-05-13 Amit Daniely , Shai Shalev-Shwartz

Many key problems in machine learning and data science are routinely modeled as optimization problems and solved via optimization algorithms. With the increase of the volume of data and the size and complexity of the statistical models used…

Optimization and Control · Mathematics 2020-08-28 Filip Hanzely

This tutorial introduces a systematic approach for addressing the key question of quantum metrology: For a generic task of sensing an unknown parameter, what is the ultimate precision given a constrained set of admissible strategies. The…

Quantum Physics · Physics 2024-12-19 Qiushi Liu , Zihao Hu , Haidong Yuan , Yuxiang Yang

Policy evaluation estimates the performance of a policy by (1) collecting data from the environment and (2) processing raw data into a meaningful estimate. Due to the sequential nature of reinforcement learning, any improper data-collecting…

Machine Learning · Computer Science 2025-03-21 Shuze Daniel Liu , Claire Chen , Shangtong Zhang

We consider off-policy evaluation and optimization with continuous action spaces. We focus on observational data where the data collection policy is unknown and needs to be estimated. We take a semi-parametric approach where the value…

Econometrics · Economics 2019-07-23 Mert Demirer , Vasilis Syrgkanis , Greg Lewis , Victor Chernozhukov

We investigate the problem of jointly testing a pair of composite hypotheses and, depending on the test result, estimating a random parameter under distributional uncertainties. Specifically, it is assumed that the distribution of the data…

Signal Processing · Electrical Eng. & Systems 2026-04-27 Dominik Reinhard , Michael Fauß , Abdelhak M. Zoubir

The essential of navigation, perception, and decision-making which are basic tasks for intelligent robots, is to estimate necessary system states. Among them, navigation is fundamental for other upper applications, providing precise…

Robotics · Computer Science 2024-01-12 Feng Zhu , Zhuo Xu , Xveqing Zhang , Yuantai Zhang , Weijie Chen , Xiaohong Zhang

Real-world datasets often encode stereotypes and societal biases. Such biases can be implicitly captured by trained models, leading to biased predictions and exacerbating existing societal preconceptions. Existing debiasing methods, such as…

Machine Learning · Computer Science 2022-05-06 Aili Shen , Xudong Han , Trevor Cohn , Timothy Baldwin , Lea Frermann