English
Related papers

Related papers: Minimax Learning for Remote Prediction

200 papers

The increasing penetration of renewable generation and distributed energy resources requires new operating practices for power systems, wherein risk is explicitly quantified and managed. However, traditional risk-assessment frameworks are…

Optimization and Control · Mathematics 2023-10-05 Wenbo Chen , Mathieu Tanneau , Pascal Van Hentenryck

This paper studies the off-policy evaluation problem, where one aims to estimate the value of a target policy based on a sample of observations collected by another policy. We first consider the multi-armed bandit case, establish a minimax…

Artificial Intelligence · Computer Science 2014-09-15 Lihong Li , Remi Munos , Csaba Szepesvari

In the remote state estimation problem, an observer tries to reconstruct the state of a dynamical system at a remote location, where no direct sensor measurements are available. The observer only has access to information sent through a…

Optimization and Control · Mathematics 2021-06-28 Christoph Kawan , Sigurdur Hafstein , Peter Giesl

Nowadays, the major challenge in machine learning is the Big Data challenge. The big data problems due to large number of data points or large number of features in each data point, or both, the training of models have become very slow. The…

Machine Learning · Computer Science 2018-07-26 Vinod Kumar Chauhan , Anuj Sharma , Kalpana Dahiya

Deep learning has had remarkable success at analyzing handheld imagery such as consumer photos due to the availability of large-scale human annotations (e.g., ImageNet). However, remote sensing data lacks such extensive annotation and thus…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Chun-Hsiao Yeh , Xudong Wang , Stella X. Yu , Charles Hill , Zackery Steck , Scott Kangas , Aaron Reite

Learning the optimized solution as a function of environmental parameters is effective in solving numerical optimization in real time for time-sensitive applications. Existing works of learning to optimize train deep neural networks (DNN)…

Machine Learning · Computer Science 2019-05-28 Chengjian Sun , Chenyang Yang

In relation extraction with distant supervision, noisy labels make it difficult to train quality models. Previous neural models addressed this problem using an attention mechanism that attends to sentences that are likely to express the…

Computation and Language · Computer Science 2019-04-09 Iz Beltagy , Kyle Lo , Waleed Ammar

Learning from imprecise labels such as "animal" or "bird", but making precise predictions like "snow bunting" at inference time is an important capability for any classifier when expertly labeled training data is scarce. Contributions by…

Computer Vision and Pattern Recognition · Computer Science 2022-01-28 Clemens-Alexander Brust , Björn Barz , Joachim Denzler

We consider online learning when the time horizon is unknown. We apply a minimax analysis, beginning with the fixed horizon case, and then moving on to two unknown-horizon settings, one that assumes the horizon is chosen randomly according…

Machine Learning · Computer Science 2013-10-08 Haipeng Luo , Robert E. Schapire

In this paper, we develop a randomized algorithm and theory for learning a sparse model from large-scale and high-dimensional data, which is usually formulated as an empirical risk minimization problem with a sparsity-inducing regularizer.…

Machine Learning · Computer Science 2016-10-18 Lijun Zhang , Tianbao Yang , Rong Jin , Zhi-Hua Zhou

We present estimators for a well studied statistical estimation problem: the estimation for the linear regression model with soft sparsity constraints ($\ell_q$ constraint with $0<q\leq1$) in the high-dimensional setting. We first present a…

Statistics Theory · Mathematics 2013-11-11 Li Zhang

Many structured prediction problems (particularly in vision and language domains) are ambiguous, with multiple outputs being correct for an input - e.g. there are many ways of describing an image, multiple ways of translating a sentence;…

Machine Learning · Statistics 2018-06-11 Ashwin Kalyan , Stefan Lee , Anitha Kannan , Dhruv Batra

We consider the problem of revealing/sharing data in an efficient and secure way via a compact representation. The representation should ensure reliable reconstruction of the desired features/attributes while still preserve privacy of the…

Information Theory · Computer Science 2016-05-09 Kittipong Kittichokechai , Giuseppe Caire

We establish an algorithm to learn feedback maps from data for a class of robust model predictive control (MPC) problems. The algorithm accounts for the approximation errors due to the learning directly at the synthesis stage, ensuring…

Optimization and Control · Mathematics 2025-10-16 Siddhartha Ganguly , Shubham Gupta , Debasish Chatterjee

Few-shot learning or meta-learning leverages the data scarcity problem in machine learning. Traditionally, training data requires a multitude of samples and labeling for supervised learning. To address this issue, we propose a one-shot…

Machine Learning · Computer Science 2023-10-23 Atik Faysal , Mohammad Rostami , Huaxia Wang , Avimanyu Sahoo , Ryan Antle

Safe reinforcement learning (RL) aims to learn policies that satisfy certain constraints before deploying them to safety-critical applications. Previous primal-dual style approaches suffer from instability issues and lack optimality…

Machine Learning · Computer Science 2022-06-20 Zuxin Liu , Zhepeng Cen , Vladislav Isenbaev , Wei Liu , Zhiwei Steven Wu , Bo Li , Ding Zhao

The fundamental theorem of statistical learning states that for binary classification problems, any Empirical Risk Minimization (ERM) learning rule has close to optimal sample complexity. In this paper we seek for a generic optimal learner…

Machine Learning · Computer Science 2014-05-13 Amit Daniely , Shai Shalev-Shwartz

We propose a general framework for machine learning based optimization under uncertainty. Our approach replaces the complex forward model by a surrogate, which is learned simultaneously in a one-shot sense when solving the optimal control…

Optimization and Control · Mathematics 2023-12-25 Philipp A. Guth , Claudia Schillings , Simon Weissmann

With the widespread adoption of machine learning systems, the need to curtail their behavior has become increasingly apparent. This is evidenced by recent advancements towards developing models that satisfy robustness, safety, and fairness…

Machine Learning · Computer Science 2024-03-19 Juan Elenter , Luiz F. O. Chamon , Alejandro Ribeiro

We study sparse linear regression over a network of agents, modeled as an undirected graph (with no centralized node). The estimation problem is formulated as the minimization of the sum of the local LASSO loss functions plus a quadratic…

Machine Learning · Computer Science 2023-06-23 Yao Ji , Gesualdo Scutari , Ying Sun , Harsha Honnappa