English
Related papers

Related papers: Budget Allocation for Unknown Value Functions in a…

200 papers

We study a type of reverse (procurement) auction problems in the presence of budget constraints. The general algorithmic problem is to purchase a set of resources, which come at a cost, so as not to exceed a given budget and at the same…

Computer Science and Game Theory · Computer Science 2016-10-05 Georgios Amanatidis , Georgios Birmpas , Evangelos Markakis

We study a budgeted hyper-parameter tuning problem, where we optimize the tuning result under a hard resource constraint. We propose to solve it as a sequential decision making problem, such that we can use the partial training progress of…

Machine Learning · Computer Science 2019-02-05 Zhiyun Lu , Chao-Kai Chiang , Fei Sha

Adaptive estimation of linear functionals over a collection of parameter spaces is considered. A between-class modulus of continuity, a geometric quantity, is shown to be instrumental in characterizing the degree of adaptability over two…

Statistics Theory · Mathematics 2007-06-13 T. Tony Cai , Mark G. Low

Recent work has demonstrated the remarkable potential of Large Language Models (LLMs) in test-time scaling. By making models think before answering, they are able to achieve much higher accuracy with extra inference computation. However, in…

Artificial Intelligence · Computer Science 2025-05-22 Yi Sun , Han Wang , Jiaqiang Li , Jiacheng Liu , Xiangyu Li , Hao Wen , Yizhen Yuan , Huiwen Zheng , Yan Liang , Yuanchun Li , Yunxin Liu

Optimization in the presence of sharp (non-Lipschitz), unpredictable (w.r.t. time and amount) changes is a challenging and largely unexplored problem of great significance. We consider the class of piecewise Lipschitz functions, which is…

Machine Learning · Computer Science 2020-08-10 Maria-Florina Balcan , Travis Dick , Dravyansh Sharma

The Lipschitz constant is an important quantity that arises in analysing the convergence of gradient-based optimization methods. It is generally unclear how to estimate the Lipschitz constant of a complex model. Thus, this paper studies an…

Machine Learning · Statistics 2023-02-10 Calypso Herrera , Florian Krach , Josef Teichmann

For research to go in the right direction, it is essential to be able to compare and quantify performance of different algorithms focused on the same problem. Choosing a suitable evaluation metric requires deep understanding of the pursued…

Machine Learning · Computer Science 2018-12-05 Jan Brabec , Lukas Machlica

We study Bayesian mechanism design problems in settings where agents have budgets. Specifically, an agent's utility for an outcome is given by his value for the outcome minus any payment he makes to the mechanism, as long as the payment is…

Computer Science and Game Theory · Computer Science 2015-03-19 Shuchi Chawla , David Malec , Azarakhsh Malekian

We consider a generalization of the third degree price discrimination problem studied in Bergemann et al. (2015), where an intermediary between the buyer and the seller can design market segments to maximize any linear combination of…

Computer Science and Game Theory · Computer Science 2019-12-13 Rachel Cummings , Nikhil R. Devanur , Zhiyi Huang , Xiangning Wang

Recent advances in large language models have led to strong performance on reasoning and environment-interaction tasks, yet their ability for creative problem-solving remains underexplored. We study this capability through the lens of…

The shortcomings of maximum likelihood estimation in the context of model-based reinforcement learning have been highlighted by an increasing number of papers. When the model class is misspecified or has a limited representational capacity,…

Machine Learning · Computer Science 2021-06-08 Evgenii Nikishin , Romina Abachi , Rishabh Agarwal , Pierre-Luc Bacon

Deep learning has achieved impressive performance on many tasks in recent years. However, it has been found that it is still not enough for deep neural networks to provide only point estimates. For high-risk tasks, we need to assess the…

Machine Learning · Computer Science 2021-04-28 Yuandu Lai , Yucheng Shi , Yahong Han , Yunfeng Shao , Meiyu Qi , Bingshuai Li

The goal of strategic classification is to learn decision rules which are robust to strategic input manipulation. Earlier works assume that these responses are known; while some recent works handle unknown responses, they exclusively study…

Machine Learning · Computer Science 2024-06-24 Elan Rosenfeld , Nir Rosenfeld

In this paper, we argue that the prevailing approach to training and evaluating machine learning models often fails to consider their real-world application within organizational or societal contexts, where they are intended to create…

Machine Learning · Computer Science 2025-04-24 Burcu Sayin , Jie Yang , Xinyue Chen , Andrea Passerini , Fabio Casati

Equipping current decision-making tools with notions of fairness, equitability, or other ethically motivated outcomes, is one of the top priorities in recent research efforts in machine learning, AI, and optimization. In this paper, we…

Optimization and Control · Mathematics 2022-06-27 Andrea Simonetto , Ivano Notarnicola

Most active learning research has focused on methods which perform well when many labels are available, but can be dramatically worse than random selection when label budgets are small. Other methods have focused on the low-budget regime,…

Machine Learning · Computer Science 2025-02-28 Wonho Bae , Gabriel L. Oliveira , Danica J. Sutherland

Many applications require the collection of data on different variables or measurements over many system performance metrics. We term those broadly as measures or variables. Often data collection along each measure incurs a cost, thus it is…

Methodology · Statistics 2021-11-30 Donghui Yan , Zhiwei Qin , Songxiang Gu , Haiping Xu , Ming Shao

The use of deep learning for medical imaging has seen tremendous growth in the research community. One reason for the slow uptake of these systems in the clinical setting is that they are complex, opaque and tend to fail silently. Outside…

Computer Vision and Pattern Recognition · Computer Science 2018-07-03 Terrance DeVries , Graham W. Taylor

Nowadays, robots are dominating the manufacturing, entertainment and healthcare industries. Robot vision aims to equip robots with the ability to discover information, understand it and interact with the environment. These capabilities…

Computer Vision and Pattern Recognition · Computer Science 2018-07-19 Mohammed Hassanin , Salman Khan , Murat Tahtali

In the classical many normal means with different variances, we consider the situation when the observer is allowed to allocate the available measurement budget over the coordinates of the parameter of interest. The benchmark is the minimax…

Statistics Theory · Mathematics 2019-04-01 Eduard Belitser