English
Related papers

Related papers: A Budget-Adaptive Allocation Rule for Optimal Comp…

200 papers

Computationally intensive decoding procedures--including search, reranking, and self-critique--can improve the quality of language model (LM) outputs in problems spanning code generation, numerical reasoning, and dialog. Existing work…

Machine Learning · Computer Science 2024-10-08 Mehul Damani , Idan Shenfeld , Andi Peng , Andreea Bobu , Jacob Andreas

We study two-stage stochastic optimization problems with random recourse, where the adaptive decisions are multiplied with the uncertain parameters in both the objective function and the constraints. To mitigate the computational…

Optimization and Control · Mathematics 2021-10-05 Xiangyi Fan , Grani A. Hanasusanto

We study an online learning problem on dynamic pricing and resource allocation, where we make joint pricing and inventory decisions to maximize the overall net profit. We consider the stochastic dependence of demands on the price, which…

Machine Learning · Computer Science 2025-05-23 Jianyu Xu , Xuan Wang , Yu-Xiang Wang , Jiashuo Jiang

Recommender systems rely heavily on increasing computation resources to improve their business goal. By deploying computation-intensive models and algorithms, these systems are able to inference user interests and exhibit certain ads or…

Systems and Control · Electrical Eng. & Systems 2021-03-04 Xun Yang , Yunli Wang , Cheng Chen , Qing Tan , Chuan Yu , Jian Xu , Xiaoqiang Zhu

This paper focuses on managing the cost of deliberation before action. In many problems, the overall quality of the solution reflects costs incurred and resources consumed in deliberation as well as the cost and benefit of execution, when…

Artificial Intelligence · Computer Science 2013-04-05 David Einav , Michael R. Fehling

The emergence of large reasoning models demonstrates that scaling inference-time compute significantly enhances performance on complex tasks. However, it often falls into another trap: overthinking simple problems, where repetitive…

Computation and Language · Computer Science 2026-04-07 Siye Wu , Jian Xie , Yikai Zhang , Yanghua Xiao

Stochastic optimization finds a wide range of applications in operations research and management science. However, existing stochastic optimization techniques usually require the information of random samples (e.g., demands in the…

Optimization and Control · Mathematics 2019-04-18 Xi Chen , Qihang Lin , Zizhuo Wang

The performance of modern machine learning algorithms depends upon the selection of a set of hyperparameters. Common examples of hyperparameters are learning rate and the number of layers in a dense neural network. Auto-ML is a branch of…

Machine Learning · Computer Science 2024-01-01 Joshua Inman , Tanmay Khandait , Giulia Pedrielli , Lalitha Sankar

Response-adaptive randomization has recently attracted a lot of attention in the literature. In this paper, we propose a new and simple family of response-adaptive randomization procedures that attain the Cramer--Rao lower bounds on the…

Statistics Theory · Mathematics 2009-08-25 Feifang Hu , Li-Xin Zhang , Xuming He

Motivated by programmatic advertising optimization, we consider the task of sequentially allocating budget across a set of resources. At every time step, a feasible allocation is chosen and only a corresponding random return is observed.…

Artificial Intelligence · Computer Science 2024-10-02 Juliette Achddou , Olivier Cappe , Aurélien Garivier

The essence of distributed computing systems is how to schedule incoming requests and how to allocate all computing nodes to minimize both time and computation costs. In this paper, we propose a cost-aware optimal scheduling and allocation…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-12-02 Wei Ren , Eleftherios Vlahakis , Nikolaos Athanasopoulos , Raphael Jungers

While evolutionary algorithms are known to be very successful for a broad range of applications, the algorithm designer is often left with many algorithmic choices, for example, the size of the population, the mutation rates, and the…

Neural and Evolutionary Computing · Computer Science 2015-04-14 Benjamin Doerr , Carola Doerr

Optimal resource allocation (RA) in massive carrier aggregation scenarios is a challenging combinatorial optimization problem whose dimension is proportional to the number of users, component carriers (CCs), and OFDMA resource blocks per…

Information Theory · Computer Science 2017-06-19 Stelios Stefanatos , Fotis Foukalas , Theodoros A. Tsiftsis

Reinforcement Learning with Verifiable Rewards (RLVR) has emerged as a key approach for enhancing LLM reasoning. However, standard frameworks like Group Relative Policy Optimization (GRPO) typically employ a uniform rollout budget, leading…

Machine Learning · Computer Science 2026-02-09 Zhiyuan Yao , Yi-Kai Zhang , Yuxin Chen , Yueqing Sun , Zishan Xu , Yu Yang , Tianhao Hu , Qi Gu , Hui Su , Xunliang Cai

The emergence of Big Data has enabled new research perspectives in the discrete choice community. While the techniques to estimate Machine Learning models on a massive amount of data are well established, these have not yet been fully…

Optimization and Control · Mathematics 2020-12-23 Gael Lederrey , Virginie Lurkin , Tim Hillel , Michel Bierlaire

We study uncertainty quantification for contextual stochastic optimization, focusing on weighted sample average approximation (wSAA), which uses machine-learned relevance weights based on covariates. Although wSAA is widely used for…

Optimization and Control · Mathematics 2025-10-14 Yanyuan Wang , Xiaowei Zhang

In this paper, a stochastic approximation (SA) based distributed algorithm is proposed to solve the resource allocation (RA) with uncertainties. In this problem, a group of agents cooperatively optimize a separable optimization problem with…

Optimization and Control · Mathematics 2016-11-01 Peng Yi , Jinlong Lei , Yiguang Hong

As LLM reasoning performance plateau, improving inference-time compute efficiency is crucial to mitigate overthinking and long thinking traces even for simple queries. Prior approaches including length regularization, adaptive routing, and…

Machine Learning · Computer Science 2026-04-15 Neharika Jali , Anupam Nayak , Gauri Joshi

Operations research practitioners frequently want to model complicated functions that are are difficult to encode in their underlying optimisation framework. A common approach is to solve an approximate model, and to use a simulation to…

Optimization and Control · Mathematics 2022-07-06 Michael Forbes , Mitchell Harris , Marijn Jansen , Femke van der Schoot , Thomas Taimre

The best algorithm for a computational problem generally depends on the "relevant inputs," a concept that depends on the application domain and often defies formal articulation. While there is a large literature on empirical approaches to…

Machine Learning · Computer Science 2016-09-06 Rishi Gupta , Tim Roughgarden