English
Related papers

Related papers: Trading-Off Cost of Deployment Versus Accuracy in …

200 papers

We propose a transformer architecture for time series forecasting with a focus on time series tokenisation and apply it to a real-world prediction problem from the pricing domain. Our architecture aims to learn effective representations at…

Machine Learning · Computer Science 2025-04-22 Egon Peršak , Miguel F. Anjos , Sebastian Lautz , Aleksandar Kolev

Many applications require the collection of data on different variables or measurements over many system performance metrics. We term those broadly as measures or variables. Often data collection along each measure incurs a cost, thus it is…

Methodology · Statistics 2021-11-30 Donghui Yan , Zhiwei Qin , Songxiang Gu , Haiping Xu , Ming Shao

Practitioners in diverse fields such as healthcare, economics and education are eager to apply machine learning to improve decision making. The cost and impracticality of performing experiments and a recent monumental increase in electronic…

Machine Learning · Computer Science 2023-08-01 Fredrik D. Johansson , Uri Shalit , Nathan Kallus , David Sontag

As machine learning models are increasingly being employed in various high-stakes settings, it becomes important to ensure that predictions of these models are not only adversarially robust, but also readily explainable to relevant…

Machine Learning · Computer Science 2024-07-25 Satyapriya Krishna , Chirag Agarwal , Himabindu Lakkaraju

While there are many studies on weight regularization, the study on structure regularization is rare. Many existing systems on structured prediction focus on increasing the level of structural dependencies within the model. However, this…

Machine Learning · Computer Science 2015-02-02 Xu Sun

When deploying machine learning models in production for any product/application, there are three properties that are commonly desired. First, the models should be generalizable, in that we can extend it to further use cases as our…

Computation and Language · Computer Science 2023-08-17 Abi Aryan , Aakash Kumar Nain , Andrew McMahon , Lucas Augusto Meyer , Harpreet Singh Sahota

Trade-offs between accuracy and efficiency pervade law, public health, and other non-computing domains, which have developed policies to guide how to balance the two in conditions of uncertainty. While computer science also commonly studies…

Computers and Society · Computer Science 2021-10-05 A. Feder Cooper , Karen Levy , Christopher De Sa

We propose and analyze a regularization approach for structured prediction problems. We characterize a large class of loss functions that allows to naturally embed structured outputs in a linear space. We exploit this fact to design…

Machine Learning · Computer Science 2017-07-31 Carlo Ciliberto , Alessandro Rudi , Lorenzo Rosasco

As the use of machine learning in high impact domains becomes widespread, the importance of evaluating safety has increased. An important aspect of this is evaluating how robust a model is to changes in setting or population, which…

Machine Learning · Computer Science 2021-03-16 Adarsh Subbaswamy , Roy Adams , Suchi Saria

Recent systems on structured prediction focus on increasing the level of structural dependencies within the model. However, our study suggests that complex structures entail high overfitting risks. To control the structure-based…

Machine Learning · Computer Science 2017-11-29 Xu Sun , Weiwei Sun , Shuming Ma , Xuancheng Ren , Yi Zhang , Wenjie Li , Houfeng Wang

The need for control strategies that can address dynamic system uncertainty is becoming increasingly important. In this work, we propose a Model Predictive Control by quantifying the risk of failure in our system model. The proposed control…

Systems and Control · Electrical Eng. & Systems 2023-02-17 Mostafa Tavakkoli Anbarani , Efe C. Balta , Rômulo Meira-Góes , Ilya Kovalenko

Many real-world combinatorial problems involve uncertain parameters, which can be predicted given contextual features and historical data. These `predict-then-optimize' or `contextual optimization' problems have gained significant…

Machine Learning · Computer Science 2026-05-19 Noah Schutte , Senne Berden , Tias Guns , Krzysztof Postek , Neil Yorke-Smith

We construct custom regularization functions for use in supervised training of deep neural networks. Our technique is applicable when the ground-truth labels themselves exhibit internal structure; we derive a regularizer by learning an…

Computer Vision and Pattern Recognition · Computer Science 2018-04-09 Mohammadreza Mostajabi , Michael Maire , Gregory Shakhnarovich

Clinical prediction models are increasingly used to support patient care, yet many deep learning-based approaches remain unstable, as their predictions can vary substantially when trained on different samples from the same population. Such…

Machine Learning · Computer Science 2026-02-13 Sara Matijevic , Christopher Yau

Reinforcement learning (RL) is recognized as lacking generalization and robustness under environmental perturbations, which excessively restricts its application for real-world robotics. Prior work claimed that adding regularization to the…

Machine Learning · Computer Science 2023-12-06 Yuan Zhang , Jianhong Wang , Joschka Boedecker

Distributionally Robust Optimization (DRO) is a worst-case approach to decision making when there is model uncertainty. It is also well known that for certain uncertainty sets, DRO is approximated by a regularized nominal problem. We show…

Optimization and Control · Mathematics 2026-05-08 Jun-ya Gotoh , Michael Jong Kim , Andrew E. B. Lim

We focus on robust, survivable communication networks, where network links and nodes are affected by an uncertainty set. In this sense, any network links might fail. Besides, a signal can only travel a maximum distance before its quality…

Networking and Internet Architecture · Computer Science 2026-02-12 Mohammad Khosravi , Setareh Maghsudi

Dealing with high variance is a significant challenge in model-free reinforcement learning (RL). Existing methods are unreliable, exhibiting high variance in performance from run to run using different initializations/seeds. Focusing on…

Machine Learning · Computer Science 2019-05-15 Richard Cheng , Abhinav Verma , Gabor Orosz , Swarat Chaudhuri , Yisong Yue , Joel W. Burdick

By searching for shared inductive biases across tasks, meta-learning promises to accelerate learning on novel tasks, but with the cost of solving a complex bilevel optimization problem. We introduce and rigorously define the trade-off…

Machine Learning · Computer Science 2021-04-15 Katelyn Gao , Ozan Sener

Conventional active learning algorithms assume a single labeler that produces noiseless label at a given, fixed cost, and aim to achieve the best generalization performance for given classifier under a budget constraint. However, in many…

Machine Learning · Computer Science 2021-05-25 Ruijiang Gao , Maytal Saar-tsechansky