English
Related papers

Related papers: An Information-Theoretic Framework for Unifying Ac…

200 papers

We develop a generalized inverse optimization framework for fitting the cost vector of a single linear optimization problem given multiple observed decisions. This setting is motivated by ensemble learning, where building consensus from…

Optimization and Control · Mathematics 2020-06-08 Aaron Babier , Timothy C. Y. Chan , Taewoo Lee , Rafid Mahmood , Daria Terekhov

Information extraction (IE) systems aim to automatically extract structured information, such as named entities, relations between entities, and events, from unstructured texts. While most existing work addresses a particular IE task,…

Computation and Language · Computer Science 2023-05-22 Chang Gao , Wenxuan Zhang , Wai Lam , Lidong Bing

Multi-access Edge Computing (MEC) can be implemented together with Open Radio Access Network (O-RAN) over commodity platforms to offer low-cost deployment and bring the services closer to end-users. In this paper, a joint O-RAN/MEC…

Networking and Internet Architecture · Computer Science 2023-12-27 Fahri Wisnu Murti , Samad Ali , Matti Latva-aho

Accurately and efficiently characterizing the decision boundary of classifiers is important for problems related to model selection and meta-learning. Inspired by topological data analysis, the characterization of decision boundaries using…

Machine Learning · Computer Science 2020-11-20 Weizhi Li , Gautam Dasarathy , Karthikeyan Natesan Ramamurthy , Visar Berisha

Latent Space Bayesian Optimization (LSBO) combines generative models, typically Variational Autoencoders (VAE), with Bayesian Optimization (BO) to generate de-novo objects of interest. However, LSBO faces challenges due to the mismatch…

Machine Learning · Computer Science 2024-04-30 Onur Boyar , Ichiro Takeuchi

The effectiveness of active learning largely depends on the sampling efficiency of the acquisition function. Expected Loss Reduction (ELR) focuses on a Bayesian estimate of the reduction in classification error, and more general costs fit…

Machine Learning · Computer Science 2023-12-19 Wei Tan , Lan Du , Wray Buntine

Bayesian Optimization (BO) is a sample-efficient black-box optimizer commonly used in search spaces where hyperparameters are independent. However, in many practical AutoML scenarios, there will be dependencies among hyperparameters,…

Machine Learning · Computer Science 2025-01-28 Jiaxing Li , Wei Liu , Chao Xue , Yibing Zhan , Xiaoxing Wang , Weifeng Liu , Dacheng Tao

Continual learning refers to the capability of a machine learning model to learn and adapt to new information, without compromising its performance on previously learned tasks. Although several studies have investigated continual learning…

Information Retrieval · Computer Science 2024-06-21 Jingrui Hou , Georgina Cosma , Axel Finke

Although the many efforts to apply deep reinforcement learning to query optimization in recent years, there remains room for improvement as query optimizers are complex entities that require hand-designed tuning of workloads and datasets.…

Databases · Computer Science 2023-06-05 Yuri Kim , Yewon Choi , Yujung Gil , Sanghee Lee , Heesik Shin , Jaehyok Chong

Bayesian optimization (BO) has for sequential optimization of expensive black-box functions demonstrated practicality and effectiveness in many real-world settings. Meta-Bayesian optimization (meta-BO) focuses on improving the sample…

Machine learning has emerged as a promising paradigm for enabling connected, automated vehicles to autonomously cruise the streets and react to unexpected situations. A key challenge, however, is to collect and select real-time and reliable…

Networking and Internet Architecture · Computer Science 2020-02-19 Alaa Awad Abdellatif , Carla Fabiana Chiasserini , Francesco Malandrino

Though neural networks have achieved much progress in various applications, it is still highly challenging for them to learn from a continuous stream of tasks without forgetting. Continual learning, a new learning paradigm, aims to solve…

Machine Learning · Computer Science 2019-05-13 Ju Xu , Jin Ma , Zhanxing Zhu

We study a fundamental learning problem over multiple groups with unknown data distributions, where an analyst would like to learn the mean of each group. Moreover, we want to ensure that this data is collected in a relatively fair manner…

Machine Learning · Computer Science 2025-05-22 Abdellah Aznag , Rachel Cummings , Adam N. Elmachtoub

Bayesian optimization is an effective method to efficiently optimize unknown objective functions with high evaluation costs. Traditional Bayesian optimization algorithms select one point per iteration for single objective function, whereas…

Machine Learning · Statistics 2019-05-08 Takashi Wada , Hideitsu Hino

Bayesian optimization is a powerful framework for optimizing functions that are expensive or time-consuming to evaluate. Recent work has considered Bayesian optimization of function networks (BOFN), where the objective function is given by…

How should we gather information to make effective decisions? We address Bayesian active learning and experimental design problems, where we sequentially select tests to reduce uncertainty about a set of hypotheses. Instead of minimizing…

Machine Learning · Computer Science 2014-02-25 Shervin Javdani , Yuxin Chen , Amin Karbasi , Andreas Krause , J. Andrew Bagnell , Siddhartha Srinivasa

Information-theoretic (IT) measures are ubiquitous in artificial intelligence: entropy drives decision-tree splits and uncertainty quantification, cross-entropy is the default classification loss, mutual information underpins representation…

Artificial Intelligence · Computer Science 2026-04-28 Nikolaos Al. Papadopoulos , Konstantinos E. Psannis

The progress of machine learning over the past decade is undeniable. In retrospect, it is both remarkable and unsettling that this progress was achievable with little to no rigorous theory to guide experimentation. Despite this fact,…

Machine Learning · Statistics 2025-05-23 Hong Jun Jeon , Benjamin Van Roy

Bayesian Optimization (BO) is a key methodology for accelerating molecular discovery by estimating the mapping from molecules to their properties while seeking the optimal candidate. Typically, BO iteratively updates a probabilistic…

Machine Learning · Computer Science 2025-12-17 Qi Chen , Fabio Ramos , Alán Aspuru-Guzik , Florian Shkurti

Existing approaches to active learning maximize the system performance by sampling unlabeled instances for annotation that yield the most efficient training. However, when active learning is integrated with an end-user application, this can…

Computation and Language · Computer Science 2020-05-13 Ji-Ung Lee , Christian M. Meyer , Iryna Gurevych