English
Related papers

Related papers: How to select an objective function using informat…

200 papers

In the theoretical modelling of a physical system a crucial step consists in the identification of those degrees of freedom that enable a synthetic, yet informative representation of it. While in some cases this selection can be carried out…

Statistical Mechanics · Physics 2020-06-30 Marco Giulini , Roberto Menichetti , M. Scott Shell , Raffaello Potestio

When users can benefit from certain predictive outcomes, they may be prone to act to achieve those outcome, e.g., by strategically modifying their features. The goal in strategic classification is therefore to train predictive models that…

Machine Learning · Computer Science 2023-06-12 Guy Horowitz , Nir Rosenfeld

We consider a distributed learning setting where each agent/learner holds a specific parametric model and data source. The goal is to integrate information across a set of learners to enhance the prediction accuracy of a given learner. A…

Methodology · Statistics 2021-09-21 Jiaying Zhou , Jie Ding , Kean Ming Tan , Vahid Tarokh

In multi-objective optimization problems, there might exist hidden objectives that are important to the decision-maker but are not being optimized. On the other hand, there might also exist irrelevant objectives that are being optimized but…

Optimization and Control · Mathematics 2022-06-06 Seyed Mahdi Shavarani , Manuel López-Ibáñez , Richard Allmendinger

We use the language of uninformative Bayesian prior choice to study the selection of appropriately simple effective models. We advocate for the prior which maximizes the mutual information between parameters and predictions, learning as…

Data Analysis, Statistics and Probability · Physics 2018-02-16 Henry H. Mattingly , Mark K. Transtrum , Michael C. Abbott , Benjamin B. Machta

Functionality or proxy-based approach is one of the used approaches to evaluate the quality of explainable artificial intelligence methods. It uses statistical methods, definitions and new developed metrics for the evaluation without human…

Machine Learning · Computer Science 2025-02-04 Ahmed M. Salih

Recent advances in reinforcement learning have proved that given an environment we can learn to perform a task in that environment if we have access to some form of a reward function (dense, sparse or derived from IRL). But most of the…

Machine Learning · Computer Science 2019-05-28 Aadil Hayat , Utsav Singh , Vinay P. Namboodiri

Despite large incentives, ecorrectness in software remains an elusive goal. Declarative programming techniques, where algorithms are derived from a specification of the desired behavior, offer hope to address this problem, since there is a…

Programming Languages · Computer Science 2018-01-22 Anthony Di Franco

Researchers often frame quantitative research as objective, but every step in data collection and analysis can bias findings in often unexamined ways. In this investigation, we examined how the process of selecting variables to include in…

Physics Education · Physics 2021-11-16 Ben Van Dusen , Jayson Nissen

Classification and characterization of variable phenomena and transient phenomena are critical for astrophysics and cosmology. These objects are commonly studied using photometric time series or spectroscopic data. Given that many ongoing…

Instrumentation and Methods for Astrophysics · Physics 2020-01-08 Javiera Astudillo , Pavlos Protopapas , Karim Pichara , Pablo Huijse

Complexity theory offers a variety of concise computational models for computing boolean functions - branching programs, circuits, decision trees and ordered binary decision diagrams to name a few. A natural question that arises in this…

Computational Complexity · Computer Science 2013-06-18 Netanel Raviv

This paper presents a new foundational approach to information theory based on the concept of the information efficiency of a recursive function, which is defined as the difference between the information in the input and the output. The…

Information Theory · Computer Science 2023-08-29 Pieter Adriaans

Effective optimization is essential for interactive systems to provide a satisfactory user experience. However, it is often challenging to find an objective to optimize for. Generally, such objectives are manually crafted and rarely capture…

Artificial Intelligence · Computer Science 2019-12-17 Ziming Li , Julia Kiseleva , Alekh Agarwal , Maarten de Rijke

Creating impact in real-world settings requires artificial intelligence techniques to span the full pipeline from data, to predictive models, to decisions. These components are typically approached separately: a machine learning model is…

Machine Learning · Computer Science 2018-11-22 Bryan Wilder , Bistra Dilkina , Milind Tambe

The goal of inversion is to estimate the model which generates the data of observations with a specific modeling equation. One general approach to inversion is to use optimization methods which are algebraic in nature to define an objective…

Geophysics · Physics 2015-06-02 August Lau , Chuan Yin

The concept of "task" is at the core of artificial intelligence (AI): Tasks are used for training and evaluating AI systems, which are built in order to perform and automatize tasks we deem useful. In other fields of engineering theoretical…

Artificial Intelligence · Computer Science 2016-05-13 Kristinn R. Thórisson , Jordi Bieger , Thröstur Thorarensen , Jóna S. Sigurðardóttir , Bas R. Steunebrink

Black-box optimization is often encountered for decision-making in complex systems management, where the knowledge of system is limited. Under these circumstances, it is essential to balance the utilization of new information with…

Computation · Statistics 2025-01-15 Teng Lian , Jian-Qiang Hu , Yuhang Wu , Zeyu Zheng

Optimization is an essential component for solving problems in wide-ranging fields. Ideally, the objective function should be designed such that the solution is unique and the optimization problem can be solved stably. However, the…

Robotics · Computer Science 2020-07-27 Takayuki Osa

We consider a cooperative learning scenario where a collection of networked agents with individually owned classifiers dynamically update their predictions, for the same classification task, through communication or observations of each…

Data Structures and Algorithms · Computer Science 2024-06-03 Shahrzad Haddadan , Cheng Xin , Jie Gao

The goal of machine learning is to find models that minimize prediction error on data that has not yet been seen. Its operational paradigm assumes access to a dataset $S$ and articulates a scheme for evaluating how well a given model…

Machine Learning · Computer Science 2026-04-22 Maxim Raginsky , Benjamin Recht