English
Related papers

Related papers: BELIEF: A distance-based redundancy-proof feature …

200 papers

Approximate Bayesian inference on the basis of summary statistics is well-suited to complex problems for which the likelihood is either mathematically or computationally intractable. However the methods that use rejection suffer from the…

Computation · Statistics 2010-05-04 M. G. B. Blum , O. Francois

With the rapid growth of Internet services, recommendation systems play a central role in delivering personalized content. Faced with massive user requests and complex model architectures, the key challenge for real-time recommendation…

Information Retrieval · Computer Science 2025-08-14 Junli Shao , Jing Dong , Dingzhou Wang , Kowei Shih , Dannier Li , Chengrui Zhou

Sequential importance sampling algorithms have been defined to estimate likelihoods in models of ancestral population processes. However, these algorithms are based on features of the models with constant population size, and become…

Statistics Theory · Mathematics 2016-03-24 Coralie Merle , Raphaël Leblois , François Rousset , Pierre Pudlo

Classification models are very sensitive to data uncertainty, and finding robust classifiers that are less sensitive to data uncertainty has raised great interest in the machine learning literature. This paper aims to construct robust…

Machine Learning · Statistics 2022-03-01 Vali Asimit , Ioannis Kyriakou , Simone Santoni , Salvatore Scognamiglio , Rui Zhu

This paper discusses the critical decision process of extracting or selecting the features in a supervised learning context. It is often confusing to find a suitable method to reduce dimensionality. There are pros and cons to deciding…

Machine Learning · Computer Science 2022-06-22 Jean-Sébastien Dessureault , Daniel Massicotte

Big data analytics is gaining massive momentum in the last few years. Applying machine learning models to big data has become an implicit requirement or an expectation for most analysis tasks, especially on high-stakes applications.Typical…

Databases · Computer Science 2018-04-24 Wei Wang , Sheng Wang , Jinyang Gao , Meihui Zhang , Gang Chen , Teck Khim Ng , Beng Chin Ooi

While deep neural networks are highly performant and successful in a wide range of real-world problems, estimating their predictive uncertainty remains a challenging task. To address this challenge, we propose and implement a loss function…

Machine Learning · Computer Science 2022-10-14 Tony Tohme , Kevin Vanslette , Kamal Youcef-Toumi

Kernel-based methods enjoy powerful generalization capabilities in handling a variety of learning tasks. When such methods are provided with sufficient training data, broadly-applicable classes of nonlinear functions can be approximated…

Machine Learning · Statistics 2017-12-29 Fatemeh Sheikholeslami , Dimitris Berberidis , Georgios B. Giannakis

We present a novel, domain-agnostic, model-independent, unsupervised, and universally applicable Machine Learning approach for dimensionality reduction based on the principles of algorithmic complexity. Specifically, but without loss of…

Data Structures and Algorithms · Computer Science 2025-05-06 Hector Zenil , Narsis A. Kiani , Alyssa Adams , Felipe S. Abrahão , Antonio Rueda-Toicen , Allan A. Zea , Luan Ozelim , Jesper Tegnér

Current AI/ML methods for data-driven engineering use models that are mostly trained offline. Such models can be expensive to build in terms of communication and computing cost, and they rely on data that is collected over extended periods…

Machine Learning · Computer Science 2021-12-16 Xiaoxuan Wang , Rolf Stadler

This paper introduces a computational framework for reasoning in Bayesian belief networks that derives significant advantages from focused inference and relevance reasoning. This framework is based on d -separation and other simple and…

Artificial Intelligence · Computer Science 2013-02-08 Yan Lin , Marek J. Druzdzel

In this work, we study and analyze different feature selection algorithms that can be used to classify cancer subtypes in case of highly varying high-dimensional data. We apply three different feature selection methods on five different…

Machine Learning · Computer Science 2021-10-01 Vaibhav Sinha , Siladitya Dash , Nazma Naskar , Sk Md Mosaddek Hossain

Fair classification is a critical challenge that has gained increasing importance due to international regulations and its growing use in high-stakes decision-making settings. Existing methods often rely on adversarial learning or…

Machine Learning · Computer Science 2025-10-14 Alberto Sinigaglia , Davide Sartor , Marina Ceccon , Gian Antonio Susto

Selecting a small set of informative features from a large number of possibly noisy candidates is a challenging problem with many applications in machine learning and approximate Bayesian computation. In practice, the cost of computing…

Methodology · Statistics 2022-09-05 Louis Raynal , Till Hoffmann , Jukka-Pekka Onnela

Model explainability is crucial for human users to be able to interpret how a proposed classifier assigns labels to data based on its feature values. We study generalized linear models constructed using sets of feature value rules, which…

Machine Learning · Statistics 2023-11-06 Sanjeeb Dash , Soumyadip Ghosh , Joao Goncalves , Mark S. Squillante

In this paper we consider the binary transfer learning problem, focusing on how to select and combine sources from a large pool to yield a good performance on a target task. Constraining our scenario to real world, we do not assume the…

Computer Vision and Pattern Recognition · Computer Science 2016-09-16 Ilja Kuzborskij , Francesco Orabona , Barbara Caputo

The performance of fault diagnosis systems is highly affected by data quality in cyber-physical power systems. These systems generate massive amounts of data that overburden the system with excessive computational costs. Another issue is…

Machine Learning · Computer Science 2024-09-04 Hossein Hassani , Ehsan Hallaji , Roozbeh Razavi-Far , Mehrdad Saif

The remarkable success of modern machine learning models on large datasets often demands extensive training time and resource consumption. To save cost, a prevalent research line, known as online batch selection, explores selecting…

Machine Learning · Computer Science 2024-06-10 Feng Hong , Yueming Lyu , Jiangchao Yao , Ya Zhang , Ivor W. Tsang , Yanfeng Wang

Scalable machine learning over big data is an important problem that is receiving a lot of attention in recent years. On popular distributed environments such as Hadoop running on a cluster of commodity machines, communication costs are…

Machine Learning · Computer Science 2015-03-18 Dhruv Mahajan , Nikunj Agrawal , S. Sathiya Keerthi , S. Sundararajan , Leon Bottou

Random forest (RF) missing data algorithms are an attractive approach for dealing with missing data. They have the desirable properties of being able to handle mixed types of missing data, they are adaptive to interactions and nonlinearity,…

Machine Learning · Statistics 2017-01-23 Fei Tang , Hemant Ishwaran