English
Related papers

Related papers: Personalized Prediction By Learning Halfspace Refe…

200 papers

We consider the problem of PAC-learning decision trees, i.e., learning a decision tree over the n-dimensional hypercube from independent random labeled examples. Despite significant effort, no polynomial-time algorithm is known for learning…

Machine Learning · Computer Science 2008-12-05 Adam Tauman Kalai , Shang-Hua Teng

Supervisory signals are a critical resource for training learning to rank models. In many real-world search and retrieval scenarios, these signals may not be readily available or could be costly to obtain for some queries. The examples…

Information Retrieval · Computer Science 2024-10-10 Xuyang Wu , Ajit Puthenputhussery , Hongwei Shang , Changsung Kang , Yi Fang

Sparse linear discriminant analysis via penalized optimal scoring is a successful tool for classification in high-dimensional settings. While the variable selection consistency of sparse optimal scoring has been established, the…

Statistics Theory · Mathematics 2021-04-01 Irina Gaynanova

The increased availability of data in recent years has led several authors to ask whether it is possible to use data as a {\em computational} resource. That is, if more data is available, beyond the sample complexity limit, is it possible…

Machine Learning · Computer Science 2013-11-12 Amit Daniely , Nati Linial , Shai Shalev Shwartz

Accurate prediction of user consumption is a key part not only in understanding consumer flexibility and behavior patterns, but in the design of robust and efficient energy saving programs as well. Existing prediction methods usually have…

Machine Learning · Statistics 2017-02-22 Pan Li , Baosen Zhang , Yang Weng , Ram Rajagopal

We introduce a simple framework for designing private boosting algorithms. We give natural conditions under which these algorithms are differentially private, efficient, and noise-tolerant PAC learners. To demonstrate our framework, we use…

Machine Learning · Computer Science 2020-02-05 Mark Bun , Marco Leandro Carmosino , Jessica Sorrell

Modern processors rely heavily on speculation to keep the pipeline filled and consequently execute and commit instructions as close to maximum capacity as possible. To improve instruction-level parallelism, the processor core needs to fetch…

Hardware Architecture · Computer Science 2021-10-19 Ilias Vougioukas , Andreas Sandberg , Nikos Nikoleris

We study the problem of estimating high dimensional models with underlying sparse structures while preserving the privacy of each training example. We develop a differentially private high-dimensional sparse learning framework using the…

Machine Learning · Statistics 2019-09-16 Lingxiao Wang , Quanquan Gu

In recent years, the crucial importance of metrics in machine learning algorithms has led to an increasing interest for optimizing distance and similarity functions. Most of the state of the art focus on learning Mahalanobis distances…

Machine Learning · Computer Science 2019-01-25 Aurelien Bellet , Amaury Habrard , Marc Sebban

The cost and scarcity of fully supervised labels in statistical machine learning encourage using partially labeled data for model validation as a cheaper and more accessible alternative. Effectively collecting and leveraging weakly…

Machine Learning · Statistics 2022-06-16 Maxime Cauchois , John Duchi

In designing personalized ranking algorithms, it is desirable to encourage a high precision at the top of the ranked list. Existing methods either seek a smooth convex surrogate for a non-smooth ranking metric or directly modify updating…

Machine Learning · Statistics 2018-08-15 Kuan Liu , Prem Natarajan

In real-world applications, the distribution of the data, and our goals, evolve over time. The prevailing theoretical framework for studying machine learning, namely probably approximately correct (PAC) learning, largely ignores time. As a…

Machine Learning · Statistics 2025-01-31 Ashwin De Silva , Rahul Ramesh , Rubing Yang , Siyu Yu , Joshua T Vogelstein , Pratik Chaudhari

The goal of a learning algorithm is to receive a training data set as input and provide a hypothesis that can generalize to all possible data points from a domain set. The hypothesis is chosen from hypothesis classes with potentially…

Machine Learning · Statistics 2023-03-29 Soosan Beheshti , Mahdi Shamsi

We propose a novel sparse preference learning/ranking algorithm. Our algorithm approximates the true utility function by a weighted sum of basis functions using the squared loss on pairs of data points, and is a generalization of the kernel…

Machine Learning · Statistics 2013-07-04 Evgeni Tsivtsivadze , Tom Heskes

In Semi-Supervised Semi-Private (SP) learning, the learner has access to both public unlabelled and private labelled data. We propose a computationally efficient algorithm that, under mild assumptions on the data, provably achieves…

Machine Learning · Computer Science 2023-06-08 Francesco Pinto , Yaxi Hu , Fanny Yang , Amartya Sanyal

Speech evaluation measures a learners oral proficiency using automatic models. Corpora for training such models often pose sparsity challenges given that there often is limited scored data from teachers, in addition to the score…

Artificial Intelligence · Computer Science 2024-09-24 Huayun Zhang , Jeremy H. M. Wong , Geyu Lin , Nancy F. Chen

The majority of machine learning methods and algorithms give high priority to prediction performance which may not always correspond to the priority of the users. In many cases, practitioners and researchers in different fields, going from…

Precision and Recall are fundamental metrics in machine learning tasks where both accurate predictions and comprehensive coverage are essential, such as in multi-label learning, language generation, medical studies, and recommender systems.…

Machine Learning · Computer Science 2025-10-27 Lee Cohen , Yishay Mansour , Shay Moran , Han Shao

This paper addresses Bayesian inference related to partial differential equations (PDEs), particularly nonparametric regression constrained by PDEs. To effectively encode prior information, we propose a novel framework that learns a…

Statistics Theory · Mathematics 2026-02-09 Junxiong Jia , Deyu Meng , Zongben Xu , Fang Yao

Machine learning is used to make decisions for individuals in various fields, which require us to achieve good prediction accuracy while ensuring fairness with respect to sensitive features (e.g., race and gender). This problem, however,…

Machine Learning · Computer Science 2021-03-01 Yoichi Chikahara , Shinsaku Sakaue , Akinori Fujino , Hisashi Kashima