English
Related papers

Related papers: An $O(n\log(n))$ Algorithm for Projecting Onto the…

200 papers

Ordinal regression is a classification task where classes have an order and prediction error increases the further the predicted class is from the true class. The standard approach for modeling ordinal data involves fitting parallel…

Machine Learning · Computer Science 2022-02-16 Fred Lu , Francis Ferraro , Edward Raff

Prior knowledge on properties of a target model often come as discrete or combinatorial descriptions. This work provides a unified computational framework for defining norms that promote such structures. More specifically, we develop…

Machine Learning · Statistics 2019-04-11 Amin Jalali , Adel Javanmard , Maryam Fazel

This paper presents a fast algorithm for projecting a given function to the set of shift orthogonal functions (i.e. set containing functions with unit $L^2$ norm that are orthogonal to their prescribed shifts). The algorithm can be…

Numerical Analysis · Mathematics 2014-02-24 Farzin Barekat , Rongjie Lai , Ke Yin , Stanley Osher , Russel Caflisch , Vidvuds Ozolins

Ordinal regression is a specialized supervised problem where the labels show an inherent order. The order distinguishes it from normal multi-class problem. Support Vector Ordinal Regression, as an outstanding ordinal regression model, is…

Machine Learning · Computer Science 2024-04-26 Haorui Xiang , Zhichang Wu , Guoxu Li , Rong Wang , Feiping Nie , Xuelong Li

We propose a randomized algorithm for training Support vector machines(SVMs) on large datasets. By using ideas from Random projections we show that the combinatorial dimension of SVMs is $O({log} n)$ with high probability. This estimate of…

Machine Learning · Computer Science 2009-09-22 Vinay Jethava , Krishnan Suresh , Chiranjib Bhattacharyya , Ramesh Hariharan

Object-oriented reinforcement learning (OORL) is a promising way to improve the sample efficiency and generalization ability over standard RL. Recent works that try to solve OORL tasks without additional feature engineering mainly focus on…

Machine Learning · Computer Science 2022-10-17 Qi Yi , Rui Zhang , Shaohui Peng , Jiaming Guo , Xing Hu , Zidong Du , Xishan Zhang , Qi Guo , Yunji Chen

Online learning updates models incrementally with new data, avoiding large storage requirements and costly model recalculations. In this paper, we introduce "OLR-WA; OnLine Regression with Weighted Average", a novel and versatile…

Machine Learning · Computer Science 2025-12-18 Mohammad Abu-Shaira , Alejandro Rodriguez , Greg Speegle , Victor Sheng , Ishfaq Ahmad

In decision-making under uncertainty, several criteria have been studied to aggregate the performance of a solution over multiple possible scenarios. This paper introduces a novel variant of ordered weighted averaging (OWA) for optimization…

Optimization and Control · Mathematics 2024-01-30 Werner Baak , Marc Goerigk , Adam Kasperski , Paweł Zieliński

This paper considers correlation clustering on unweighted complete graphs. We give a combinatorial algorithm that returns a single clustering solution that is simultaneously $O(1)$-approximate for all $\ell_p$-norms of the disagreement…

Data Structures and Algorithms · Computer Science 2024-03-12 Sami Davies , Benjamin Moseley , Heather Newman

Mixed norms that promote structured sparsity have numerous applications in signal processing and machine learning problems. In this work, we present a new algorithm, based on a Newton root search technique, for computing the projection onto…

Optimization and Control · Mathematics 2021-03-25 Gustavo Chau , Brendt Wohlberg , Paul Rodriguez

Ordinal regression (OR) is classification of ordinal data in which the underlying categorical target variable has a natural ordinal relation for the underlying explanatory variable. For $K$-class OR tasks, threshold methods learn a…

Machine Learning · Computer Science 2024-05-22 Ryoya Yamasaki , Toshiyuki Tanaka

We present in this paper a generic object-oriented benchmark (OCB: the Object Clustering Benchmark) that has been designed to evaluate the performances of Object-Oriented Data-bases (OODBs), and more specifically the performances of…

Databases · Computer Science 2016-11-29 Jérôme Darmont , Michel Schneider

A large body of research has focused on theory and computation for variable selection techniques for high dimensional data. There has been substantially less work in the big tall data paradigm, where the number of variables may be large,…

Computation · Statistics 2018-01-30 Jared D. Huling , Peter Z. G. Qian

Semantic embedding of knowledge graphs has been widely studied and used for prediction and statistical analysis tasks across various domains such as Natural Language Processing and the Semantic Web. However, less attention has been paid to…

Artificial Intelligence · Computer Science 2021-01-26 Jiaoyan Chen , Pan Hu , Ernesto Jimenez-Ruiz , Ole Magnus Holter , Denvar Antonyrajah , Ian Horrocks

We develop a novel optical neural network (ONN) framework which introduces a degree of scalar invariance to image classification estima- tion. Taking a hint from the human eye, which has higher resolution near the center of the retina,…

Computer Vision and Pattern Recognition · Computer Science 2018-05-30 Grant Fennessy , Yevgeniy Vorobeychik

The octagonal shrinkage and clustering algorithm for regression (OSCAR), equipped with the $\ell_1$-norm and a pair-wise $\ell_{\infty}$-norm regularizer, is a useful tool for feature selection and grouping in high-dimensional data…

Optimization and Control · Mathematics 2018-03-29 Ziyan Luo , Defeng Sun , Kim-Chuan Toh , Naihua Xiu

In the framework of convolutional neural networks that lie at the heart of deep learning, downsampling is often performed with a max-pooling operation that only retains the element with maximum activation, while completely discarding the…

Computer Vision and Pattern Recognition · Computer Science 2018-04-17 Ashwani Kumar

Ordinal regression refers to classifying object instances into ordinal categories. It has been widely studied in many scenarios, such as medical disease grading, movie rating, etc. Known methods focused only on learning inter-class ordinal…

Artificial Intelligence · Computer Science 2023-07-24 Jinhong Wang , Yi Cheng , Jintai Chen , Tingting Chen , Danny Chen , Jian Wu

We study the selective learning problem introduced by Qiao and Valiant (2019), in which the learner observes $n$ labeled data points one at a time. At a time of its choosing, the learner selects a window length $w$ and a model $\hat\ell$…

Machine Learning · Computer Science 2021-07-01 Mingda Qiao , Gregory Valiant

Label prediction in neural networks (NNs) has O(n) complexity proportional to the number of classes. This holds true for classification using fully connected layers and cosine similarity with some set of class prototypes. In this paper we…

Machine Learning · Computer Science 2026-04-07 Nikita Gabdullin , Ilya Androsov