English
Related papers

Related papers: Parametric Information Maximization for Generalize…

200 papers

In genomics, differential abundance and expression analyses are complicated by the compositional nature of sequence count data, which reflect only relative-not absolute-abundances or expression levels. Many existing methods attempt to…

Methodology · Statistics 2025-12-16 Won Gu , Francesca Chiaromonte , Justin D. Silverman

In this paper, we study a sequential decision-making problem, called Adaptive Sampling for Discovery (ASD). Starting with a large unlabeled dataset, algorithms for ASD adaptively label the points with the goal to maximize the sum of…

Machine Learning · Statistics 2023-01-04 Ziping Xu , Eunjae Shim , Ambuj Tewari , Paul Zimmerman

In many cases, neural network classifiers are likely to be exposed to input data that is outside of their training distribution data. Samples from outside the distribution may be classified as an existing class with high probability by…

Machine Learning · Computer Science 2020-03-24 Guy Amit , Ishai Rosenberg , Moshe Levy , Ron Bitton , Asaf Shabtai , Yuval Elovici

Compact and discriminative visual codebooks are preferred in many visual recognition tasks. In the literature, a number of works have taken the approach of hierarchically merging visual words of an initial large-sized codebook, but…

Computer Vision and Pattern Recognition · Computer Science 2014-01-31 Lingqiao Liu , Lei Wang , Chunhua Shen

Semi-supervised domain generalization (SSDG) has recently emerged as an appealing alternative to tackle domain generalization when labeled data is scarce but unlabeled samples across domains are abundant. In this work, we identify an…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Leo Fillioux , Omprakash Chakraborty , Quentin Gopée , Pierre Marza , Paul-Henry Cournède , Stergios Christodoulidis , Maria Vakalopoulou , Ismail Ben Ayed , Jose Dolz

Accurate brain tumor classification is critical for intra-operative decision making in neuro-oncological surgery. However, existing approaches are restricted to a fixed set of predefined classes and are therefore unable to capture patterns…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Matthias Perkonigg , Patrick Rockenschaub , Georg Göbel , Adelheid Wöhrer

In this paper, we propose a new mathematical optimization model for multiclass classification based on arrangements of hyperplanes. Our approach preserves the core support vector machine (SVM) paradigm of maximizing class separation while…

Optimization and Control · Mathematics 2025-10-07 Víctor Blanco , Harshit Kothari , James Luedtke

Missing data is a significant problem impacting all domains. State-of-the-art framework for minimizing missing data bias is multiple imputation, for which the choice of an imputation model remains nontrivial. We propose a multiple…

Machine Learning · Computer Science 2018-02-20 Lovedeep Gondara , Ke Wang

Partial Information Decomposition (PID) is a principled and flexible method to unveil complex high-order interactions in multi-unit network systems. Though being defined exclusively for random variables, PID is ubiquitously applied to…

In today's heavily overparameterized models, the value of the training loss provides few guarantees on model generalization ability. Indeed, optimizing only the training loss value, as is commonly done, can easily lead to suboptimal model…

Machine Learning · Computer Science 2021-04-30 Pierre Foret , Ariel Kleiner , Hossein Mobahi , Behnam Neyshabur

Semantically connecting users and items is a fundamental problem for the matching stage of an industrial recommender system. Recent advances in this topic are based on multi-channel retrieval to efficiently measure users' interest on items…

Information Retrieval · Computer Science 2022-02-15 Yujie Lu , Ping Nie , Shengyu Zhang , Ming Zhao , Ruobing Xie , William Yang Wang , Yi Ren

Generalized Category Discovery (GCD) aims to classify test-time samples into either seen categories** -- available during training -- or novel ones, without relying on label supervision. Most existing GCD methods assume simultaneous access…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Vaibhav Rathore , Divyam Gupta , Biplab Banerjee

We tackle the generalized category discovery (GCD) problem, which aims to discover novel classes in unlabeled datasets by leveraging the knowledge of known classes. Previous works utilize the known class knowledge through shared…

Computer Vision and Pattern Recognition · Computer Science 2025-02-07 Chuyu Zhang , Peiyan Gu , Xueyang Yu , Xuming He

Generalized category discovery (GCD) aims at addressing a more realistic and challenging setting of semi-supervised learning, where only part of the category labels are assigned to certain training samples. Previous methods generally employ…

Computer Vision and Pattern Recognition · Computer Science 2024-02-02 Yuanpeng Tu , Zhun Zhong , Yuxi Li , Hengshuang Zhao

We study the problem of learning multi-index models (MIMs), where the label depends on the input $\boldsymbol{x} \in \mathbb{R}^d$ only through an unknown $\mathsf{s}$-dimensional projection $\boldsymbol{W}_*^\mathsf{T} \boldsymbol{x} \in…

Statistics Theory · Mathematics 2026-02-11 Hugo Latourelle-Vigeant , Theodor Misiakiewicz

Variational mutual information (MI) estimators are widely used in unsupervised representation learning methods such as contrastive predictive coding (CPC). A lower bound on MI can be obtained from a multi-class classification problem, where…

Machine Learning · Computer Science 2020-12-04 Jiaming Song , Stefano Ermon

In robotics, methods and softwares usually require optimizations of hyperparameters in order to be efficient for specific tasks, for instance industrial bin-picking from homogeneous heaps of different objects. We present a developmental…

Robotics · Computer Science 2020-07-31 Maxime Petit , Emmanuel Dellandrea , Liming Chen

Bivariate partial information decompositions (PIDs) characterize how the information in a "message" random variable is decomposed between two "constituent" random variables in terms of unique, redundant and synergistic information…

Information Theory · Computer Science 2023-07-21 Praveen Venkatesh , Gabriel Schamberg

Mixed-integer linear programming (MILP) is widely employed for modeling combinatorial optimization problems. In practice, similar MILP instances with only coefficient variations are routinely solved, and machine learning (ML) algorithms are…

Optimization and Control · Mathematics 2023-03-07 Qingyu Han , Linxin Yang , Qian Chen , Xiang Zhou , Dong Zhang , Akang Wang , Ruoyu Sun , Xiaodong Luo

In open-world scenarios, Generalized Category Discovery (GCD) requires identifying both known and novel categories within unlabeled data. However, existing methods often suffer from prototype confusion caused by shortcut learning, which…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Kailin Lyu , Jianwei He , Long Xiao , Jianing Zeng , Liang Fan , Lin Shu , Jie Hao