English
Related papers

Related papers: High-Order Conditional Mutual Information Maximiza…

200 papers

Binary vector embeddings enable fast nearest neighbor retrieval in large databases of high-dimensional objects, and play an important role in many practical applications, such as image and video retrieval. We study the problem of learning…

Computer Vision and Pattern Recognition · Computer Science 2018-06-26 Fatih Cakir , Kun He , Sarah Adel Bargal , Stan Sclaroff

In the era of big data, learning from categorical features with very large vocabularies (e.g., 28 million for the Criteo click prediction dataset) has become a practical challenge for machine learning researchers and practitioners. We…

Machine Learning · Computer Science 2019-05-01 MohammadHossein Bateni , Lin Chen , Hossein Esfandiari , Thomas Fu , Vahab S. Mirrokni , Afshin Rostamizadeh

We propose an approach to self-supervised representation learning based on maximizing mutual information between features extracted from multiple views of a shared context. For example, one could produce multiple views of a local…

Machine Learning · Computer Science 2019-07-09 Philip Bachman , R Devon Hjelm , William Buchwalter

Mutual Information (MI) based feature selection makes use of MI to evaluate each feature and eventually shortlists a relevant feature subset, in order to address issues associated with high-dimensional datasets. Despite the effectiveness of…

Machine Learning · Computer Science 2022-12-20 Shiyu Liu , Mehul Motani

Choosing which properties of the data to use as input to multivariate decision algorithms -- a.k.a. feature selection -- is an important step in solving any problem with machine learning. While there is a clear trend towards training…

High Energy Physics - Phenomenology · Physics 2022-12-02 Ranit Das , Gregor Kasieczka , David Shih

In this work, we perform unsupervised learning of representations by maximizing mutual information between an input and the output of a deep neural network encoder. Importantly, we show that structure matters: incorporating knowledge about…

Non-orthogonal multiple access (NOMA) technique is important for achieving a high data rate in next-generation wireless communications. A key challenge to fully utilizing the effectiveness of the NOMA technique is the optimization of the…

Information Theory · Computer Science 2024-10-28 Teppei Otsuka , Aohan Li , Hiroki Takesue , Kensuke Inaba , Kazuyuki Aihara , Mikio Hasegawa

High-dimensional datasets depict a challenge for learning tasks in data mining and machine learning. Feature selection is an effective technique in dealing with dimensionality reduction. It is often an essential data processing step prior…

Machine Learning · Computer Science 2023-09-18 Gustavo Sosa-Cabrera , Santiago Gómez-Guerrero , Miguel García-Torres , Christian E. Schaerer

Providing natural language-based explanations to justify recommendations helps to improve users' satisfaction and gain users' trust. However, as current explanation generation methods are commonly trained with an objective to mimic existing…

Information Retrieval · Computer Science 2024-08-22 Yurou Zhao , Yiding Sun , Ruidong Han , Fei Jiang , Lu Guan , Xiang Li , Wei Lin , Weizhi Ma , Jiaxin Mao

Modeling holistic user interests is important for improving recommendation systems but is challenged by high computational cost and difficulty in handling diverse information with full behavior context. Existing search-based methods might…

Information Retrieval · Computer Science 2025-04-10 Yong Bai , Rui Xiang , Kaiyuan Li , Yongxiang Tang , Yanhua Cheng , Xialong Liu , Peng Jiang , Kun Gai

Feature selection is one of the most important problems in hyperspectral images classification. It consists to choose the most informative bands from the entire set of input datasets and discard the noisy, redundant and irrelevant ones. In…

Computer Vision and Pattern Recognition · Computer Science 2022-10-27 Hasna Nhaila , Asma Elmaizi , Elkebir Sarhrouni , Ahmed Hammouch

Mutual Information (MI) and Conditional Mutual Information (CMI) are multi-purpose tools from information theory that are able to naturally measure the statistical dependencies between random variables, thus they are usually of central…

Machine Learning · Computer Science 2022-11-22 Bao Duong , Thin Nguyen

Minimum redundancy among different elements of an embedding in a latent space is a fundamental requirement or major preference in representation learning to capture intrinsic informational structures. Current self-supervised learning…

Machine Learning · Computer Science 2022-07-19 Chuang Niu , Ge Wang

This paper introduces a high-performance hybrid algorithm, called Hybrid Hypervolume Maximization Algorithm (H2MA), for multi-objective optimization that alternates between exploring the decision space and exploiting the already obtained…

Neural and Evolutionary Computing · Computer Science 2015-06-18 Conrado Silva Miranda , Fernando José Von Zuben

Mutual Information (MI) is a powerful statistical measure that quantifies shared information between random variables, particularly valuable in high-dimensional data analysis across fields like genomics, natural language processing, and…

Machine Learning · Computer Science 2024-12-02 Andre O. Falcao

We aim to discover manipulation concepts embedded in the unannotated demonstrations, which are recognized as key physical states. The discovered concepts can facilitate training manipulation policies and promote generalization. Current…

Robotics · Computer Science 2024-07-23 Pei Zhou , Yanchao Yang

The main feature of large-scale multi-objective optimization problems (LSMOP) is to optimize multiple conflicting objectives while considering thousands of decision variables at the same time. An efficient LSMOP algorithm should have the…

Neural and Evolutionary Computing · Computer Science 2021-08-10 Haokai Hong , Kai Ye , Min Jiang , Donglin Cao , Kay Chen Tan

Higher-order community detection (HCD) reveals both mesoscale structures and functional characteristics of real-life networks. Although many methods have been developed from diverse perspectives, to our knowledge, none can provide…

Physics and Society · Physics 2024-07-11 Jing Xiao , Ya-Wei Wei , Xiao-Ke Xu

The concepts of conditional mutual information (CMI) and normalized conditional mutual information (NCMI) are introduced to measure the concentration and separation performance of a classification deep neural network (DNN) in the output…

Machine Learning · Computer Science 2023-09-19 En-Hui Yang , Shayan Mohajer Hamidi , Linfeng Ye , Renhao Tan , Beverly Yang

The identification of relevant features, i.e., the driving variables that determine a process or the properties of a system, is an essential part of the analysis of data sets with a large number of variables. A mathematical rigorous…

Machine Learning · Statistics 2022-08-02 Benjamin Regler , Matthias Scheffler , Luca M. Ghiringhelli