English
Related papers

Related papers: Information Competing Process for Learning Diversi…

200 papers

Striking progress has recently been made in understanding human cognition by analyzing how its neuronal underpinnings are engaged in different modes of information processing. Specifically, neural information can be decomposed into…

Neurons and Cognition · Quantitative Biology 2022-10-07 Alexandra M. Proca , Fernando E. Rosas , Andrea I. Luppi , Daniel Bor , Matthew Crosby , Pedro A. M. Mediano

As a part of the Data-Centric AI Competition, we propose a data-centric approach to improve the diversity of the training samples by iterative sampling. The method itself relies strongly on the fidelity of augmented samples and the…

Machine Learning · Computer Science 2021-11-09 Devrim Cavusoglu , Ogulcan Eryuksel , Sinan Altinuc

Given a query composed of a reference image and a relative caption, the Composed Image Retrieval goal is to retrieve images visually similar to the reference one that integrates the modifications expressed by the caption. Given that recent…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Alberto Baldrati , Marco Bertini , Tiberio Uricchio , Alberto del Bimbo

The task of infomin learning aims to learn a representation with high utility while being uninformative about a specified target, with the latter achieved by minimising the mutual information between the representation and the target. It…

Machine Learning · Computer Science 2023-02-22 Yanzhi Chen , Weihao Sun , Yingzhen Li , Adrian Weller

When cast into the Deep Reinforcement Learning framework, many robotics tasks require solving a long horizon and sparse reward problem, where learning algorithms struggle. In such context, Imitation Learning (IL) can be a powerful approach…

Artificial Intelligence · Computer Science 2023-04-14 Alexandre Chenu , Nicolas Perrin-Gilbert , Olivier Sigaud

As machine learning (ML) becomes more prevalent in human-centric applications, there is a growing emphasis on algorithmic fairness and privacy protection. While previous research has explored these areas as separate objectives, there is a…

Machine Learning · Computer Science 2024-02-19 Songjie Xie , Youlong Wu , Jiaxuan Li , Ming Ding , Khaled B. Letaief

Self-supervised learning is an empirically successful approach to unsupervised learning based on creating artificial supervised learning problems. A popular self-supervised approach to representation learning is contrastive learning, which…

Machine Learning · Computer Science 2021-04-16 Christopher Tosh , Akshay Krishnamurthy , Daniel Hsu

Information theory has inspired numerous advancements in multi-view learning. Most multi-view methods incorporating information-theoretic principles rely an assumption called multi-view redundancy which states that common information…

Machine Learning · Computer Science 2025-09-03 Long Shi , Yunshan Ye , Wenjie Wang , Tao Lei , Yu Zhao , Gang Kou , Badong Chen

A competitive learning model was introduced in Ref. 1 (A. Mehta and J. M. Luck, Phys. Rev. E 60, 5, 1999), in which the learning is outcome-related. Every individual chooses between a pair of existing strategies or types, guided by a…

Adaptation and Self-Organizing Systems · Physics 2011-07-11 Gaurang Mahajan , Anita Mehta

Recent success in training deep neural networks have prompted active investigation into the features learned on their intermediate layers. Such research is difficult because it requires making sense of non-linear computations performed by…

Machine Learning · Computer Science 2016-03-01 Yixuan Li , Jason Yosinski , Jeff Clune , Hod Lipson , John Hopcroft

Representation learning is increasingly employed to generate representations that are predictive across multiple downstream tasks. The development of representation learning algorithms that provide strong fairness guarantees is thus…

Machine Learning · Computer Science 2023-10-25 Yuhong Luo , Austin Hoag , Philip S. Thomas

Incremental learning aims to enable machine learning models to continuously acquire new knowledge given new classes, while maintaining the knowledge already learned for old classes. Saving a subset of training samples of previously seen…

Computer Vision and Pattern Recognition · Computer Science 2021-04-22 Jian Jiang , Edoardo Cetin , Oya Celiktutan

Learning disentangled representations of natural language is essential for many NLP tasks, e.g., conditional text generation, style transfer, personalized dialogue systems, etc. Similar problems have been studied extensively for other forms…

Machine Learning · Computer Science 2022-01-13 Pengyu Cheng , Martin Renqiang Min , Dinghan Shen , Christopher Malon , Yizhe Zhang , Yitong Li , Lawrence Carin

The information bottleneck (IB) principle has been adopted to explain deep learning in terms of information compression and prediction, which are balanced by a trade-off hyperparameter. How to optimize the IB principle for better robustness…

Machine Learning · Computer Science 2021-03-04 Penglong Zhai , Shihua Zhang

Deep learning architectures have shown remarkable results in scene understanding problems, however they exhibit a critical drop of performances when they are required to learn incrementally new tasks without forgetting old ones. This…

Computer Vision and Pattern Recognition · Computer Science 2021-01-22 Umberto Michieli , Pietro Zanuttigh

With the rise of deep learning algorithms nowadays, scene image representation methods have achieved a significant performance boost in classification. However, the performance is still limited because the scene images are mostly complex…

Computer Vision and Pattern Recognition · Computer Science 2023-06-13 Chiranjibi Sitaula , Tej Bahadur Shahi , Faezeh Marzbanrad , Jagannath Aryal

Learning discriminative powerful representations is a crucial step for machine learning systems. Introducing invariance against arbitrary nuisance or sensitive attributes while performing well on specific tasks is an important problem in…

Computer Vision and Pattern Recognition · Computer Science 2020-07-07 Mhd Hasan Sarhan , Nassir Navab , Abouzar Eslami , Shadi Albarqouni

The game of bridge consists of two stages: bidding and playing. While playing is proved to be relatively easy for computer programs, bidding is very challenging. During the bidding stage, each player knowing only his/her own cards needs to…

Artificial Intelligence · Computer Science 2019-03-06 Jiang Rong , Tao Qin , Bo An

Despite the success of a number of recent techniques for visual self-supervised deep learning, there has been limited investigation into the representations that are ultimately learned. By leveraging recent advances in the comparison of…

Computer Vision and Pattern Recognition · Computer Science 2021-12-06 Tom George Grigg , Dan Busbridge , Jason Ramapuram , Russ Webb

Remote sensing image segmentation faces persistent challenges in distinguishing morphologically similar categories and adapting to diverse scene variations. While existing methods rely on implicit representation learning paradigms, they…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Xuechao Zou , Yue Li , Shun Zhang , Kai Li , Shiying Wang , Pin Tao , Junliang Xing , Congyan Lang