English
Related papers

Related papers: Knowledge-Based Learning through Feature Generatio…

200 papers

Deep learning has shown its human-level performance in various applications. However, current deep learning models are characterised by catastrophic forgetting of old knowledge when learning new classes. This poses a challenge particularly…

Machine Learning · Computer Science 2022-04-29 Yang Yang , Zhiying Cui , Junjie Xu , Changhong Zhong , Wei-Shi Zheng , Ruixuan Wang

When deep learning is applied to visual object recognition, data augmentation is often used to generate additional training data without extra labeling cost. It helps to reduce overfitting and increase the performance of the algorithm. In…

Computer Vision and Pattern Recognition · Computer Science 2014-02-18 Alexey Dosovitskiy , Jost Tobias Springenberg , Thomas Brox

Feature generation (FG) aims to enhance the prediction potential of original data by constructing high-order feature combinations and removing redundant features. It is a key preprocessing step for tabular scientific data to improve…

Machine Learning · Computer Science 2025-07-10 Meng Xiao , Junfeng Zhou , Yuanchun Zhou

In everyday reasoning, when we think about a particular object, we associate it with a unique set of expected properties such as weight, size, or more abstract attributes like density or horsepower. These expectations are shaped by our…

Machine Learning · Computer Science 2025-07-01 Piotr Makarevich

In recent years neural networks have achieved impressive results on many technological and scientific tasks. Yet, the mechanism through which these models automatically select features, or patterns in data, for prediction remains unclear.…

Machine Learning · Computer Science 2023-05-11 Adityanarayanan Radhakrishnan , Daniel Beaglehole , Parthe Pandit , Mikhail Belkin

Scene graph generation has received growing attention with the advancements in image understanding tasks such as object detection, attributes and relationship prediction,~\etc. However, existing datasets are biased in terms of object and…

Computer Vision and Pattern Recognition · Computer Science 2019-04-02 Jiuxiang Gu , Handong Zhao , Zhe Lin , Sheng Li , Jianfei Cai , Mingyang Ling

Recent research in feature learning has been extended to sequence data, where each instance consists of a sequence of heterogeneous items with a variable length. However, in many real-world applications, the data exists in the form of…

Machine Learning · Computer Science 2022-01-25 Zhongfang Zhuang

Robust and efficient learning remains a challenging problem in robotics, in particular with complex visual inputs. Inspired by human attention mechanism, with which we quickly process complex visual scenes and react to changes in the…

Robotics · Computer Science 2023-08-30 Daniel Scheuchenstuhl , Stefan Ulmer , Felix Resch , Luigi Berducci , Radu Grosu

Learning auxiliary tasks, such as multiple predictions about the world, can provide many benefits to reinforcement learning systems. A variety of off-policy learning algorithms have been developed to learn such predictions, but as yet there…

Machine Learning · Computer Science 2022-02-24 Matthew McLeod , Chunlok Lo , Matthew Schlegel , Andrew Jacobsen , Raksha Kumaraswamy , Martha White , Adam White

The amount of information in the form of features and variables avail- able to machine learning algorithms is ever increasing. This can lead to classifiers that are prone to overfitting in high dimensions, high di- mensional models do not…

Machine Learning · Computer Science 2014-02-12 Aaron Karper

The representation of feature space is a crucial environment where data points get vectorized and embedded for subsequent modeling. Thus the efficacy of machine learning (ML) algorithms is closely related to the quality of feature…

Machine Learning · Computer Science 2026-01-12 Xinhao Zhang , Jinghan Zhang , Banafsheh Rekabdar , Yuanchun Zhou , Pengfei Wang , Kunpeng Liu

Feature selection aims to identify the most pattern-discriminative feature subset. In prior literature, filter (e.g., backward elimination) and embedded (e.g., Lasso) methods have hyperparameters (e.g., top-K, score thresholding) and tie to…

Machine Learning · Computer Science 2024-03-07 Wangyang Ying , Dongjie Wang , Haifeng Chen , Yanjie Fu

Quality feature representation is key to instance image retrieval. To attain it, existing methods usually resort to a deep model pre-trained on benchmark datasets or even fine-tune the model with a task-dependent labelled auxiliary dataset.…

Computer Vision and Pattern Recognition · Computer Science 2022-08-15 Zhongyan Zhang , Lei Wang , Yang Wang , Luping Zhou , Jianjia Zhang , Peng Wang , Fang Chen

Many recent few-shot learning methods concentrate on designing novel model architectures. In this paper, we instead show that with a simple backbone convolutional network we can even surpass state-of-the-art classification accuracy. The…

Computer Vision and Pattern Recognition · Computer Science 2019-03-26 Wei Shen , Ziqiang Shi , Jun Sun

The goal of machine learning is to provide solutions which are trained by data or by experience coming from the environment. Many training algorithms exist and some brilliant successes were achieved. But even in structured environments for…

Adaptation and Self-Organizing Systems · Physics 2011-09-06 Wolfgang Konen

In this paper, the problem of training a classifier on a dataset with incomplete features is addressed. We assume that different subsets of features (random or structured) are available at each data instance. This situation typically occurs…

Machine Learning · Computer Science 2021-04-20 Cesar F. Caiafa , Ziyao Wang , Jordi Solé-Casals , Qibin Zhao

User behavior on online platforms is evolving, reflecting real-world changes in how people post, whether it's helpful messages or hate speech. Models that learn to capture this content can experience a decrease in performance over time due…

Machine Learning · Computer Science 2025-11-04 Yasas Senarath , Hemant Purohit

Ensembling methods are well known for improving prediction accuracy. However, they are limited in the sense that they cannot discriminate among component models effectively. In this paper, we propose stacking with auxiliary features that…

Computation and Language · Computer Science 2016-05-30 Nazneen Fatema Rajani , Raymond J. Mooney

Deep learning has brought an unprecedented progress in computer vision and significant advances have been made in predicting subjective properties inherent to visual data (e.g., memorability, aesthetic quality, evoked emotions, etc.).…

Machine Learning · Statistics 2018-12-04 Aliaksandr Siarohin , Gloria Zen , Nicu Sebe , Elisa Ricci

High-dimensional measurements are often correlated which motivates their approximation by factor models. This holds also true when features are engineered via low-dimensional interactions or kernel tricks. This often results in over…

Applications · Statistics 2025-09-03 Xiaonan Zhu , Bingyan Wang , Jianqing Fan