English
Related papers

Related papers: Learning Symbolic Model-Agnostic Loss Functions vi…

200 papers

We develop a functional encoder-decoder approach to supervised meta-learning, where labeled data is encoded into an infinite-dimensional functional representation rather than a finite-dimensional one. Furthermore, rather than directly…

Machine Learning · Statistics 2020-08-18 Jin Xu , Jean-Francois Ton , Hyunjik Kim , Adam R. Kosiorek , Yee Whye Teh

Few-shot learning, a challenging task in machine learning, aims to learn a classifier adaptable to recognize new, unseen classes with limited labeled examples. Meta-learning has emerged as a prominent framework for few-shot learning. Its…

Machine Learning · Computer Science 2024-03-07 Weihao Jiang , Guodong Liu , Di He , Kun He

In recent years, neural systems have demonstrated highly effective learning ability and superior perception intelligence. However, they have been found to lack effective reasoning and cognitive ability. On the other hand, symbolic systems…

Machine Learning · Computer Science 2023-06-27 Dongran Yu , Bo Yang , Dayou Liu , Hui Wang , Shirui Pan

Automatically detecting and recovering from failures is an important but challenging problem for autonomous robots. Most of the recent work on learning to plan from demonstrations lacks the ability to detect and recover from errors in the…

This paper proposes a meta-learning approach to evolving a parametrized loss function, which is called Meta-Loss Network (MLN), for training the image classification learning on small datasets. In our approach, the MLN is embedded in the…

Artificial Intelligence · Computer Science 2023-10-31 Zhaoyang Hai , Xiabi Liu

In the last years, deep learning has dramatically improved the performances in a variety of medical image analysis applications. Among different types of deep learning models, convolutional neural networks have been among the most…

Image and Video Processing · Electrical Eng. & Systems 2021-04-23 Minh H. Vu , Gabriella Norman , Tufve Nyholm , Tommy Löfstedt

We propose a novel and flexible approach to meta-learning for learning-to-learn from only a few examples. Our framework is motivated by actor-critic reinforcement learning, but can be applied to both reinforcement and supervised learning.…

Machine Learning · Computer Science 2017-06-30 Flood Sung , Li Zhang , Tao Xiang , Timothy Hospedales , Yongxin Yang

Objective functions that optimize deep neural networks play a vital role in creating an enhanced feature representation of the input data. Although cross-entropy-based loss formulations have been extensively used in a variety of supervised…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Deen Dayal Mohan , Bhavin Jawade , Srirangaraj Setlur , Venu Govindaraj

Designing a competent meta-reinforcement learning (meta-RL) algorithm in terms of data usage remains a central challenge to be tackled for its successful real-world applications. In this paper, we propose a sample-efficient meta-RL…

Machine Learning · Computer Science 2023-12-12 Jaeuk Shin , Giho Kim , Howon Lee , Joonho Han , Insoon Yang

The goal of neural-symbolic computation is to integrate the connectionist and symbolist paradigms. Prior methods learn the neural-symbolic models using reinforcement learning (RL) approaches, which ignore the error propagation in the…

Machine Learning · Statistics 2020-07-29 Qing Li , Siyuan Huang , Yining Hong , Yixin Chen , Ying Nian Wu , Song-Chun Zhu

In a regression task, a function is learned from labeled data to predict the labels at new data points. The goal is to achieve small prediction errors. In symbolic regression, the goal is more ambitious, namely, to learn an interpretable…

Machine Learning · Computer Science 2025-06-25 Paul Kahlmeyer , Joachim Giesen , Michael Habeck , Henrik Voigt

Meta-learning for few-shot learning entails acquiring a prior over previous tasks and experiences, such that new tasks be learned from small amounts of data. However, a critical challenge in few-shot learning is task ambiguity: even when a…

Machine Learning · Computer Science 2019-10-18 Chelsea Finn , Kelvin Xu , Sergey Levine

Designing proper loss functions for vision tasks has been a long-standing research direction to advance the capability of existing models. For object detection, the well-established classification and regression loss functions have been…

Computer Vision and Pattern Recognition · Computer Science 2021-02-10 Peidong Liu , Gengwei Zhang , Bochao Wang , Hang Xu , Xiaodan Liang , Yong Jiang , Zhenguo Li

Being able to quickly adapt to changes in dynamics is paramount in model-based control for object manipulation tasks. In order to influence fast adaptation of the inverse dynamics model's parameters, data efficiency is crucial. Given…

Robotics · Computer Science 2022-11-28 Kristen Morse , Neha Das , Yixin Lin , Austin S. Wang , Akshara Rai , Franziska Meier

Identifying governing equations for a dynamical system is a topic of critical interest across an array of disciplines, from mathematics to engineering to biology. Machine learning -- specifically deep learning -- techniques have shown their…

Dynamical Systems · Mathematics 2026-05-07 Nibodh Boddupalli , Timothy Matchen , Jeff Moehlis

Class-imbalanced node classification tasks are prevalent in real-world scenarios. Due to the uneven distribution of nodes across different classes, learning high-quality node representations remains a challenging endeavor. The engineering…

Machine Learning · Computer Science 2024-05-24 Xinyu Guo , Kai Wu , Xiaoyu Zhang , Jing Liu

The performance of deep neural networks improves with more annotated data. The problem is that the budget for annotation is limited. One solution to this is active learning, where a model asks human to annotate data that it perceived as…

Computer Vision and Pattern Recognition · Computer Science 2019-05-10 Donggeun Yoo , In So Kweon

This paper presents a hybrid methodology that enhances the training process of deep learning (DL) models by embedding domain expert knowledge using ontologies and answer set programming (ASP). By integrating these symbolic AI methods, we…

Artificial Intelligence · Computer Science 2025-06-10 Fadi Al Machot , Martin Thomas Horsch , Habib Ullah

Deep Metric Learning (DML) learns a non-linear semantic embedding from input data that brings similar pairs together while keeping dissimilar data away from each other. To this end, many different methods are proposed in the last decade…

Computer Vision and Pattern Recognition · Computer Science 2023-01-02 Davood Zabihzadeh , Zahraa Alitbi , Seyed Jalaleddin Mousavirad

Recent work has suggested that a good embedding is all we need to solve many few-shot learning benchmarks. Furthermore, other work has strongly suggested that Model Agnostic Meta-Learning (MAML) also works via this same method - by learning…

Machine Learning · Computer Science 2021-12-28 Brando Miranda , Yu-Xiong Wang , Sanmi Koyejo