English
Related papers

Related papers: Meta-Learning with Dynamic-Memory-Based Prototypic…

200 papers

This paper evaluates Few-Shot Prompting with Large Language Models for Named Entity Recognition (NER). Traditional NER systems rely on extensive labeled datasets, which are costly and time-consuming to obtain. Few-Shot Prompting or…

Information Retrieval · Computer Science 2024-09-05 Hédi Zeghidi , Ludovic Moncla

Online power system event identification and classification is crucial to enhancing the reliability of transmission systems. In this paper, we develop a deep neural network (DNN) based approach to identify and classify power system events…

Machine Learning · Computer Science 2021-04-30 Jie Shi , Brandon Foggo , Nanpeng Yu

Humans excel at lifelong learning, as the brain has evolved to be robust to distribution shifts and noise in our ever-changing environment. Deep neural networks (DNNs), however, exhibit catastrophic forgetting and the learned…

Machine Learning · Computer Science 2023-02-23 Fahad Sarfraz , Elahe Arani , Bahram Zonooz

Traditional continual event detection relies on abundant labeled data for training, which is often impractical to obtain in real-world applications. In this paper, we introduce continual few-shot event detection (CFED), a more commonly…

Computation and Language · Computer Science 2024-03-27 Chenlong Zhang , Pengfei Cao , Yubo Chen , Kang Liu , Zhiqiang Zhang , Mengshu Sun , Jun Zhao

Most tasks in natural language processing can be cast into question answering (QA) problems over language input. We introduce the dynamic memory network (DMN), a neural network architecture which processes input sequences and questions,…

Computation and Language · Computer Science 2016-03-08 Ankit Kumar , Ozan Irsoy , Peter Ondruska , Mohit Iyyer , James Bradbury , Ishaan Gulrajani , Victor Zhong , Romain Paulus , Richard Socher

To predict rare extreme events using deep neural networks, one encounters the so-called small data problem because even long-term observations often contain few extreme events. Here, we investigate a model-assisted framework where the…

Machine Learning · Computer Science 2022-04-20 Anna Asch , Ethan Brady , Hugo Gallardo , John Hood , Bryan Chu , Mohammad Farazmand

Few-shot named entity recognition (NER) enables us to build a NER system for a new domain using very few labeled examples. However, existing prototypical networks for this task suffer from roughly estimated label dependency and closely…

Computation and Language · Computer Science 2022-08-18 Bin Ji , Shasha Li , Shaoduo Gan , Jie Yu , Jun Ma , Huijun Liu

Event extraction (EE) is the task of identifying interested event mentions from text. Conventional efforts mainly focus on the supervised setting. However, these supervised models cannot generalize to event types out of the pre-defined…

Computation and Language · Computer Science 2022-11-15 Hongming Zhang , Wenlin Yao , Dong Yu

Deep neural networks are highly effective when a large number of labeled samples are available but fail with few-shot classification tasks. Recently, meta-learning methods have received much attention, which train a meta-learner on massive…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Yucan Zhou , Yu Wang , Jianfei Cai , Yu Zhou , Qinghua Hu , Weiping Wang

In recent years, deep learning has increasingly gained attention in the field of traffic prediction. Existing traffic prediction models often rely on GCNs or attention mechanisms with O(N^2) complexity to dynamically extract traffic node…

Machine Learning · Computer Science 2024-08-15 Wenchao Weng , Mei Wu , Hanyu Jiang , Wanzeng Kong , Xiangjie Kong , Feng Xia

Meta-learning methods have been widely used in few-shot named entity recognition (NER), especially prototype-based methods. However, the Other(O) class is difficult to be represented by a prototype vector because there are generally a large…

Computation and Language · Computer Science 2023-02-16 Chengcheng Han , Renyu Zhu , Jun Kuang , FengJiao Chen , Xiang Li , Ming Gao , Xuezhi Cao , Wei Wu

A catastrophic forgetting problem makes deep neural networks forget the previously learned information, when learning data collected in new environments, such as by different sensors or in different light conditions. This paper presents a…

Machine Learning · Computer Science 2016-07-04 Heechul Jung , Jeongwoo Ju , Minju Jung , Junmo Kim

Event detection (ED), aiming to detect events from texts and categorize them, is vital to understanding actual happenings in real life. However, mainstream event detection models require high-quality expert human annotations of triggers,…

Computation and Language · Computer Science 2022-08-23 Jiachen Zhao , Haiqin Yang

Deep networks can learn to accurately recognize objects of a category by training on a large number of annotated images. However, a meta-learning challenge known as a low-shot image recognition task comes when only a few images with…

Computer Vision and Pattern Recognition · Computer Science 2021-01-14 Mengting Chen , Xinggang Wang , Heng Luo , Yifeng Geng , Wenyu Liu

Few-shot learning is a challenging task that aims at training a classifier for unseen classes with only a few training examples. The main difficulty of few-shot learning lies in the lack of intra-class diversity within insufficient training…

Computer Vision and Pattern Recognition · Computer Science 2020-01-01 Mengting Chen , Yuxin Fang , Xinggang Wang , Heng Luo , Yifeng Geng , Xinyu Zhang , Chang Huang , Wenyu Liu , Bo Wang

Meta-learning has been proposed as a framework to address the challenging few-shot learning setting. The key idea is to leverage a large number of similar few-shot tasks in order to learn how to adapt a base-learner to a new task for which…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Qianru Sun , Yaoyao Liu , Tat-Seng Chua , Bernt Schiele

For many natural language processing (NLP) tasks the amount of annotated data is limited. This urges a need to apply semi-supervised learning techniques, such as transfer learning or meta-learning. In this work we tackle Named Entity…

Computation and Language · Computer Science 2018-12-18 Alexander Fritzler , Varvara Logacheva , Maksim Kretov

A new data-driven method is proposed to detect events in the data streams from distribution-level phasor measurement units, a.k.a., micro-PMUs. The proposed method is developed by constructing unsupervised deep learning anomaly detection…

Systems and Control · Electrical Eng. & Systems 2021-02-02 Armin Aligholian , Alireza Shahsavari , Ed Cortez , Emma Stewart , Hamed Mohsenian-Rad

In the field of computational physics and material science, the efficient sampling of rare events occurring at atomic scale is crucial. It aids in understanding mechanisms behind a wide range of important phenomena, including protein…

Machine Learning · Computer Science 2024-01-17 Xinru Hua , Rasool Ahmad , Jose Blanchet , Wei Cai

Few-shot meta-learning presents a challenge for gradient descent optimization due to the limited number of training samples per task. To address this issue, we propose an episodic memory optimization for meta-learning, we call EMO, which is…

Machine Learning · Computer Science 2023-06-28 Yingjun Du , Jiayi Shen , Xiantong Zhen , Cees G. M. Snoek