English
Related papers

Related papers: Dynamic Memory Induction Networks for Few-Shot Tex…

200 papers

Attention mechanisms have demonstrated significant potential in enhancing learning models by identifying key portions of input data, particularly in scenarios with limited training samples. Inspired by human perception, we propose that…

Artificial Intelligence · Computer Science 2025-04-22 Bahareh Nikpour , Narges Armanfard

Multivariate time series classification is an important task with widespread domains of applications. Recently, deep neural networks (DNN) have achieved state-of-the-art performance in time series classification. However, they often require…

Machine Learning · Computer Science 2024-09-17 Jesus Barreda , Ashley Gomez , Ruben Puga , Kaixiong Zhou , Li Zhang

Traditional fine-grained image classification typically relies on large-scale training samples with annotated ground-truth. However, some sub-categories have few available samples in real-world applications, and current few-shot models…

Computer Vision and Pattern Recognition · Computer Science 2022-10-27 Hegui Zhu , Zhan Gao , Jiayi Wang , Yange Zhou , Chengqing Li

In this paper, we propose a novel probabilistic self-supervised learning via Scoring Rule Minimization (ProSMIN), which leverages the power of probabilistic models to enhance representation quality and mitigate collapsing representations.…

Machine Learning · Computer Science 2023-09-06 Amirhossein Vahidi , Simon Schoßer , Lisa Wimmer , Yawei Li , Bernd Bischl , Eyke Hüllermeier , Mina Rezaei

We introduce the Dynamic Capacity Network (DCN), a neural network that can adaptively assign its capacity across different portions of the input data. This is achieved by combining modules of two types: low-capacity sub-networks and…

Machine Learning · Computer Science 2016-05-24 Amjad Almahairi , Nicolas Ballas , Tim Cooijmans , Yin Zheng , Hugo Larochelle , Aaron Courville

Sequential recommendation has become increasingly essential in various online services. It aims to model the dynamic preferences of users from their historical interactions and predict their next items. The accumulated user behavior records…

Information Retrieval · Computer Science 2021-02-19 Qiaoyu Tan , Jianwei Zhang , Ninghao Liu , Xiao Huang , Hongxia Yang , Jingren Zhou , Xia Hu

In recent years, deep learning has increasingly gained attention in the field of traffic prediction. Existing traffic prediction models often rely on GCNs or attention mechanisms with O(N^2) complexity to dynamically extract traffic node…

Machine Learning · Computer Science 2024-08-15 Wenchao Weng , Mei Wu , Hanyu Jiang , Wanzeng Kong , Xiangjie Kong , Feng Xia

With the rapid development of Deep Learning, more and more applications on the cloud and edge tend to utilize large DNN (Deep Neural Network) models for improved task execution efficiency as well as decision-making quality. Due to memory…

Machine Learning · Computer Science 2024-07-02 Jingran Shen , Nikos Tziritas , Georgios Theodoropoulos

Deep neural networks (DNNs) excel in computer vision tasks, especially, few-shot learning (FSL), which is increasingly important for generalizing from limited examples. However, DNNs are computationally expensive with scalability issues in…

Machine Learning · Computer Science 2025-05-16 Qi Xu , Junyang Zhu , Dongdong Zhou , Hao Chen , Yang Liu , Jiangrong Shen , Qiang Zhang

Few-shot action recognition aims at quickly adapting a pre-trained model to the novel data with a distribution shift using only a limited number of samples. Key challenges include how to identify and leverage the transferable knowledge…

Computer Vision and Pattern Recognition · Computer Science 2024-06-06 Yuke Li , Guangyi Chen , Ben Abramowitz , Stefano Anzellott , Donglai Wei

Image classification serves as the cornerstone of computer vision, traditionally achieved through discriminative models based on deep neural networks. Recent advancements have introduced classification methods derived from generative…

Computer Vision and Pattern Recognition · Computer Science 2024-12-16 Chunxiao Li , Xiaoxiao Wang , Boming Miao , Chuanlong Xie , Zizhe Wang , Yao Zhu

State-of-the-art deep learning algorithms generally require large amounts of data for model training. Lack thereof can severely deteriorate the performance, particularly in scenarios with fine-grained boundaries between categories. To this…

Computer Vision and Pattern Recognition · Computer Science 2018-06-15 Frederik Pahde , Patrick Jähnichen , Tassilo Klein , Moin Nabi

Few-shot learning has been successfully applied to medical image classification as only very few medical examples are available for training. Due to the challenging problem of limited number of annotated medical images, image…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Zhenwei Wang , Qiule Sun , Bingbing Zhang , Pengfei Wang , Jianxin Zhang , Qiang Zhang

As labeling cost for different modules in task-oriented dialog (ToD) systems is high, a major challenge in practice is to learn different tasks with the least amount of labeled data. Recently, prompting methods over pre-trained language…

Computation and Language · Computer Science 2022-03-22 Fei Mi , Yitong Li , Yasheng Wang , Xin Jiang , Qun Liu

The effectiveness of Neural Information Retrieval (Neu-IR) often depends on a large scale of in-domain relevance training signals, which are not always available in real-world ranking scenarios. To democratize the benefits of Neu-IR, this…

Information Retrieval · Computer Science 2021-06-03 Si Sun , Yingzhuo Qian , Zhenghao Liu , Chenyan Xiong , Kaitao Zhang , Jie Bao , Zhiyuan Liu , Paul Bennett

Recent few-shot learning works focus on training a model with prior meta-knowledge to fast adapt to new tasks with unseen classes and samples. However, conventional time-series classification algorithms fail to tackle the few-shot scenario.…

Machine Learning · Computer Science 2020-07-03 Wensi Tang , Lu Liu , Guodong Long

The deployment of deep neural networks in real-world applications is mostly restricted by their high inference costs. Extensive efforts have been made to improve the accuracy with expert-designed or algorithm-searched architectures.…

Machine Learning · Computer Science 2020-11-10 Shaofeng Cai , Yao Shu , Wei Wang , Beng Chin Ooi

Autonomous systems (AS) often use Deep Neural Network (DNN) classifiers to allow them to operate in complex, high-dimensional, non-linear, and dynamically changing environments. Due to the complexity of these environments, DNN classifiers…

Machine Learning · Computer Science 2024-08-16 Abanoub Ghobrial , Xuan Zheng , Darryl Hond , Hamid Asgari , Kerstin Eder

Intent detection is one of the core components of goal-oriented dialog systems, and detecting out-of-scope (OOS) intents is also a practically important skill. Few-shot learning is attracting much attention to mitigate data scarcity, but…

Computation and Language · Computer Science 2020-10-27 Jian-Guo Zhang , Kazuma Hashimoto , Wenhao Liu , Chien-Sheng Wu , Yao Wan , Philip S. Yu , Richard Socher , Caiming Xiong

In this work, we aim to solve data-driven optimization problems, where the goal is to find an input that maximizes an unknown score function given access to a dataset of inputs with corresponding scores. When the inputs are high-dimensional…

Machine Learning · Computer Science 2020-01-01 Aviral Kumar , Sergey Levine