English
Related papers

Related papers: Memory-Based Shallow Parsing

200 papers

This paper studies the problem of semi-supervised video object segmentation(VOS). Multiple works have shown that memory-based approaches can be effective for video object segmentation. They are mostly based on pixel-level matching, both…

Computer Vision and Pattern Recognition · Computer Science 2021-04-12 Li Hu , Peng Zhang , Bang Zhang , Pan Pan , Yinghui Xu , Rong Jin

The evolving capabilities of large language models are accompanied by growing sizes and deployment costs, necessitating effective inference optimisation techniques. We propose a novel pruning method utilising centrality measures from graph…

Machine Learning · Computer Science 2024-12-02 David Hoffmann , Kailash Budhathoki , Matthaeus Kleindessner

We present Hierarchical Memory Matching Network (HMMN) for semi-supervised video object segmentation. Based on a recent memory-based method [33], we propose two advanced memory read modules that enable us to perform memory reading in…

Computer Vision and Pattern Recognition · Computer Science 2021-09-24 Hongje Seong , Seoung Wug Oh , Joon-Young Lee , Seongwon Lee , Suhyeon Lee , Euntai Kim

Estimating the log-likelihood of a given sentence under an autoregressive language model is straightforward: one can simply apply the chain rule and sum the log-likelihood values for each successive token. However, for masked language…

Computation and Language · Computer Science 2023-05-24 Carina Kauf , Anna Ivanova

We address the problem of weakly-supervised semantic segmentation (WSSS) using bounding box annotations. Although object bounding boxes are good indicators to segment corresponding objects, they do not specify object boundaries, making it…

Computer Vision and Pattern Recognition · Computer Science 2021-04-05 Youngmin Oh , Beomjun Kim , Bumsub Ham

Weakly Labelled learning has garnered lot of attention in recent years due to its potential to scale Sound Event Detection (SED) and is formulated as Multiple Instance Learning (MIL) problem. This paper proposes a Multi-Task Learning (MTL)…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-02 Soham Deshmukh , Bhiksha Raj , Rita Singh

This work presents a novel approach for semi-supervised semantic segmentation. The key element of this approach is our contrastive learning module that enforces the segmentation network to yield similar pixel-level feature representations…

Computer Vision and Pattern Recognition · Computer Science 2021-08-09 Inigo Alonso , Alberto Sabater , David Ferstl , Luis Montesano , Ana C. Murillo

This paper presents a new view of Explanation-Based Learning (EBL) of natural language parsing. Rather than employing EBL for specializing parsers by inferring new ones, this paper suggests employing EBL for learning how to reduce ambiguity…

cmp-lg · Computer Science 2008-02-03 Khalil Sima'an

Recent research has revealed that deep neural networks often take dataset biases as a shortcut to make decisions rather than understand tasks, leading to failures in real-world applications. In this study, we focus on the spurious…

Computation and Language · Computer Science 2023-06-23 Yanrui Du , Jing Yan , Yan Chen , Jing Liu , Sendong Zhao , Qiaoqiao She , Hua Wu , Haifeng Wang , Bing Qin

Event extraction (EE) plays an important role in many industrial application scenarios, and high-quality EE methods require a large amount of manual annotation data to train supervised learning models. However, the cost of obtaining…

Computation and Language · Computer Science 2023-03-21 Shirong Shen , Zhen Li , Guilin Qi

Name tagging in low-resource languages or domains suffers from inadequate training data. Existing work heavily relies on additional information, while leaving those noisy annotations unexplored that extensively exist on the web. In this…

Computation and Language · Computer Science 2019-08-27 Yixin Cao , Zikun Hu , Tat-Seng Chua , Zhiyuan Liu , Heng Ji

The dominant approach in probing neural networks for linguistic properties is to train a new shallow multi-layer perceptron (MLP) on top of the model's internal representations. This approach can detect properties encoded in the model, but…

Computation and Language · Computer Science 2021-04-09 Steven Cao , Victor Sanh , Alexander M. Rush

The black-box nature of Large Language Models necessitates novel evaluation frameworks that transcend surface-level performance metrics. This study investigates the internal neural representations of cognitive complexity using Bloom's…

Artificial Intelligence · Computer Science 2026-02-20 Bianca Raimondi , Maurizio Gabbrielli

Reinforcement learning under partial observability requires deciding what information to retain, yet most memory-based approaches do not explicitly model short-term-to-long-term transfer of symbolic observations. We study this transfer…

Machine Learning · Computer Science 2026-05-22 Taewoon Kim , Vincent François-Lavet , Michael Cochez

Keyword spotting (KWS) on mobile devices generally requires a small memory footprint. However, most current models still maintain a large number of parameters in order to ensure good performance. In this paper, we propose a temporally…

Sound · Computer Science 2021-08-30 Shenghua Hu , Jing Wang , Yujun Wang , Wenjing Yang

Weakly supervised semantic segmentation (WSSS) has gained significant popularity since it relies only on weak labels such as image level annotations rather than pixel level annotations required by supervised semantic segmentation (SSS)…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Kunhao Yuan , Gerald Schaefer , Yu-Kun Lai , Yifan Wang , Xiyao Liu , Lin Guan , Hui Fang

Motivated by the potential for parallel implementation of batch-based algorithms and the accelerated convergence achievable with approximated second order information a limited memory version of the BFGS algorithm has been receiving…

Machine Learning · Computer Science 2023-03-07 Federico Zocco , Seán McLoone

Multimodal Large Language Models (MLLMs) struggle with continual learning, often suffering from catastrophic forgetting when adapting to sequential tasks. We introduce a routing-based architecture that integrates new capabilities while…

Machine Learning · Computer Science 2026-04-08 Jay Mohta , Kenan Emir Ak , Gwang Lee , Dimitrios Dimitriadis , Yan Xu , Mingwei Shen

The Hyperspace Analogue to Language (HAL) model relies on global word co-occurrence matrices to construct distributional semantic representations. While these representations capture lexical relationships effectively, aggregating them into…

Computation and Language · Computer Science 2026-03-23 Ali Sakour , Zoalfekar Sakour

Many NLP learning tasks can be decomposed into several distinct sub-tasks, each associated with a partial label. In this paper we focus on a popular class of learning problems, sequence prediction applied to several sentiment analysis…

Computation and Language · Computer Science 2019-06-05 Xiao Zhang , Dan Goldwasser