中文
相关论文

相关论文: Binary Token-Level Classification with DeBERTa for…

200 篇论文

We propose an ensemble model for predicting the lexical complexity of words and multiword expressions (MWEs). The model receives as input a sentence with a target word or MWEand outputs its complexity score. Given that a key challenge with…

计算与语言 · 计算机科学 2021-06-16 Yuki Taya , Lis Kanashiro Pereira , Fei Cheng , Ichiro Kobayashi

This paper shines a light on the potential of definition-based semantic models for detecting idiomatic and semi-idiomatic multiword expressions (MWEs) in clinical terminology. Our study focuses on biomedical entities defined in the UMLS…

计算与语言 · 计算机科学 2023-05-12 François Remy , Alfiya Khabibullina , Thomas Demeester

SemEval-2024 Task 8 introduces the challenge of identifying machine-generated texts from diverse Large Language Models (LLMs) in various languages and domains. The task comprises three subtasks: binary classification in monolingual and…

计算与语言 · 计算机科学 2024-01-24 Feng Xiong , Thanet Markchom , Ziwei Zheng , Subin Jung , Varun Ojha , Huizhi Liang

We present our system for SemEval-2026 Task 9: Multilingual Polarization Detection, a binary classification task spanning 22 languages. Our approach fine-tunes separate Gemma~3 models (12B and 27B parameters) per language using Low-Rank…

计算与语言 · 计算机科学 2026-05-07 Srikar Kashyap Pulipaka

Safe and reliable natural language inference is critical for extracting insights from clinical trial reports but poses challenges due to biases in large pre-trained language models. This paper presents a novel data augmentation technique to…

计算与语言 · 计算机科学 2024-04-16 Yuqi Wang , Zeqiang Wang , Wei Wang , Qi Chen , Kaizhu Huang , Anh Nguyen , Suparna De

This paper presents our system for the MLC-SLM Challenge 2025, focusing on multilingual speech recognition and language modeling with large language models (LLMs). Our approach combines a fine-tuned Whisper-large-v3 encoder with efficient…

计算与语言 · 计算机科学 2025-07-08 Tuan Nguyen , Long-Vu Hoang , Huy-Dat Tran

Extracting clinically relevant information from unstructured medical narratives such as admission notes, discharge summaries, and emergency case histories remains a challenge in clinical natural language processing (NLP). Medical Entity…

Dataset curation has become a basis for strong large language model (LLM) performance. While various rule-based filtering heuristics exist for English and multilingual datasets, model-based filtering techniques have primarily focused on…

计算与语言 · 计算机科学 2026-02-20 Bettina Messmer , Vinko Sabolčec , Martin Jaggi

For different language pairs, word-level neural machine translation (NMT) models with a fixed-size vocabulary suffer from the same problem of representing out-of-vocabulary (OOV) words. The common practice usually replaces all these rare or…

计算与语言 · 计算机科学 2018-07-26 Yingting Wu , Hai Zhao

This paper aims to construct a linguistic resource of Korean Multiword Expressions for Feature-Based Sentiment Analysis (FBSA): DECO-MWE. Dealing with multiword expressions (MWEs) has been a critical issue in FBSA since many constructs…

计算与语言 · 计算机科学 2026-05-12 Jaeho Han , Changhoe Hwang , Seongyong Choi , Gwanghoon Yoo , Eric Laporte , Jeesun Nam

This paper presents our approach for SemEval 2025 Task 11 Track A, focusing on multilabel emotion classification across 28 languages. We explore two main strategies: fully fine-tuning transformer models and classifier-only training,…

Mixture-of-Experts (MoE) based large language models (LLMs) offer strong performance but suffer from high memory and computation costs. Weight binarization provides extreme efficiency, yet existing binary methods designed for dense LLMs…

机器学习 · 计算机科学 2026-04-22 Zhixiong Zhao , Zukang Xu , Zhixuan Chen , Dawei Yang

This paper presents a new pre-trained language model, DeBERTaV3, which improves the original DeBERTa model by replacing mask language modeling (MLM) with replaced token detection (RTD), a more sample-efficient pre-training task. Our…

计算与语言 · 计算机科学 2023-03-27 Pengcheng He , Jianfeng Gao , Weizhu Chen

Pretraining on large-scale datasets can boost the performance of object detectors while the annotated datasets for object detection are hard to scale up due to the high labor cost. What we possess are numerous isolated filed-specific…

计算机视觉与模式识别 · 计算机科学 2023-04-10 Jing Hao , Song Chen , Xiaodi Wang , Shumin Han

Multiword expressions are a key ingredient for developing large-scale and linguistically sound natural language processing technology. This paper describes our improvements in automatically identifying Romanian multiword expressions on the…

计算与语言 · 计算机科学 2023-05-09 Andrei-Marius Avram , Verginica Barbu Mititelu , Dumitru-Clementin Cercel

Large language models (LLMs) have shown strong performance on clinical de-identification, the task of identifying sensitive identifiers to protect privacy. However, previous work has not examined their generalizability between formats,…

计算与语言 · 计算机科学 2026-02-19 Noopur Zambare , Kiana Aghakasiri , Carissa Lin , Carrie Ye , J. Ross Mitchell , Mohamed Abdalla

This paper presents the Duluth approach to SemEval-2026 Task 6 on CLARITY: Unmasking Political Question Evasions. We address Task 1 (clarity-level classification) and Task 2 (evasion-level classification), both of which involve classifying…

计算与语言 · 计算机科学 2026-04-23 Shujauddin Syed , Ted Pedersen

The category of figurative language contains many varieties, some of which are non-compositional in nature. This type of phrase or multi-word expression (MWE) includes idioms, which represent a single meaning that does not consist of the…

计算与语言 · 计算机科学 2026-03-25 Blake Matheny , Phuong Minh Nguyen , Minh Le Nguyen

Deep neural models, in particular Transformer-based pre-trained language models, require a significant amount of data to train. This need for data tends to lead to problems when dealing with idiomatic multiword expressions (MWEs), which are…

Scaling up the number of parameters of language models has proven to be an effective approach to improve performance. For dense models, increasing model size proportionally increases the model's computation footprint. In this work, we seek…

计算与语言 · 计算机科学 2023-11-21 Cicero Nogueira dos Santos , James Lee-Thorp , Isaac Noble , Chung-Ching Chang , David Uthus