中文
相关论文

相关论文: Failing Forward: Improving Generative Error Correc…

200 篇论文

Accurately identifying adversarial techniques in security texts is critical for effective cyber defense. However, existing methods face a fundamental trade-off: they either rely on generic models with limited domain precision or require…

密码学与安全 · 计算机科学 2025-08-12 Ahmed Lekssays , Utsav Shukla , Husrev Taha Sencar , Md Rizwan Parvez

The rapid development of large language models has led to the widespread adoption of Retrieval-Augmented Generation (RAG), which integrates external knowledge to alleviate knowledge bottlenecks and mitigate hallucinations. However, the…

计算与语言 · 计算机科学 2024-10-10 Ruotong Pan , Boxi Cao , Hongyu Lin , Xianpei Han , Jia Zheng , Sirui Wang , Xunliang Cai , Le Sun

In differentiable neural architecture search (NAS) algorithms like DARTS, the training set used to update model weight and the validation set used to update model architectures are sampled from the same data distribution. Thus, the uncommon…

机器学习 · 计算机科学 2021-12-02 Ruisi Zhang , Youwei Liang , Sai Ashish Somayajula , Pengtao Xie

Large language models can enhance automatic speech recognition systems through generative error correction. In this paper, we propose Pinyin-enhanced GEC, which leverages Pinyi, the phonetic representation of Mandarin Chinese, as…

计算与语言 · 计算机科学 2024-09-23 Yuang Li , Xiaosong Qiao , Xiaofeng Zhao , Huan Zhao , Wei Tang , Min Zhang , Hao Yang

We investigate the use of generative adversarial networks (GANs) in speech dereverberation for robust speech recognition. GANs have been recently studied for speech enhancement to remove additive noises, but there still lacks of a work to…

声音 · 计算机科学 2019-01-01 Ke Wang , Junbo Zhang , Sining Sun , Yujun Wang , Fei Xiang , Lei Xie

Speech Emotion Recognition (SER) is crucial for human-computer interaction but still remains a challenging problem because of two major obstacles: data scarcity and imbalance. Many datasets for SER are substantially imbalanced, where data…

声音 · 计算机科学 2022-08-11 Shijun Wang , Hamed Hemati , Jón Guðnason , Damian Borth

Biomedical named entity recognition (NER) is a high-utility natural language processing (NLP) task, and large language models (LLMs) show promise particularly in few-shot settings (i.e., limited training data). In this article, we address…

计算与语言 · 计算机科学 2025-08-12 Yao Ge , Sudeshna Das , Yuting Guo , Abeed Sarker

Retrieval-Augmented Generation (RAG) is a core approach for enhancing Large Language Models (LLMs), where the effectiveness of the retriever largely determines the overall response quality of RAG systems. Retrievers encompass a multitude of…

信息检索 · 计算机科学 2025-09-30 Zou Yuheng , Wang Yiran , Tian Yuzhu , Zhu Min , Huang Yanhua

Agentic Retrieval-Augmented Generation (Agentic RAG) enhances the processing capability for complex tasks through dynamic retrieval and adaptive workflows. Recent advances (e.g., Search-R1) have shown that outcome-supervised reinforcement…

计算与语言 · 计算机科学 2025-10-08 Yongqi Leng , Yikun Lei , Xikai Liu , Meizhi Zhong , Bojian Xiong , Yurong Zhang , Yan Gao , Yi Wu , Yao Hu , Deyi Xiong

Large Language Models (LLMs) struggle with generating reliable outputs due to outdated knowledge and hallucinations. Retrieval-Augmented Generation (RAG) models address this by enhancing LLMs with external knowledge, but often fail to…

信息检索 · 计算机科学 2026-01-16 Saber Zerhoudi , Michael Granitzer

\Ac{RAG} has emerged as a crucial technique for enhancing large models with real-time and domain-specific knowledge. While numerous improvements and open-source tools have been proposed to refine the \ac{RAG} framework for accuracy,…

信息检索 · 计算机科学 2025-02-20 Yixing Fan , Qiang Yan , Wenshan Wang , Jiafeng Guo , Ruqing Zhang , Xueqi Cheng

Text classification is vital for Web for Good applications like hate speech and misinformation detection. However, traditional models (e.g., BERT) often fail in dynamic few-shot settings where labeled data are scarce, and target labels…

计算与语言 · 计算机科学 2026-01-30 Yubo Wang , Haoyang Li , Fei Teng , Lei Chen

While retrieval-augmented generation (RAG) has been shown to enhance factuality of large language model (LLM) outputs, LLMs still suffer from hallucination, generating incorrect or irrelevant information. A common detection strategy…

计算与语言 · 计算机科学 2025-03-17 Tobias Leemann , Periklis Petridis , Giuseppe Vietri , Dionysis Manousakas , Aaron Roth , Sergul Aydore

Grammatical Error Correction (GEC) faces a critical challenge concerning explainability, notably when GEC systems are designed for language learners. Existing research predominantly focuses on explaining grammatical errors extracted in…

计算与语言 · 计算机科学 2025-02-24 Jingheng Ye , Shang Qin , Yinghui Li , Hai-Tao Zheng , Shen Wang , Qingsong Wen

Retrieval-augmented generation (RAG) has become a dominant paradigm for mitigating knowledge hallucination and staleness in large language models (LLMs) while preserving data security. By retrieving relevant evidence from private,…

信息检索 · 计算机科学 2025-09-29 Guohang Yan , Yue Zhang , Pinlong Cai , Ding Wang , Song Mao , Hongwei Zhang , Yaoze Zhang , Hairong Zhang , Xinyu Cai , Botian Shi

Recent advancements in Retrieval-Augmented Generation (RAG) have enabled Large Language Models to answer financial questions using external knowledge bases of U.S. SEC filings, earnings reports, and regulatory documents. However, existing…

Retrieval-augmented Generation (RAG) extends large language models (LLMs) with external knowledge but faces key challenges: restricted effective context length and redundancy in retrieved documents. Pure compression-based approaches reduce…

计算与语言 · 计算机科学 2025-07-09 Yiqiao Jin , Kartik Sharma , Vineeth Rakesh , Yingtong Dou , Menghai Pan , Mahashweta Das , Srijan Kumar

In recent years, sequence-to-sequence models have been very effective for end-to-end grammatical error correction (GEC). As creating human-annotated parallel corpus for GEC is expensive and time-consuming, there has been work on artificial…

计算与语言 · 计算机科学 2019-07-23 Phu Mon Htut , Joel Tetreault

Datasets are crucial when training a deep neural network. When datasets are unrepresentative, trained models are prone to bias because they are unable to generalise to real world settings. This is particularly problematic for models trained…

计算机视觉与模式识别 · 计算机科学 2019-12-30 Mkhuseli Ngxande , Jules-Raymond Tapamo , Michael Burke

While automatic speech recognition (ASR) greatly benefits from data augmentation, the augmentation recipes themselves tend to be heuristic. In this paper, we address one of the heuristic approach associated with balancing the right amount…

音频与语音处理 · 电气工程与系统科学 2024-06-17 Vishwanath Pratap Singh , Federico Malato , Ville Hautamaki , Md. Sahidullah , Tomi Kinnunen