English
Related papers

Related papers: READIN: A Chinese Multi-Task Benchmark with Realis…

200 papers

During both pretraining and fine-tuning, Large Language Models (\textbf{LLMs}) are trained on trillions of tokens of text of widely varying quality. Both phases of training typically involve heuristically filtering out ``low-quality'' or…

Machine Learning · Computer Science 2024-02-12 Alex Havrilla , Maia Iyer

Recent advances in large language models have enabled LLM-based agents to achieve strong performance on a variety of benchmarks. However, their performance in real-world deployments often that observed on benchmark settings, especially in…

Artificial Intelligence · Computer Science 2026-02-19 Ruipeng Wang , Yuxin Chen , Yukai Wang , Chang Wu , Junfeng Fang , Xiaodong Cai , Qi Gu , Hui Su , An Zhang , Xiang Wang , Xunliang Cai , Tat-Seng Chua

The ability to reason from audio, including speech, environmental sounds, and music, is essential for AI agents to interact effectively in real-world scenarios. Existing benchmarks mainly focus on static or single-scene settings and English…

The diversity of human language, shaped by social, cultural, and regional influences, presents significant challenges for natural language processing (NLP) systems. Existing benchmarks often overlook intra-language variations, leaving…

Computation and Language · Computer Science 2025-04-11 Abhay Gupta , Jacob Cheung , Philip Meng , Shayan Sayyed , Austen Liao , Kevin Zhu , Sean O'Brien

Quantum Computing (QC) promises computational speedup over classic computing for solving complex problems. However, noise exists in current and near-term quantum computers. Quantum software testing (for gaining confidence in quantum…

Software Engineering · Computer Science 2024-01-17 Asmar Muqeet , Tao Yue , Shaukat Ali , Paolo Arcaini

Large Language Models (LLMs) excel at reasoning, traditionally requiring high-quality large-scale data and extensive training. Recent works reveal a very appealing Less-Is-More phenomenon where very small, carefully curated high-quality…

Machine Learning · Computer Science 2026-04-22 Rapheal Huang , Weilong Guo

As the capabilities of large language models (LLMs) continue to advance, evaluating their performance becomes increasingly crucial and challenging. This paper aims to bridge this gap by introducing CMMLU, a comprehensive Chinese benchmark…

Computation and Language · Computer Science 2024-01-19 Haonan Li , Yixuan Zhang , Fajri Koto , Yifei Yang , Hai Zhao , Yeyun Gong , Nan Duan , Timothy Baldwin

Social norms fundamentally shape interpersonal communication. We present NormDial, a high-quality dyadic dialogue dataset with turn-by-turn annotations of social norm adherences and violations for Chinese and American cultures. Introducing…

Computation and Language · Computer Science 2023-10-26 Oliver Li , Mallika Subramanian , Arkadiy Saakyan , Sky CH-Wang , Smaranda Muresan

Label noise remains a challenge for training robust classification models. Most methods for mitigating label noise have been benchmarked using primarily datasets with synthetic noise. While the need for datasets with realistic noise…

Computation and Language · Computer Science 2024-10-24 Alicja Rączkowska , Aleksandra Osowska-Kurczab , Jacek Szczerbiński , Kalina Jasinska-Kobus , Klaudia Nazarko

Large language models (LLMs) have been increasingly applied to automated harmful content detection tasks, assisting moderators in identifying policy violations and improving the overall efficiency and accuracy of content review. However,…

Computation and Language · Computer Science 2025-08-14 Kangwei Liu , Siyuan Cheng , Bozhong Tian , Xiaozhuan Liang , Yuyang Yin , Meng Han , Ningyu Zhang , Bryan Hooi , Xi Chen , Shumin Deng

Ancient Chinese text processing presents unique challenges for large language models (LLMs) due to its distinct linguistic features, complex structural constraints, and rich cultural context. While existing benchmarks have primarily focused…

Computation and Language · Computer Science 2025-03-21 Shangqing Zhao , Yuhao Zhou , Yupei Ren , Zhe Chen , Chenghao Jia , Fang Zhe , Zhaogaung Long , Shu Liu , Man Lan

\textbf{RE}trieval-\textbf{A}ugmented \textbf{L}LM-based \textbf{M}achine \textbf{T}ranslation (REAL-MT) shows promise for knowledge-intensive tasks like idiomatic translation, but its reliability under noisy retrieval contexts remains…

Computation and Language · Computer Science 2025-11-18 Yanming Sun , Runzhe Zhan , Chi Seng Cheang , Han Wu , Xuebo Liu , Yuyao Niu , Fengying Ye , Kaixin Lan , Lidia S. Chao , Derek F. Wong

Idioms, are a kind of idiomatic expression in Chinese, most of which consist of four Chinese characters. Due to the properties of non-compositionality and metaphorical meaning, Chinese Idioms are hard to be understood by children and…

Computation and Language · Computer Science 2022-04-21 Jipeng Qiang , Yang Li , Chaowei Zhang , Yun Li , Yunhao Yuan , Yi Zhu , Xindong Wu

Chinese Spelling Check (CSC) aims to detect and correct error tokens in Chinese contexts, which has a wide range of applications. However, it is confronted with the challenges of insufficient annotated data and the issue that previous…

Computation and Language · Computer Science 2024-02-27 Xunjian Yin , Xinyu Hu , Jin Jiang , Xiaojun Wan

While pre-trained language models (LMs) have brought great improvements in many NLP tasks, there is increasing attention to explore capabilities of LMs and interpret their predictions. However, existing works usually focus only on a certain…

Computation and Language · Computer Science 2022-07-29 Yaozong Shen , Lijie Wang , Ying Chen , Xinyan Xiao , Jing Liu , Hua Wu

High-performance neural language models have obtained state-of-the-art results on a wide range of Natural Language Processing (NLP) tasks. However, results for common benchmark datasets often do not reflect model reliability and robustness…

Computation and Language · Computer Science 2021-08-30 Milad Moradi , Matthias Samwald

This paper introduces DuReader, a new large-scale, open-domain Chinese ma- chine reading comprehension (MRC) dataset, designed to address real-world MRC. DuReader has three advantages over previous MRC datasets: (1) data sources: questions…

Computation and Language · Computer Science 2018-06-12 Wei He , Kai Liu , Jing Liu , Yajuan Lyu , Shiqi Zhao , Xinyan Xiao , Yuan Liu , Yizhong Wang , Hua Wu , Qiaoqiao She , Xuan Liu , Tian Wu , Haifeng Wang

Multilingual pre-trained language models have shown impressive performance on cross-lingual tasks. It greatly facilitates the applications of natural language processing on low-resource languages. However, there are still some languages…

Computation and Language · Computer Science 2022-09-22 Ziqing Yang , Zihang Xu , Yiming Cui , Baoxin Wang , Min Lin , Dayong Wu , Zhigang Chen

Education artificial intelligence aims to profit tasks in the education domain such as intelligent test paper generation and consolidation exercises where the main technique behind is how to match the exercises, known as the finding similar…

Artificial Intelligence · Computer Science 2021-11-18 Tongwen Huang , Xihua Li

From an engineering perspective, a design should not only perform well in an ideal condition, but should also resist noises. Such a design methodology, namely robust design, has been widely implemented in the industry for product quality…

Machine Learning · Computer Science 2021-12-09 Jia-Qi Yang , Ke-Bin Fan , Hao Ma , De-Chuan Zhan