English
Related papers

Related papers: Can Pre-trained Language Models Understand Chinese…

200 papers

Speech understanding is essential for interpreting the diverse forms of information embedded in spoken language, including linguistic, paralinguistic, and non-linguistic cues that are vital for effective human-computer interaction. The…

Audio and Speech Processing · Electrical Eng. & Systems 2025-12-08 Jing Peng , Yucheng Wang , Bohan Li , Yiwei Guo , Hankun Wang , Yangui Fang , Yu Xi , Haoyu Li , Xu Li , Ke Zhang , Shuai Wang , Kai Yu

Large language models (LLMs) have demonstrated substantial commonsense understanding through numerous benchmark evaluations. However, their understanding of cultural commonsense remains largely unexamined. In this paper, we conduct a…

Computation and Language · Computer Science 2024-05-09 Siqi Shen , Lajanugen Logeswaran , Moontae Lee , Honglak Lee , Soujanya Poria , Rada Mihalcea

Large language models (LLMs) have been increasingly applied to automated harmful content detection tasks, assisting moderators in identifying policy violations and improving the overall efficiency and accuracy of content review. However,…

Computation and Language · Computer Science 2025-08-14 Kangwei Liu , Siyuan Cheng , Bozhong Tian , Xiaozhuan Liang , Yuyang Yin , Meng Han , Ningyu Zhang , Bryan Hooi , Xi Chen , Shumin Deng

The proliferation of hate speech has inflicted significant societal harm, with its intensity and directionality closely tied to specific targets and arguments. In recent years, numerous machine learning-based methods have been developed to…

Computation and Language · Computer Science 2025-07-16 Zewen Bai , Liang Yang , Shengdi Yin , Yuanyuan Sun , Hongfei Lin

The process mining community has recently recognized the potential of large language models (LLMs) for tackling various process mining tasks. Initial studies report the capability of LLMs to support process analysis and even, to some…

Computation and Language · Computer Science 2024-07-03 Adrian Rebmann , Fabian David Schmidt , Goran Glavaš , Han van der Aa

In the current environment, psychological issues are prevalent and widespread, with social media serving as a key outlet for individuals to share their feelings. This results in the generation of vast quantities of data daily, where…

Computation and Language · Computer Science 2024-06-13 Wei Zhai , Hongzhi Qi , Qing Zhao , Jianqiang Li , Ziqi Wang , Han Wang , Bing Xiang Yang , Guanghui Fu

Large Language Models (LLMs) have garnered considerable interest within both academic and industrial. Yet, the application of LLMs to graph data remains under-explored. In this study, we evaluate the capabilities of four LLMs in addressing…

Artificial Intelligence · Computer Science 2023-09-12 Chang Liu , Bo Wu

Large language models (LLMs) have shown impressive capabilities across tasks such as mathematics, coding, and reasoning, yet their learning ability, which is crucial for adapting to dynamic environments and acquiring new knowledge, remains…

Computation and Language · Computer Science 2025-12-29 Zhengyu Hu , Jianxun Lian , Zheyuan Xiao , Seraphina Zhang , Tianfu Wang , Nicholas Jing Yuan , Xing Xie , Hui Xiong

Recent advances in large language models (LLMs) have led to substantial progress in domain-specific applications, particularly within the legal domain. However, general-purpose models such as GPT-4 often struggle with specialized subdomains…

Artificial Intelligence · Computer Science 2026-01-16 Zixun Lan , Maochun Xu , Yifan Ren , Rui Wu , Jianghui Zhou , Xueyang Cheng , Jianan Ding Ding , Xinheng Wang , Mingmin Chi , Fei Ma

Recently, knowledge-enhanced pre-trained language models (KEPLMs) improve context-aware representations via learning from structured relations in knowledge graphs, and/or linguistic knowledge from syntactic or dependency analysis. Unlike…

Computation and Language · Computer Science 2022-10-13 Taolin Zhang , Junwei Dong , Jianing Wang , Chengyu Wang , Ang Wang , Yinghui Liu , Jun Huang , Yong Li , Xiaofeng He

Probabilistic models of language understanding are valuable tools for investigating human language use. However, they need to be hand-designed for a particular domain. In contrast, large language models (LLMs) are trained on text that spans…

Computation and Language · Computer Science 2023-05-23 Ben Prystawski , Paul Thibodeau , Christopher Potts , Noah D. Goodman

The non-humanlike behaviour of contemporary pre-trained language models (PLMs) is a leading cause undermining their trustworthiness. A striking phenomenon of such faulty behaviours is the generation of inconsistent predictions, which…

Computation and Language · Computer Science 2023-10-25 Myeongjun Erik Jang , Thomas Lukasiewicz

Moral values have deep roots in early civilizations, codified within norms and laws that regulated societal order and the common good. They play a crucial role in understanding the psychological basis of human behavior and cultural…

Computation and Language · Computer Science 2025-04-07 Lorenzo Zangari , Candida M. Greco , Davide Picca , Andrea Tagarelli

Large language models (LLMs) hold the potential to absorb and reflect personality traits and attitudes specified by users. In our study, we investigated this potential using robust psychometric measures. We adapted the most studied test in…

Computation and Language · Computer Science 2025-12-19 Anton Vasiliuk , Irina Abdullaeva , Polina Druzhinina , Anton Razzhigaev , Andrey Kuznetsov

While pre-trained language models (PLMs) have shown evidence of acquiring vast amounts of knowledge, it remains unclear how much of this parametric knowledge is actually usable in performing downstream tasks. We propose a systematic…

Computation and Language · Computer Science 2023-05-25 Amirhossein Kazemnejad , Mehdi Rezagholizadeh , Prasanna Parthasarathi , Sarath Chandar

Recent progress in pretraining language models on large corpora has resulted in large performance gains on many NLP tasks. These large models acquire linguistic knowledge during pretraining, which helps to improve performance on downstream…

Computation and Language · Computer Science 2021-02-09 Lutfi Kerem Senel , Hinrich Schütze

To quantitatively and intuitively explore the generalization ability of pre-trained language models (PLMs), we have designed several tasks of arithmetic and logical reasoning. We both analyse how well PLMs generalize when the test data is…

Computation and Language · Computer Science 2021-10-20 Cunxiang Wang , Boyuan Zheng , Yuchen Niu , Yue Zhang

As ChatGPT and GPT-4 spearhead the development of Large Language Models (LLMs), more researchers are investigating their performance across various tasks. But more research needs to be done on the interpretability capabilities of LLMs, that…

Computation and Language · Computer Science 2023-10-27 Dongfang Li , Jindi Yu , Baotian Hu , Zhenran Xu , Min Zhang

Machine Translation of Culture-Specific Items (CSIs) poses significant challenges. Recent work on CSI translation has shown some success using Large Language Models (LLMs) to adapt to different languages and cultures; however, a deeper…

Computation and Language · Computer Science 2024-08-27 Zhonghe Zhang , Xiaoyu He , Vivek Iyer , Alexandra Birch

While large language models (LLMs) have showcased impressive capabilities, they struggle with addressing legal queries due to the intricate complexities and specialized expertise required in the legal field. In this paper, we introduce…

Computation and Language · Computer Science 2024-06-24 Zhiwei Fei , Songyang Zhang , Xiaoyu Shen , Dawei Zhu , Xiao Wang , Maosong Cao , Fengzhe Zhou , Yining Li , Wenwei Zhang , Dahua Lin , Kai Chen , Jidong Ge