中文
相关论文

相关论文: AraReasoner: Evaluating Reasoning-Based LLMs for A…

200 篇论文

With the emergence of advanced reasoning models like OpenAI o3 and DeepSeek-R1, large language models (LLMs) have demonstrated remarkable reasoning capabilities. However, their ability to perform rigorous logical reasoning remains an open…

人工智能 · 计算机科学 2025-02-14 Hanmeng Liu , Zhizhang Fu , Mengru Ding , Ruoxi Ning , Chaoli Zhang , Xiaozhang Liu , Yue Zhang

This paper introduces Arabic-DeepSeek-R1, an application-driven open-source Arabic LLM that leverages a sparse MoE backbone to address the digital equity gap for under-represented languages, and establishes a new SOTA across the entire Open…

The emergence of Large Language Models (LLMs) has fundamentally transformed natural language processing, making them indispensable across domains ranging from conversational systems to scientific exploration. However, their pre-trained…

Existing long-context benchmarks for Large Language Models (LLMs) focus on evaluating comprehension of long inputs, while overlooking the evaluation of long reasoning abilities. To address this gap, we introduce LongReasonArena, a benchmark…

计算与语言 · 计算机科学 2025-08-28 Jiayu Ding , Shuming Ma , Lei Cui , Nanning Zheng , Furu Wei

There is a significant gap in evaluating cultural reasoning in LLMs using conversational datasets that capture culturally rich and dialectal contexts. Most Arabic benchmarks focus on short text snippets in Modern Standard Arabic (MSA),…

Reasoning-enabled large language models (LLMs) excel in logical tasks, yet their utility for evaluating natural language generation remains unexplored. This study systematically compares reasoning LLMs with non-reasoning counterparts across…

Large Language Models (LLMs) have shown remarkable capabilities, not only in generating human-like text, but also in acquiring knowledge. This highlights the need to go beyond the typical Natural Language Processing downstream benchmarks…

In the current era of digital communication and widespread use of social media, it is crucial to develop an understanding of persuasive techniques employed in written text. This knowledge is essential for effectively discerning accurate…

计算与语言 · 计算机科学 2024-05-22 Abdurahmman Alzahrani , Eyad Babkier , Faisal Yanbaawi , Firas Yanbaawi , Hassan Alhuzali

We introduce LogicAsker, a novel approach for evaluating and enhancing the logical reasoning capabilities of large language models (LLMs) such as ChatGPT and GPT-4. Despite LLMs' prowess in tasks like writing assistance, code generation,…

软件工程 · 计算机科学 2024-10-10 Yuxuan Wan , Wenxuan Wang , Yiliu Yang , Youliang Yuan , Jen-tse Huang , Pinjia He , Wenxiang Jiao , Michael R. Lyu

This paper explores the efficacy of large language models (LLMs) for Persian. While ChatGPT and consequent LLMs have shown remarkable performance in English, their efficiency for more low-resource languages remains an open question. We…

Reinforcement learning (RL) has recently demonstrated strong potential in enhancing the reasoning capabilities of large language models (LLMs). Particularly, the "Zero" reinforcement learning introduced by Deepseek-R1-Zero, enables direct…

计算与语言 · 计算机科学 2025-06-10 Xueguang Ma , Qian Liu , Dongfu Jiang , Ge Zhang , Zejun Ma , Wenhu Chen

Argument mining (AM) is an interdisciplinary research field focused on the automatic identification and classification of argumentative components, such as claims and premises, and the relationships between them. Recent advances in large…

计算与语言 · 计算机科学 2026-03-23 Marcin Pietroń , Filip Gampel , Jakub Gomułka , Andrzej Tomski , Rafał Olszowski

Large language models (LLMs) have greatly impacted the natural language processing (NLP) field, particularly for the English language. These models have demonstrated capabilities in understanding and generating human-like text. The success…

计算与语言 · 计算机科学 2024-07-10 Hasna Chouikhi , Manel Aloui , Cyrine Ben Hammou , Ghaith Chaabane , Haithem Kchaou , Chehir Dhaouadi

Large Language Models (LLMs) have shown remarkable capabilities in reasoning, exemplified by the success of OpenAI-o1 and DeepSeek-R1. However, integrating reasoning with external search processes remains challenging, especially for complex…

Prompting techniques have significantly enhanced the capabilities of Large Language Models (LLMs) across various complex tasks, including reasoning, planning, and solving math word problems. However, most research has predominantly focused…

计算与语言 · 计算机科学 2024-05-24 Neisarg Dave , Daniel Kifer , C. Lee Giles , Ankur Mali

In the intricate field of legal studies, the analysis of court decisions is a cornerstone for the effective functioning of the judicial system. The ability to predict court outcomes helps judges during the decision-making process and equips…

计算与语言 · 计算机科学 2023-10-17 Adel Ammar , Anis Koubaa , Bilel Benjdira , Omar Najar , Serry Sibaee

Large Language Models (LLMs) are now integral to numerous industries, increasingly serving as the core reasoning engine for autonomous agents that perform complex tasks through tool-use. While the development of Arabic-native LLMs is…

Large Language Models (LLMs) have demonstrated potential in predicting mental health outcomes from online text, yet traditional classification methods often lack interpretability and robustness. This study evaluates structured reasoning…

计算与语言 · 计算机科学 2026-01-09 Avinash Patil , Amardeep Kour Gedhu

Arabic remains one of the most underrepresented languages in natural language processing research, particularly in medical applications, due to the limited availability of open-source data and benchmarks. The lack of resources hinders…