中文
相关论文

相关论文: Can LLMs Write Faithfully? An Agent-Based Evaluati…

200 篇论文

Large Language Models (LLMs) have demonstrated impressive capabilities in natural language and code generation, and are increasingly deployed as automatic judges of model outputs and learning activities. Yet, their behavior on structured…

计算与语言 · 计算机科学 2025-11-25 H. M. Shadman Tabib , Jaber Ahmed Deedar

Accessing legal help in Bangladesh is hard. People face high fees, complex legal language, a shortage of lawyers, and millions of unresolved court cases. Generative AI models like OpenAI GPT-4.1 Mini, Gemini 2.0 Flash, Meta Llama 3 70B, and…

Qualitative analysis is typically limited to small datasets because it is time-intensive. Moreover, a second human rater is required to ensure reliable findings. Artificial intelligence tools may replace human raters if we demonstrate high…

物理教育 · 物理学 2025-09-03 Nikhil Sanjay Borse , Ravishankar Chatta Subramaniam , N. Sanjay Rebello

The auditing of financial documents, historically a labor-intensive process, stands on the precipice of transformation. AI-driven solutions have made inroads into streamlining this process by recommending pertinent text passages from…

Despite the impressive capabilities of large language models (LLMs), they currently exhibit two primary limitations, \textbf{\uppercase\expandafter{\romannumeral 1}}: They struggle to \textbf{autonomously solve the real world engineering…

人工智能 · 计算机科学 2024-11-05 Bin Lei , Yuchen Li , Yiming Zeng , Tao Ren , Yi Luo , Tianyu Shi , Zitian Gao , Zeyu Hu , Weitai Kang , Qiuwu Chen

Large language models (LLMs) trained primarily on English corpora often struggle to capture the linguistic and cultural nuances of Arabic. To address this gap, the Saudi Data and AI Authority (SDAIA) introduced the $ALLaM$ family of…

计算与语言 · 计算机科学 2025-08-26 Omer Nacar

Large language models (LLMs) power deep research agents that synthesize information from hundreds of web sources into cited reports, yet these citations cannot be reliably verified. Current approaches either trust models to self-cite…

计算与语言 · 计算机科学 2026-05-08 Hailey Onweller , Elias Lumer , Austin Huber , Pia Ramchandani , Vamse Kumar Subbiah , Corey Feld

Benchmarking modern large language models (LLMs) on complex and realistic tasks is critical to advancing their development. In this work, we evaluate the factual accuracy and citation performance of state-of-the-art LLMs on the task of…

计算与语言 · 计算机科学 2024-12-25 Maya Patel , Aditi Anand

Despite Large Language Models (LLMs) like GPT-4 achieving impressive results in function-level code generation, they struggle with repository-scale code understanding (e.g., coming up with the right arguments for calling routines),…

There is an urgent need for reliable, culturally validated instruments to assess psychological responses to AI in general and large language models (LLMs). This need is global issue, but it is especially urgent among Arabic-speaking…

人机交互 · 计算机科学 2025-08-26 Sameha AlShakhsi , Ala Yankouskaya , Magnus Liebherr , Raian Ali

Many AI detection models have been developed to counter the presence of articles created by artificial intelligence (AI). However, if a human-authored article is slightly polished by AI, a shift will occur in the borderline decision of…

计算与语言 · 计算机科学 2025-12-03 Saleh Almohaimeed , Saad Almohaimeed , Mousa Jari , Khaled A. Alobaid , Fahad Alotaibi

This paper presents our approach and results for SubTask 1: Islamic Inheritance Reasoning at QIAS 2025, a shared task focused on evaluating Large Language Models (LLMs) in understanding and reasoning within Islamic inheritance knowledge. We…

计算与语言 · 计算机科学 2025-08-25 Mohammad AL-Smadi

Search engines increasingly leverage large language models (LLMs) to generate direct answers, and AI chatbots now access the Internet for fresh data. As information curators for billions of users, LLMs must assess the accuracy and…

计算与语言 · 计算机科学 2025-05-23 Kai-Cheng Yang , Filippo Menczer

As educational systems evolve, ensuring that assessment items remain aligned with content standards is essential for maintaining fairness and instructional relevance. Traditional human alignment reviews are accurate but slow and…

人工智能 · 计算机科学 2025-11-26 Farzan Karimi-Malekabadi , Pooya Razavi , Sonya Powers

Large Language Models (LLMs) have achieved unprecedented capabilities in generating human-like text, posing subtle yet significant challenges for information integrity across critical domains, including education, social media, and…

计算与语言 · 计算机科学 2025-06-05 Maged S. Al-Shaibani , Moataz Ahmed

As qualitative researchers show growing interest in using automated tools to support interpretive analysis, a large language model (LLM) is often introduced into an analytic workflow as is, without systematic evaluation of interpretive…

计算与语言 · 计算机科学 2026-04-02 Songhee Han , Jueun Shin , Jiyoon Han , Bung-Woo Jun , Hilal Ayan Karabatman

Large language models (LLMs) and multi-agent orchestration are touted as the next leap in machine translation (MT), but their benefits relative to conventional neural MT (NMT) remain unclear. This paper offers an empirical reality check. We…

计算与语言 · 计算机科学 2025-05-06 Vicent Briva Iglesias , Gokhan Dogru

Large Language Models (LLMs) have been garnering significant attention of AI researchers, especially following the widespread popularity of ChatGPT. However, due to LLMs' intricate architecture and vast parameters, several concerns and…

软件工程 · 计算机科学 2023-10-10 Tinghui Ouyang , Hoang-Quoc Nguyen-Son , Huy H. Nguyen , Isao Echizen , Yoshiki Seo

This paper is devoted to the development of a localized Large Language Model (LLM) specifically for Arabic, a language imbued with unique cultural characteristics inadequately addressed by current mainstream models. Significant concerns…

Large Language Models (LLMs) such as OpenAI's GPT-4 and Meta's LLaMA offer a promising approach for scalable personality assessment from open-ended language. However, inferring personality traits remains challenging, and earlier work often…

计算与语言 · 计算机科学 2025-07-22 Jianfeng Zhu , Ruoming Jin , Karin G. Coifman