English
Related papers

Related papers: Beyond the Resum\'e: A Rubric-Aware Automatic Inte…

200 papers

The impressive performance of large language models (LLMs) has attracted considerable attention from the academic and industrial communities. Besides how to construct and train LLMs, how to effectively evaluate and compare the capacity of…

Information Retrieval · Computer Science 2024-06-04 Zhumin Chu , Qingyao Ai , Yiteng Tu , Haitao Li , Yiqun Liu

Business interview preparation demands both solid theoretical grounding and refined soft skills, yet conventional classroom methods rarely deliver the individualized, culturally aware practice employers currently expect. This paper…

Computers and Society · Computer Science 2025-08-19 Truong Thanh Hung Nguyen , Tran Diem Quynh Nguyen , Hoang Loc Cao , Thi Cam Thanh Tran , Thi Cam Mai Truong , Hung Cao

Formative assessment in STEM topics aims to promote student learning by identifying students' current understanding, thus targeting how to promote further learning. Previous studies suggest that the assessment performance of current…

Machine Learning · Computer Science 2025-04-08 Yuchen Wei , Dennis Pearl , Matthew Beckman , Rebecca J. Passonneau

LLM-based automated scoring approaches near-human performance, but scaling to new tasks remains bottlenecked by the per-item human configuration of upstream stages such as rubric construction. Human experts bypass this bottleneck through…

Computation and Language · Computer Science 2026-05-29 Yun Wang , Xin Xia , Xuansheng Wu , Xiaoming Zhai , Ninghao Liu

As large language models (LLMs) increasingly exhibit human-like capabilities, a fundamental question emerges: How can we enable LLMs to learn the underlying patterns from limited examples in entirely novel environments and apply them…

Computation and Language · Computer Science 2025-09-23 Brian S. Lin , Jiaxin Yuan , Zihan Zhou , Shouli Wang , Shuo Wang , Cunliang Kong , Qi Shi , Yuxuan Li , Liner Yang , Zhiyuan Liu , Maosong Sun

Large language models (LLMs) have achieved remarkable progress in the field of natural language processing (NLP), demonstrating remarkable abilities in producing text that resembles human language for various tasks. This opens up new…

Information Retrieval · Computer Science 2024-06-05 Jianghao Lin , Xinyi Dai , Rong Shan , Bo Chen , Ruiming Tang , Yong Yu , Weinan Zhang

Large language models (LLMs) are being widely applied across various fields, but as tasks become more complex, evaluating their responses is increasingly challenging. Compared to human evaluators, the use of LLMs to support performance…

Artificial Intelligence · Computer Science 2025-04-25 Yuran Li , Jama Hussein Mohamud , Chongren Sun , Di Wu , Benoit Boulet

Parametric knowledge in large language models (LLMs) is a cornerstone of their success, yet remains poorly understood. Existing knowledge benchmarks typically rely on predefined questions (e.g., "What is the birth date of M.L. King?"),…

Computation and Language · Computer Science 2026-05-27 Luca Giordano , Simon Razniewski

Large Language Models (LLMs) have achieved remarkable success across a wide range of natural language tasks, and recent efforts have sought to extend their capabilities to multimodal domains and resource-constrained environments. However,…

Machine Learning · Computer Science 2025-05-26 Yun-Da Tsai

Matching submissions with suitable reviewers at scale is a growing challenge for major venues, yet existing approaches either rely on coarse proxy signals that conflate general relatedness with true suitability, or require expensive human…

Computation and Language · Computer Science 2026-05-28 Zixuan Yang , Yibo Zhao , Weicong Liu , Xiang Li

Which large language model (LLM) is better? Every evaluation tells a story, but what do users really think about current LLMs? This paper presents CLUE, an LLM-powered interviewer that conducts in-the-moment user experience interviews,…

Computation and Language · Computer Science 2025-06-11 Mengqiao Liu , Tevin Wang , Cassandra A. Cohen , Sarah Li , Chenyan Xiong

Large Language Models (LLMs) and chatbots show significant promise in streamlining the legal intake process. This advancement can greatly reduce the workload and costs for legal aid organizations, improving availability while making legal…

Computers and Society · Computer Science 2023-11-23 Nick Goodson , Rongfei Lu

Large language models (LLMs) have been widely adopted due to their remarkable performance across various applications, driving the accelerated development of a large number of diverse models. However, these individual LLMs show limitations…

Computation and Language · Computer Science 2025-06-13 Kaushal Kumar Maurya , KV Aditya Srivatsa , Ekaterina Kochmar

Large language models (LLMs) are prone to hallucination stemming from misaligned self-awareness, particularly when processing queries exceeding their knowledge boundaries. While existing mitigation strategies employ uncertainty estimation…

Computation and Language · Computer Science 2025-10-10 Hang Zheng , Hongshen Xu , Yuncong Liu , Lu Chen , Pascale Fung , Kai Yu

The performance of Large Language Models (LLMs) is highly sensitive to the prompts they are given. Drawing inspiration from the field of prompt optimization, this study investigates the potential for enhancing Automated Essay Scoring (AES)…

Computation and Language · Computer Science 2025-10-13 Keno Harada , Lui Yoshida , Takeshi Kojima , Yusuke Iwasawa , Yutaka Matsuo

Large Language Model (LLM)-based web agents excel at knowledge-intensive tasks but face a fundamental conflict between the need for extensive exploration and the constraints of limited context windows. Current solutions typically rely on…

Large language models (LLMs) have demonstrated great potential for domain-specific applications, such as the law domain. However, recent disputes over GPT-4's law evaluation raise questions concerning their performance in real-world legal…

Computation and Language · Computer Science 2023-10-19 Ruihao Shui , Yixin Cao , Xiang Wang , Tat-Seng Chua

Large language models (LLMs) are increasingly used as evaluators for natural language generation, applying human-defined rubrics to assess system outputs. However, human rubrics are often static and misaligned with how models internally…

Computation and Language · Computer Science 2026-02-10 Clemencia Siro , Pourya Aliannejadi , Mohammad Aliannejadi

High-quality datasets are fundamental to training and evaluating machine learning models, yet their creation-especially with accurate human annotations-remains a significant challenge. Many dataset paper submissions lack originality,…

Large Language Models (LLMs) have become a milestone in the field of artificial intelligence and natural language processing. However, their large-scale deployment remains constrained by the need for significant computational resources.…

Computation and Language · Computer Science 2025-08-07 Julián Camilo Velandia Gutiérrez