English
Related papers

Related papers: A LLM-Powered Automatic Grading Framework with Hum…

200 papers

Prompt engineering for large language models (LLMs) is often a manual time-intensive process that involves generating, evaluating, and refining prompts iteratively to ensure high-quality outputs. While there has been work on automating…

Computation and Language · Computer Science 2024-07-19 Derek Austin , Elliott Chartock

Academic writing skills are crucial for students' success, but can feel overwhelming without proper guidance and practice, particularly when writing in a second language. Traditionally, students ask instructors or search dictionaries, which…

Artificial Intelligence · Computer Science 2025-06-24 Fumian Chen , Sotheara Veng , Joshua Wilson , Xiaoming Li , Hui Fang

While large language models (LLMs) have demonstrated remarkable versatility across a wide range of general tasks, their effectiveness often diminishes in domain-specific applications due to inherent knowledge gaps. Moreover, their…

Artificial Intelligence · Computer Science 2025-11-21 Hanzhi Yan , Qin Lu , Xianqiao Wang , Xiaoming Zhai , Tianming Liu , He Li

Recent months have seen the emergence of a powerful new trend in which large language models (LLMs) are augmented to become autonomous language agents capable of performing objective oriented multi-step tasks on their own, rather than…

Large Language Models (LLMs) excel at understanding natural language but struggle with explicit commonsense reasoning. A recent trend of research suggests that the combination of LLM with robust symbolic reasoning systems can overcome this…

Artificial Intelligence · Computer Science 2025-09-23 Manuel Borroto , Katie Gallagher , Antonio Ielo , Irfan Kareem , Francesco Ricca , Alessandra Russo

In the era of MOOCs, online exams are taken by millions of candidates, where scoring short answers is an integral part. It becomes intractable to evaluate them by human graders. Thus, a generic automated system capable of grading these…

Artificial Intelligence · Computer Science 2020-12-22 Yaman Kumar , Swati Aggarwal , Debanjan Mahata , Rajiv Ratn Shah , Ponnurangam Kumaraguru , Roger Zimmermann

Stochastic variance-reduced algorithms such as Stochastic Average Gradient (SAG) and SAGA, and their deterministic counterparts like the Incremental Aggregated Gradient (IAG) method, have been extensively studied in large-scale machine…

Machine Learning · Computer Science 2026-05-22 Feng Zhu , Robert W. Heath , Aritra Mitra

Large language models (LLMs) enable rapid and consistent automated evaluation of open-ended exam responses, including dimensions of content and argumentation that have traditionally required human judgment. This is particularly important in…

Computation and Language · Computer Science 2026-01-26 Andres Karjus , Kais Allkivi , Silvia Maine , Katarin Leppik , Krister Kruusmaa , Merilin Aruvee

Retrieval-augmented generation (RAG) enhances the question-answering (QA) abilities of large language models (LLMs) by integrating external knowledge. However, adapting general-purpose RAG systems to specialized fields such as science and…

Computation and Language · Computer Science 2025-01-28 Ran Xu , Hui Liu , Sreyashi Nag , Zhenwei Dai , Yaochen Xie , Xianfeng Tang , Chen Luo , Yang Li , Joyce C. Ho , Carl Yang , Qi He

Retrieval-Augmented Generation (RAG) offers a cost-effective approach to injecting real-time knowledge into large language models (LLMs). Nevertheless, constructing and validating high-quality knowledge repositories require considerable…

Computation and Language · Computer Science 2024-05-28 Xun Liang , Simin Niu , Zhiyu li , Sensen Zhang , Shichao Song , Hanyu Wang , Jiawei Yang , Feiyu Xiong , Bo Tang , Chenyang Xi

Large Language Models (LLMs) often produce answers with a single chain-of-thought, which restricts their ability to explore reasoning paths or self-correct flawed outputs in complex tasks. In this paper, we introduce MALT (Multi-Agent LLM…

Retrieval-Augmented Generation (RAG) grounds Large Language Models (LLMs) to mitigate factual hallucinations. Recent paradigms shift from static pipelines to Modular and Agentic RAG frameworks, granting models autonomy for multi-hop…

Information Retrieval · Computer Science 2026-03-03 Yichao Wu , Penghao Liang , Yafei Xiang , Mengwei Yuan , Jianan Liu , Jing Yang , Xianyou Li , Weiran Yan

LLM agents acting in structured environments fail in operational rather than conversational ways, and reliability depends on procedural knowledge of the environment. Prior self-improvement methods accumulate natural-language guidance…

Artificial Intelligence · Computer Science 2026-05-29 Johannes Moll , Jean-Philippe Corbeil , Jiazhen Pan , Martin Hadamitzky , Daniel Rueckert , Lisa Adams , Keno Bressem

Large language models (LLMs) have shown promise in medical domains, but their ability to handle specialized neurological reasoning requires systematic evaluation. We developed a comprehensive benchmark using 305 questions from Israeli Board…

Information Retrieval · Computer Science 2025-08-21 Moran Sorka , Alon Gorenshtein , Dvir Aran , Shahar Shelly

This study investigates the use of generative AI and multi-agent systems to provide automatic feedback in educational contexts, particularly for student constructed responses in science assessments. The research addresses a key gap in the…

Computation and Language · Computer Science 2024-11-13 Shuchen Guo , Ehsan Latif , Yifan Zhou , Xuan Huang , Xiaoming Zhai

In recent years, multi-agent frameworks powered by large language models (LLMs) have advanced rapidly. Despite this progress, there is still a notable absence of benchmark datasets specifically tailored to evaluate their performance. To…

Computation and Language · Computer Science 2025-04-28 Lei Shen , Xiaoyu Shen

Transformer-based language models significantly advanced the state-of-the-art in many linguistic tasks. As this revolution continues, the ability to explain model predictions has become a major area of interest for the NLP community. In…

Machine Learning · Computer Science 2022-04-26 Oren Barkan , Edan Hauon , Avi Caciularu , Ori Katz , Itzik Malkiel , Omri Armstrong , Noam Koenigstein

Large Language Models (LLMs) have achieved remarkable advancements in natural language processing tasks, yet they encounter challenges in complex decision-making scenarios that require long-term reasoning and alignment with high-level…

Computation and Language · Computer Science 2025-06-10 Heng Dong , Kefei Duan , Chongjie Zhang

The evaluation paradigm of LLM-as-judge gains popularity due to its significant reduction in human labor and time costs. This approach utilizes one or more large language models (LLMs) to assess the quality of outputs from other LLMs.…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Zhiyuan Fan , Weinong Wang , Xing Wu , Debing Zhang

Automated Essay Scoring (AES) plays a crucial role in educational assessment by providing scalable and consistent evaluations of writing tasks. However, traditional AES systems face three major challenges: (1) reliance on handcrafted…

Computation and Language · Computer Science 2025-05-21 Jiamin Su , Yibo Yan , Fangteng Fu , Han Zhang , Jingheng Ye , Xiang Liu , Jiahao Huo , Huiyu Zhou , Xuming Hu