中文
相关论文

相关论文: Auditing an Automatic Grading Model with deep Rein…

200 篇论文

Humans can leverage hierarchical structures to split a task into sub-tasks and solve problems efficiently. Both imitation and reinforcement learning or a combination of them with hierarchical structures have been proven to be an efficient…

机器人学 · 计算机科学 2020-12-15 Yaru Niu , Yijun Gu

Multi-agent collaboration has emerged as a powerful paradigm for enhancing the reasoning capabilities of large language models, yet it suffers from interaction-level ambiguity that blurs generation, critique, and revision, making credit…

Animals and robots exist in a physical world and must coordinate their bodies to achieve behavioral objectives. With recent developments in deep reinforcement learning, it is now possible for scientists and engineers to obtain sensorimotor…

机器人学 · 计算机科学 2024-05-21 Yusheng Jiao , Feng Ling , Sina Heydari , Nicolas Heess , Josh Merel , Eva Kanso

We propose a new method to measure the task-specific accuracy of Retrieval-Augmented Large Language Models (RAG). Evaluation is performed by scoring the RAG on an automatically-generated synthetic exam composed of multiple choice questions…

计算与语言 · 计算机科学 2024-05-24 Gauthier Guinet , Behrooz Omidvar-Tehrani , Anoop Deoras , Laurent Callot

The exploration mechanism used by a Deep Reinforcement Learning (RL) agent plays a key role in determining its sample efficiency. Thus, improving over random exploration is crucial to solve long-horizon tasks with sparse rewards. We propose…

机器学习 · 计算机科学 2019-12-17 Andrey Kurenkov , Ajay Mandlekar , Roberto Martin-Martin , Silvio Savarese , Animesh Garg

This paper investigates the impact of using gradient norm reward signals in the context of Automatic Curriculum Learning (ACL) for deep reinforcement learning (DRL). We introduce a framework where the teacher model, utilizing the gradient…

机器学习 · 计算机科学 2023-12-22 Ryan Campbell , Junsang Yoon

Retrieval-Augmented Generation (RAG) is a critical technique for grounding Large Language Models (LLMs) in factual evidence, yet evaluating RAG systems in specialized, safety-critical domains remains a significant challenge. Existing…

计算与语言 · 计算机科学 2025-11-07 Joshua Gao , Quoc Huy Pham , Subin Varghese , Silwal Saurav , Vedhus Hoskere

Every four years, the PISA test is administered by the OECD to test the knowledge of teenage students worldwide and allow for comparisons of educational systems. However, having to avoid language differences and annotator bias makes the…

计算与语言 · 计算机科学 2026-04-01 Pavel Šindelář , Dávid Slivka , Christopher Bouma , Filip Prášil , Ondřej Bojar

Ideally, we would place a robot in a real-world environment and leave it there improving on its own by gathering more experience autonomously. However, algorithms for autonomous robotic learning have been challenging to realize in the real…

机器学习 · 计算机科学 2023-11-01 Max Balsells , Marcel Torne , Zihan Wang , Samedh Desai , Pulkit Agrawal , Abhishek Gupta

In the last decade, deep learning has achieved great success in machine learning tasks where the input data is represented with different levels of abstractions. Driven by the recent research in reinforcement learning using deep neural…

机器学习 · 计算机科学 2022-05-18 Dejan Markovikj

Automated scoring (AS) systems used in large-scale assessment have traditionally used small statistical models that require a large quantity of hand-scored data to make accurate predictions, which can be time-consuming and costly.…

机器学习 · 计算机科学 2025-04-01 Kai North , Christopher Ormerod

Deep-learning based Automatic Essay Scoring (AES) systems are being actively used by states and language testing agencies alike to evaluate millions of candidates for life-changing decisions ranging from college applications to visa…

计算与语言 · 计算机科学 2021-10-15 Yaman Kumar Singla , Swapnil Parekh , Somesh Singh , Junyi Jessy Li , Rajiv Ratn Shah , Changyou Chen

Subjective Answer Grading (SAG) plays a crucial role in education, standardized testing, and automated assessment systems, particularly for evaluating short-form responses in Short Answer Scoring (SAS). However, existing approaches often…

计算与语言 · 计算机科学 2025-05-16 Peichao Lai , Kexuan Zhang , Yi Lin , Linyihan Zhang , Feiyang Ye , Jinhao Yan , Yanwei Xu , Conghui He , Yilei Wang , Wentao Zhang , Bin Cui

Intelligent tutoring systems have long enabled automated immediate feedback on student work when it is presented in a tightly structured format and when problems are very constrained, but reliably assessing free-form mathematical reasoning…

计算机与社会 · 计算机科学 2026-01-08 Aron Gohr , Marie-Amelie Lawn , Kevin Gao , Inigo Serjeant , Stephen Heslip

Automated feedback systems have become increasingly integral to programming education, where learners engage in iterative cycles of code construction, testing, and refinement. Despite its wider integration in practices and technical…

计算机与社会 · 计算机科学 2026-02-03 Yeonji Jung , Yunseo Lee , Jiyeong Bae , DoYong Kim , Heungsoo Choi , Minji Kang , Unggi Lee

Automatic Short Answer Grading (ASAG) is the process of grading the student answers by computational approaches given a question and the desired answer. Previous works implemented the methods of concept mapping, facet mapping, and some used…

计算与语言 · 计算机科学 2020-09-04 Sasi Kiran Gaddipati , Deebul Nair , Paul G. Plöger

Evaluating the abilities of learners is a fundamental objective in the field of education. In particular, there is an increasing need to assess higher-order abilities such as expressive skills and logical thinking. Constructed-response…

计算与语言 · 计算机科学 2025-06-26 Masaki Uto , Yuma Ito

Reinforcement learning (RL) agents with pre-specified reward functions cannot provide guaranteed safety across variety of circumstances that an uncertain system might encounter. To guarantee performance while assuring satisfaction of safety…

人工智能 · 计算机科学 2021-04-20 Aquib Mustafa , Majid Mazouchi , Subramanya Nageshrao , Hamidreza Modares

Digital technologies are increasingly used in education to reduce the workload of teachers and students. However, creating open-ended study or examination questions and grading their answers is still a tedious task. This thesis presents the…

计算与语言 · 计算机科学 2025-06-17 Gérôme Meyer , Philip Breuer

To widen their accessibility and increase their utility, intelligent agents must be able to learn complex behaviors as specified by (non-expert) human users. Moreover, they will need to learn these behaviors within a reasonable amount of…

机器学习 · 计算机科学 2019-02-13 Dilip Arumugam , Jun Ki Lee , Sophie Saskin , Michael L. Littman