English
Related papers

Related papers: The Robust Reading Competition Annotation and Eval…

200 papers

Automated writing evaluation systems can improve students' writing insofar as students attend to the feedback provided and revise their essay drafts in ways aligned with such feedback. Existing research on revision of argumentative writing…

Computation and Language · Computer Science 2021-07-16 Tazin Afrin , Elaine Wang , Diane Litman , Lindsay C. Matsumura , Richard Correnti

In Reward Learning (ReL), we are given feedback on an unknown target reward, and the goal is to use this information to recover it in order to carry out some downstream application, e.g., planning. When the feedback is not informative…

Machine Learning · Computer Science 2025-09-16 Filippo Lazzati , Alberto Maria Metelli

Query optimizers in RDBMSs search for execution plans expected to be optimal for given queries. They use parameter estimates, often inaccurate, and make assumptions that may not hold in practice. Consequently, they may select plans that are…

Databases · Computer Science 2025-05-27 Amin Kamali , Verena Kantere , Calisto Zuzarte , Vincent Corvinelli

Robust estimation is a crucial and still challenging task, which involves estimating model parameters in noisy environments. Although conventional sampling consensus-based algorithms sample several times to achieve robustness, these…

Computer Vision and Pattern Recognition · Computer Science 2023-08-11 Chang Nie , Guangming Wang , Zhe Liu , Luca Cavalli , Marc Pollefeys , Hesheng Wang

Robust evaluation is critical for deploying trustworthy retrieval-augmented generation (RAG) systems. However, current LLM-based evaluation frameworks predominantly rely on directly prompting resource-intensive models with complex…

Computation and Language · Computer Science 2025-05-29 Kun Li , Yunxiang Li , Tianhua Zhang , Hongyin Luo , Xixin Wu , James Glass , Helen Meng

Continuous learning seeks to perform the learning on the data that arrives from time to time. While prior works have demonstrated several possible solutions, these approaches require excessive training time as well as memory usage. This is…

Computer Vision and Pattern Recognition · Computer Science 2020-07-06 Chih-Hsing Ho , Shang-Ho , Tsai

Machine reading comprehension (MRC) is an AI challenge that requires machine to determine the correct answers to questions based on a given passage. MRC systems must not only answer question when necessary but also distinguish when no…

Computation and Language · Computer Science 2020-12-14 Zhuosheng Zhang , Junjie Yang , Hai Zhao

Retrieval-Augmented Language Models (RALMs) have significantly improved performance in open-domain question answering (QA) by leveraging external knowledge. However, RALMs still struggle with unanswerable queries, where the retrieved…

Computation and Language · Computer Science 2024-08-09 Seong-Il Park , Seung-Woo Choi , Na-Hyun Kim , Jay-Yoon Lee

Retrieval-augmented generation (RAG) enhances language models by integrating external knowledge, but its effectiveness is highly dependent on system configuration. Improper retrieval settings can degrade performance, making RAG less…

Computation and Language · Computer Science 2025-07-17 Jennifer Hsia , Afreen Shaikh , Zhiruo Wang , Graham Neubig

Robust text reading from street view images provides valuable information for various applications. Performance improvement of existing methods in such a challenging scenario heavily relies on the amount of fully annotated training data,…

Computer Vision and Pattern Recognition · Computer Science 2019-09-18 Yipeng Sun , Zihan Ni , Chee-Kheng Chng , Yuliang Liu , Canjie Luo , Chun Chet Ng , Junyu Han , Errui Ding , Jingtuo Liu , Dimosthenis Karatzas , Chee Seng Chan , Lianwen Jin

Unstructured text data annotation is foundational to management research. LLMs offer a cost-effective and scalable alternative to human annotation, but they introduce a novel challenge: the annotator itself can be retired. Proprietary…

Computation and Language · Computer Science 2026-05-13 Xiang Cheng , Raveesh Mayya , João Sedoc

This thesis rigorously studies fundamental reinforcement learning (RL) methods in modern practical considerations, including robust RL, distributional RL, and offline RL with neural function approximation. The thesis first prepares the…

Machine Learning · Computer Science 2022-03-04 Thanh Nguyen-Tang

Asynchronous Advantage Actor Critic (A3C) is an effective Reinforcement Learning (RL) algorithm for a wide range of tasks, such as Atari games and robot control. The agent learns policies and value function through trial-and-error…

Machine Learning · Computer Science 2019-12-03 Zhaoyuan Gu , Zhenzhong Jia , Howie Choset

Machine Reading Comprehension (MRC) is the task of answering a question over a paragraph of text. While neural MRC systems gain popularity and achieve noticeable performance, issues are being raised with the methodology used to establish…

Computation and Language · Computer Science 2020-03-11 Viktor Schlegel , Marco Valentino , André Freitas , Goran Nenadic , Riza Batista-Navarro

Estimating the true rank of a noisy data matrix is a fundamental problem underlying techniques such as principal component analysis, matrix completion, etc. Existing rank estimation criteria, including information-based and cross-validation…

Methodology · Statistics 2025-10-23 Subhrajyoty Roy , Abhik Ghosh , Ayanendranath Basu

In recent years, recommender systems have become a ubiquitous part of our daily lives, while they suffer from a high risk of being attacked due to the growing commercial and social values. Despite significant research progress in…

Information Retrieval · Computer Science 2023-09-12 Changsheng Wang , Jianbai Ye , Wenjie Wang , Chongming Gao , Fuli Feng , Xiangnan He

We present the first learning-augmented data structure for implementing dictionaries with optimal consistency and robustness. Our data structure, named RobustSL, is a skip list augmented by predictions of access frequencies of elements in a…

Data Structures and Algorithms · Computer Science 2024-02-16 Ali Zeynali , Shahin Kamali , Mohammad Hajiesmaili

While crowdsourcing has emerged as a practical solution for labeling large datasets, it presents a significant challenge in learning accurate models due to noisy labels from annotators with varying levels of expertise. Existing methods…

Machine Learning · Computer Science 2024-11-27 Hui Guo , Grace Y. Yi , Boyu Wang

Robust principal component analysis (RPCA) is a widely used tool for dimension reduction. In this work, we propose a novel non-convex algorithm, coined Iterated Robust CUR (IRCUR), for solving RPCA problems, which dramatically improves the…

Machine Learning · Statistics 2021-02-09 HanQin Cai , Keaton Hamm , Longxiu Huang , Jiaqi Li , Tao Wang

This paper introduces reviewability as a framework for improving the accountability of automated and algorithmic decision-making (ADM) involving machine learning. We draw on an understanding of ADM as a socio-technical process involving…

Computers and Society · Computer Science 2021-02-11 Jennifer Cobbe , Michelle Seng Ah Lee , Jatinder Singh