English
Related papers

Related papers: Are We Really Measuring Progress? Transferring Ins…

200 papers

While pre-trained language models (LMs) have brought great improvements in many NLP tasks, there is increasing attention to explore capabilities of LMs and interpret their predictions. However, existing works usually focus only on a certain…

Computation and Language · Computer Science 2022-07-29 Yaozong Shen , Lijie Wang , Ying Chen , Xinyan Xiao , Jing Liu , Hua Wu

In recent years, large language models (LLMs) have emerged as promising candidates for graph tasks. Many studies leverage natural language to describe graphs and apply LLMs for reasoning, yet most focus narrowly on performance benchmarks…

Machine Learning · Computer Science 2026-01-28 Yuxiang Wang , Xinnan Dai , Wenqi Fan , Yao Ma

Recent advances in employing neural networks on graph domains helped push the state of the art in link prediction tasks, particularly in recommendation services. However, the use of temporal contextual information, often modeled as dynamic…

Information Retrieval · Computer Science 2018-11-20 Samuel G. Fadel , Ricardo da S. Torres

Graph machine learning has enjoyed a meteoric rise in popularity since the introduction of deep learning in graph contexts. This is no surprise due to the ubiquity of graph data in large scale industrial settings. Tacitly assumed in all…

Machine Learning · Computer Science 2024-12-10 Isay Katsman , Ethan Lou , Anna Gilbert

Test case prioritisation (TCP) is a critical task in regression testing to ensure quality as software evolves. Machine learning has become a common way to achieve it. In particular, learning-to-rank (LTR) algorithms provide an effective…

Software Engineering · Computer Science 2024-05-24 Aurora Ramírez , Mario Berrios , José Raúl Romero , Robert Feldt

Understanding the trustworthiness of a prediction yielded by a classifier is critical for the safe and effective use of AI models. Prior efforts have been proven to be reliable on small-scale datasets. In this work, we study the problem of…

Computer Vision and Pattern Recognition · Computer Science 2021-10-29 Yan Luo , Yongkang Wong , Mohan S. Kankanhalli , Qi Zhao

Regression testing is an essential activity to assure that software code changes do not adversely affect existing functionalities. With the wide adoption of Continuous Integration (CI) in software projects, which increases the frequency of…

Software Engineering · Computer Science 2022-09-07 Rongqi Pan , Mojtaba Bagherzadeh , Taher A. Ghaleb , Lionel Briand

Time-dependent data-generating distributions have proven to be difficult for gradient-based training of neural networks, as the greedy updates result in catastrophic forgetting of previously learned knowledge. Despite the progress in the…

Machine Learning · Computer Science 2023-04-03 Matthias De Lange , Gido van de Ven , Tinne Tuytelaars

Despite the prevalence of recent success in learning from static graphs, learning from time-evolving graphs remains an open challenge. In this work, we design new, more stringent evaluation procedures for link prediction specific to dynamic…

Machine Learning · Computer Science 2022-09-13 Farimah Poursafaei , Shenyang Huang , Kellin Pelrine , Reihaneh Rabbany

As NLP models achieved state-of-the-art performances over benchmarks and gained wide applications, it has been increasingly important to ensure the safe deployment of these models in the real world, e.g., making sure the models are robust…

Computation and Language · Computer Science 2022-05-11 Xuezhi Wang , Haohan Wang , Diyi Yang

The design of algorithms that generate personalized ranked item lists is a central topic of research in the field of recommender systems. In the past few years, in particular, approaches based on deep learning (neural) techniques have…

Information Retrieval · Computer Science 2021-01-08 Maurizio Ferrari Dacrema , Simone Boglio , Paolo Cremonesi , Dietmar Jannach

Learning with limited labelled data, such as prompting, in-context learning, fine-tuning, meta-learning or few-shot learning, aims to effectively train a model using only a small amount of labelled samples. However, these approaches have…

Machine Learning · Computer Science 2024-12-03 Branislav Pecher , Ivan Srba , Maria Bielikova

This paper addresses the problem of learning optimal control policies for systems with uncertain dynamics and high-level control objectives specified as Linear Temporal Logic (LTL) formulas. Uncertainty is considered in the workspace…

Robotics · Computer Science 2024-10-17 Yiannis Kantaros , Jun Wang

The rapid evolution of large language models (LLMs) and the real world has outpaced the static nature of widely used evaluation benchmarks, raising concerns about their reliability for evaluating LLM factuality. While substantial works…

Computation and Language · Computer Science 2026-01-21 Xunyi Jiang , Dingyi Chang , Julian McAuley , Xin Xu

Experiments used in current continual learning research do not faithfully assess fundamental challenges of learning continually. Instead of assessing performance on challenging and representative experiment designs, recent research has…

Machine Learning · Statistics 2019-06-27 Sebastian Farquhar , Yarin Gal

The capability of Large Language Models (LLMs) to plan remains a topic of debate. Some critics argue that strategies to boost LLMs' reasoning skills are ineffective in planning tasks, while others report strong outcomes merely from training…

Computation and Language · Computer Science 2024-12-17 Sukai Huang , Trevor Cohn , Nir Lipovetzky

Programming Knowledge Tracing (PKT) has recently advanced through hybrid approaches that integrate attention-based feature modeling for code representation with RNN-based sequential prediction. While these models report strong empirical…

Machine Learning · Computer Science 2026-05-07 Jaewook Kim , Hyeoncheol Kim

Despite continual learning's long and well-established academic history, its application in real-world scenarios remains rather limited. This paper contends that this gap is attributable to a misalignment between the actual challenges of…

Machine Learning · Computer Science 2024-02-16 Theodora Kontogianni , Yuanwen Yue , Siyu Tang , Konrad Schindler

NLP benchmarks rely on standardized datasets for training and evaluating models and are crucial for advancing the field. Traditionally, expert annotations ensure high-quality labels; however, the cost of expert annotation does not scale…

Computation and Language · Computer Science 2025-09-15 Omer Nahum , Nitay Calderon , Orgad Keller , Idan Szpektor , Roi Reichart

Learning from Label Proportions (LLP) is an established machine learning problem with numerous real-world applications. In this setting, data items are grouped into bags, and the goal is to learn individual item labels, knowing only the…

Machine Learning · Computer Science 2023-10-31 Gabriel Franco , Giovanni Comarela , Mark Crovella