English
Related papers

Related papers: Evaluating Performance Consistency in Competitive …

200 papers

This paper introduces Relative Predictive Coding (RPC), a new contrastive representation learning objective that maintains a good balance among training stability, minibatch size sensitivity, and downstream task performance. The key to the…

Machine Learning · Computer Science 2021-04-14 Yao-Hung Hubert Tsai , Martin Q. Ma , Muqiao Yang , Han Zhao , Louis-Philippe Morency , Ruslan Salakhutdinov

Conformal prediction (CP) is a wrapper around traditional machine learning models, giving coverage guarantees under the sole assumption of exchangeability; in classification problems, for a chosen significance level $\varepsilon$, CP…

Machine Learning · Computer Science 2023-02-23 Javier Abad , Umang Bhatt , Adrian Weller , Giovanni Cherubin

Competitive programming, due to its high reasoning difficulty and precise correctness feedback, has become a key task for both training and evaluating the reasoning capabilities of large language models (LLMs). However, while a large amount…

Software Engineering · Computer Science 2025-06-09 Zihan Wang , Siyao Liu , Yang Sun , Hongyan Li , Kai Shen

Playing in the FIFA World Cup finals is an ambition shared by several nations. Since, besides luck and skill, the probability of qualification depends on the design of the qualifiers, the study of these competitions forms an integral part…

Physics and Society · Physics 2021-11-08 László Csató

Recent reports claim that large language models (LLMs) now outperform elite humans in competitive programming. Drawing on knowledge from a group of medalists in international algorithmic contests, we revisit this claim, examining how LLMs…

Concurrent programs are difficult to test due to their inherent non-determinism. To address this problem, testing often requires the exploration of thread schedules of a program; this can be time-consuming when applied to real-world…

Software Engineering · Computer Science 2018-04-11 Tingting Yu , Wei Wen , Xue Han , Jane Hayes

The Common Out-Neighbor (or CON) score quantifies shared influence through outgoing links in competitive contexts. A dynamic analysis of competition networks reveals the CON score as a powerful predictor of node rankings. Defined in…

Social and Information Networks · Computer Science 2025-02-03 Anthony Bonato , Mariam Walaa

Online algorithms process their inputs piece by piece, taking irrevocable decisions for each data item. This model is too restrictive for most partitioning problems, since data that is yet to arrive may render it impossible to extend…

Data Structures and Algorithms · Computer Science 2017-02-21 Christian Konrad , Tigran Tonoyan

The dichotomy between the challenging nature of obtaining annotations for activities, and the more straightforward nature of data collection from wearables, has resulted in significant interest in the development of techniques that utilize…

Machine Learning · Computer Science 2022-11-14 Harish Haresamudram , Irfan Essa , Thomas Ploetz

In this paper, we show that high-performing embedding models organize their embedding spaces in a consistent way. We evaluate 25 contemporary embedding models on five MTEB tasks spanning four diverse task categories (retrieval, bitext…

Computation and Language · Computer Science 2026-05-22 Amanda Myntti , Jenna Kanerva , Veronika Laippala , Filip Ginter

Stochastic optimization algorithms have been successfully applied in several domains to find optimal solutions. Because of the ever-growing complexity of the integrated systems, novel stochastic algorithms are being proposed, which makes…

Artificial Intelligence · Computer Science 2024-06-04 Sowmya Chandrasekaran , Thomas Bartz-Beielstein

In this workshop, we discuss several algorithms for mathematical programs with equilibrium constraints (MPECs). The unifying theme is that MPECs are optimization problems whose feasible set contains a lower-level equilibrium system, often…

Optimization and Control · Mathematics 2026-04-20 Jiguang Yu

Competition retrospectives are useful when they explain what a leaderboard measured, how hidden evaluation changed conclusions, and which design patterns were rewarded. We revisit the CODS 2025 \assetopslive{} challenge, a privacy-aware…

Artificial Intelligence · Computer Science 2026-05-12 Dhaval Patel , Chathurangi Shyalika , Suryanarayana Reddy Yarrabothula , Ling Yue , Shuxin Lin , Nianjun Zhou , James Rayfield

The ubiquity of technology in our daily lives and the economic stability of the technology sector in recent years, especially in areas with a computer science footing, has led to an increase in computer science enrollment in many parts of…

Computers and Society · Computer Science 2014-05-13 Zubair Nabi

Machine learning algorithms in socially sensitive domains (e.g., credit decisions) often focus on equalizing predictive outcomes. However, satisfying these metrics does not guarantee that models use the same reasoning for different groups.…

Machine Learning · Computer Science 2026-05-14 Gideon Popoola , John Sheppard

In today's fast-paced tech industry, there is a growing need for tools that evaluate a programmer's job readiness based on their coding performance. This study focuses on predicting the potential of Codeforces users to secure various levels…

Machine learning (ML) applications have been thriving recently, largely attributed to the increasing availability of data. However, inconsistency and incomplete information are ubiquitous in real-world datasets, and their impact on ML…

Machine Learning · Computer Science 2020-05-13 Bojan Karlaš , Peng Li , Renzhi Wu , Nezihe Merve Gürel , Xu Chu , Wentao Wu , Ce Zhang

Comprehensively understanding and accurately predicting the performance of large language models across diverse downstream tasks has emerged as a pivotal challenge in NLP research. The pioneering scaling law on downstream works demonstrated…

Computation and Language · Computer Science 2024-10-04 Qiyuan Zhang , Fuyuan Lyu , Xue Liu , Chen Ma

Academic challenges comprise effective means for (i) advancing the state of the art, (ii) putting in the spotlight of a scientific community specific topics and problems, as well as (iii) closing the gap for under represented communities in…

Machine Learning · Computer Science 2023-12-04 Hugo Jair Escalante , Aleksandra Kruchinina

The Second International Workshop on Programming Language Approaches to Concurrency and Communication-cEntric Software (PLACES) was co-located with ETAPS 2009 in the city of York, England. The workshop took place on Sunday 22nd March 2009.…

Programming Languages · Computer Science 2010-02-09 Alastair R. Beresford , Simon Gay