English
Related papers

Related papers: SPLADE-v3: New baselines for SPLADE

200 papers

We introduce Massively Multi-Task Model-Based Policy Optimization (M3PO), a scalable model-based reinforcement learning (MBRL) framework designed to address sample inefficiency in single-task settings and poor generalization in multi-task…

Machine Learning · Computer Science 2025-06-30 Aditya Narendra , Dmitry Makarov , Aleksandr Panov

LLM serving platforms are increasingly deployed as multi-model cloud systems, where user demand is often long-tailed: a few popular large models receive most requests, while many smaller tail models remain underutilized. We propose…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-13 Jincheng Xie , Yawen Ling , Qi Xiao , Feiyu Zhang , Zhongyi Huang , Wen Hu , Yu Zheng

Structured sparsity has been proposed as an efficient way to prune the complexity of Machine Learning (ML) applications and to simplify the handling of sparse data in hardware. Accelerating ML models, whether for training, or inference,…

Continual learning under adversarial conditions remains an open problem, as existing methods often compromise either robustness, scalability, or both. We propose a novel framework that integrates Interval Bound Propagation (IBP) with a…

Machine Learning · Computer Science 2025-11-24 Patryk Krukowski , Łukasz Gorczyca , Piotr Helm , Kamil Książek , Przemysław Spurek

The Particle Swarm Optimization Policy (PSO-P) has been recently introduced and proven to produce remarkable results on interacting with academic reinforcement learning benchmarks in an off-policy, batch-based setting. To further…

Machine Learning · Computer Science 2018-01-26 Daniel Hein , Steffen Udluft , Michel Tokic , Alexander Hentschel , Thomas A. Runkler , Volkmar Sterzing

Retrieving code functions, classes or files that are relevant in order to solve a given user query, bug report or feature request from large codebases is a fundamental challenge for Large Language Model (LLM)-based coding agents. Agentic…

Software Engineering · Computer Science 2026-02-09 Shravan Chaudhari , Rahul Thomas Jacob , Mononito Goswami , Jiajun Cao , Shihab Rashid , Christian Bock

Benchmark collections have long enabled controlled comparison and cumulative progress in Information Retrieval (IR). However, prior meta-analyses have shown that reported effectiveness gains often fail to accumulate, in part due to the use…

Information Retrieval · Computer Science 2026-04-08 Moritz Staudinger , Wojciech Kusa , Allan Hanbury

Drawing upon the intuition that aligning different modalities to the same semantic embedding space would allow models to understand states and actions more easily, we propose a new perspective to the offline reinforcement learning (RL)…

Artificial Intelligence · Computer Science 2024-02-21 Tianyu Zheng , Ge Zhang , Xingwei Qu , Ming Kuang , Stephen W. Huang , Zhaofeng He

When dealing with multi-class classification problems, it is common practice to build a model consisting of a series of binary classifiers using a learning paradigm which dictates how the classifiers are built and combined to discriminate…

Machine Learning · Computer Science 2021-01-06 Daniel Cauchi , Adrian Muscat

The information retrieval community has recently witnessed a revolution due to large pretrained transformer models. Another key ingredient for this revolution was the MS MARCO dataset, whose scale and diversity has enabled zero-shot…

Computation and Language · Computer Science 2022-02-11 Luiz Bonifacio , Hugo Abonizio , Marzieh Fadaee , Rodrigo Nogueira

Recent advances in reinforcement learning (RL) have substantially improved the training of large-scale language models, leading to significant gains in generation quality and reasoning ability. However, most existing research focuses on…

Machine Learning · Computer Science 2026-01-13 Di Zhang , Xun Wu , Shaohan Huang , Lingjie Jiang , Yaru Hao , Li Dong , Zewen Chi , Zhifang Sui , Furu Wei

Three-dimensional (3D) imaging is popular in medical applications, however, anisotropic 3D volumes with thick, low-spatial-resolution slices are often acquired to reduce scan times. Deep learning (DL) offers a solution to recover…

Computer Vision and Pattern Recognition · Computer Science 2024-02-06 Michele Pascale , Vivek Muthurangu , Javier Montalt Tordera , Heather E Fitzke , Gauraang Bhatnagar , Stuart Taylor , Jennifer Steeden

Reinforcement learning (RL) has emerged as an effective paradigm for enhancing model reasoning. However, existing RL methods like GRPO typically rely on unstructured self-sampling to fit scalar rewards, often producing inefficient rollouts…

Computation and Language · Computer Science 2026-05-18 Jinyang Wu , Chonghua Liao , Mingkuan Feng , Shuai Zhang , Zhengqi Wen , Haoran Luo , Ling Yang , Huazhe Xu , Jianhua Tao

In this work, we introduce the Qwen3 Embedding series, a significant advancement over its predecessor, the GTE-Qwen series, in text embedding and reranking capabilities, built upon the Qwen3 foundation models. Leveraging the Qwen3 LLMs'…

Computation and Language · Computer Science 2025-06-12 Yanzhao Zhang , Mingxin Li , Dingkun Long , Xin Zhang , Huan Lin , Baosong Yang , Pengjun Xie , An Yang , Dayiheng Liu , Junyang Lin , Fei Huang , Jingren Zhou

State-of-the-art results in large language models (LLMs) often rely on scale, which becomes computationally expensive. This has sparked a research agenda to reduce these models' parameter counts and computational costs without significantly…

Computation and Language · Computer Science 2024-11-07 Xiuying Wei , Skander Moalla , Razvan Pascanu , Caglar Gulcehre

Can a model learn to escape its own learning plateau? Reinforcement learning methods for finetuning large reasoning models stall on datasets with low initial success rates, and thus little training signal. We investigate a fundamental…

Machine Learning · Computer Science 2026-02-09 Shobhita Sundaram , John Quan , Ariel Kwiatkowski , Kartik Ahuja , Yann Ollivier , Julia Kempe

The rapid advancement of Large Language Models (LLMs) in software engineering has revealed critical limitations in existing benchmarks, particularly the widely used SWE-bench dataset. Recent studies have uncovered severe data contamination…

Objective: To develop and evaluate a scalable methodology for harmonizing inconsistent units in large-scale clinical datasets, addressing a key barrier to data interoperability. Materials and Methods: We designed a novel unit harmonization…

Machine Learning · Computer Science 2025-11-18 Jordi de la Torre

While a large number of pre-trained models of source code have been successfully developed and applied to a variety of software engineering (SE) tasks in recent years, our understanding of these pre-trained models is arguably fairly…

Software Engineering · Computer Science 2023-02-09 Changan Niu , Chuanyi Li , Vincent Ng , Dongxiao Chen , Jidong Ge , Bin Luo

Task-based programming models have proven to be a robust and versatile way to approach development of applications for distributed environments. They provide natural programming patterns with high performance. However, execution on this…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-08-08 Alex Barcelo , Anna Queralt , Toni Cortes