English
Related papers

Related papers: Constraint acquisition needs better benchmarks

200 papers

Retrieval Augmented Generation (RAG) systems often struggle with domain-specific knowledge due to performance deterioration of pre-trained embeddings and prohibitive computational costs of large language model (LLM)-based retrievers. While…

Information Retrieval · Computer Science 2025-09-15 Yao Zhao , Yantian Ding , Zhiyue Zhang , Dapeng Yao , Yanxun Xu

Benchmarks are the de facto standard for tracking progress in large language models (LLMs), yet static test sets can rapidly saturate, become vulnerable to contamination, and are costly to refresh. Scalable evaluation of open-ended items…

Computation and Language · Computer Science 2026-03-24 Yandan Zheng , Haoran Luo , Zhenghong Lin , Wenjin Liu , Luu Anh Tuan

Learning representations that generalize well to unknown downstream tasks is a central challenge in representation learning. Existing approaches such as contrastive learning, self-supervised masking, and denoising auto-encoders address this…

Machine Learning · Computer Science 2025-09-10 Micha Livne

Many modern applications collect highly imbalanced categorical data, with some categories relatively rare. Bayesian hierarchical models combat data sparsity by borrowing information, while also quantifying uncertainty. However, posterior…

Statistics Theory · Mathematics 2017-06-27 James E. Johndrow , Aaron Smith , Natesh Pillai , David B. Dunson

Multimodal documents contain diverse elements, such as tables, figures, and layouts, which can complicate retrieval tasks. While current approaches typically combine dense visual embedding models with supervised rerankers to achieve…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Ruofan Hu , Menghui Zhu , Jieming Zhu , Bo Chen , Shengyang Xu , Minjie Hong , Xiaoda Yang , Sashuai Zhou , Li Tang , Tao Jin , Zhou Zhao

The ability to develop or evolve software or software-based systems/services with defined and guaranteed quality in a predictable way is becoming increasingly important. Essential - though not exclusive - prerequisites for this are the…

Software Engineering · Computer Science 2014-01-10 Adam Trendowicz , Michael Kläs , Constanza Lampasona , Jürgen Münch , Christian Körner , Matthias Saft

In this paper, we study the mathematical program with equilibrium constraints (MPEC) formulated as a mathematical program with a parametric generalized equation involving the regular normal cone. Compared with the usual way of formulating…

Optimization and Control · Mathematics 2016-11-24 Helmut Gfrerer , Jane J. Ye

This study develops a framework for a class of constant modulus (CM) optimization problems, which covers binary constraints, discrete phase constraints, semi-orthogonal matrix constraints, non-negative semi-orthogonal matrix constraints,…

Signal Processing · Electrical Eng. & Systems 2024-11-12 Junbin Liu , Ya Liu , Wing-Kin Ma , Mingjie Shao , Anthony Man-Cho So

CLIP-based domain generalization aims to improve model generalization to unseen domains by leveraging the powerful zero-shot classification capabilities of CLIP and multiple source datasets. Existing methods typically train a single model…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Yuhe Ding , Jian Liang , Bo Jiang , Zi Wang , Aihua Zheng , Bin Luo

Constrained clustering allows the training of classification models using pairwise constraints only, which are weak and relatively easy to mine, while still yielding full-supervision-level model performance. While they perform well even in…

Machine Learning · Computer Science 2023-11-28 Jann Goschenhofer , Bernd Bischl , Zsolt Kira

Sequential Monte Carlo (SMC) methods are a class of Monte Carlo methods that are used to obtain random samples of a high dimensional random variable in a sequential fashion. Many problems encountered in applications often involve different…

Methodology · Statistics 2018-12-20 Chencheng Cai , Rong Chen , Ming Lin

Large language models perform strongly on general tasks but remain constrained in specialized settings such as music, particularly in the music-entertainment domain, where corpus scale, purity, and the match between data and training…

Computation and Language · Computer Science 2025-11-19 Kai Tian , Yirong Mao , Wendong Bi , Hanjie Wang , Que Wenhui

In constrained Markov decision processes (CMDPs) with adversarial rewards and constraints, a well-known impossibility result prevents any algorithm from attaining both sublinear regret and sublinear constraint violation, when competing…

Machine Learning · Computer Science 2024-09-27 Francesco Emanuele Stradi , Anna Lunghi , Matteo Castiglioni , Alberto Marchesi , Nicola Gatti

Fragment-based shape signature techniques have proven to be powerful tools for computer-aided drug design. They allow scientists to search for target molecules with some similarity to a known active compound. They do not require reference…

Artificial Intelligence · Computer Science 2022-01-05 Thierry Petit , Randy J. Zauhar

Large Language Model (LLM) has gained popularity and achieved remarkable results in open-domain tasks, but its performance in real industrial domain-specific scenarios is average due to its lack of specific domain knowledge. This issue has…

Computation and Language · Computer Science 2023-10-17 Fangkai Yang , Pu Zhao , Zezhong Wang , Lu Wang , Jue Zhang , Mohit Garg , Qingwei Lin , Saravan Rajmohan , Dongmei Zhang

Knowledge augmentation has significantly enhanced the performance of Large Language Models (LLMs) in knowledge-intensive tasks. However, existing methods typically operate on the simplistic premise that model performance equates with…

Computation and Language · Computer Science 2026-02-16 Hao Chen , Ye He , Yuchun Fan , Yukun Yan , Zhenghao Liu , Qingfu Zhu , Maosong Sun , Wanxiang Che

Many modern statistical estimation problems are defined by three major components: a statistical model that postulates the dependence of an output variable on the input features; a loss function measuring the error between the observed…

Optimization and Control · Mathematics 2018-10-09 Ying Cui , Jong-Shi Pang , Bodhisattva Sen

Asynchronous Bayesian optimization is widely used for gradient-free optimization in domains with independent parallel experiments and varying evaluation times. Existing methods posit that standard acquisitions lead to redundant and repeated…

Machine Learning · Statistics 2026-03-17 Ben Riegler , James Odgers , Vincent Fortuin

Experimental evaluation is an integral part in the design process of algorithms. Publicly available benchmark instances are widely used to evaluate methods in SAT solving. For the interpretation of results and the design of algorithm…

Artificial Intelligence · Computer Science 2021-09-10 Markus Iser , Luca Springer , Carsten Sinz

In Near Memory Processing (NMP), processing elements(PEs) are placed near the 3D memory, reducing unnecessary data transfers between the CPU and the memory. However, as the CPUs and the PEs of the NMP use a shared memory space, maintaining…

Hardware Architecture · Computer Science 2023-12-13 Amit Kumar Kabat , Shubhang Pandey , TG Venkatesh