English
Related papers

Related papers: Adaptive Learn-then-Test: Statistically Valid and …

200 papers

Learning-to-rank (LTR) is a class of supervised learning techniques that apply to ranking problems dealing with a large number of features. The popularity and widespread application of LTR models in prioritizing information in a variety of…

Machine Learning · Computer Science 2020-05-19 Jaspreet Singh , Zhenye Wang , Megha Khosla , Avishek Anand

The effectiveness of large language models (LLMs) is not only measured by their ability to generate accurate outputs but also by their calibration-how well their confidence scores reflect the probability of their outputs being correct.…

Machine Learning · Computer Science 2024-10-01 Johnathan Xie , Annie S. Chen , Yoonho Lee , Eric Mitchell , Chelsea Finn

Selecting artificial intelligence (AI) models, such as large language models (LLMs), from multiple candidates requires accurate performance estimation. This is ideally achieved through empirical evaluations involving abundant real-world…

Machine Learning · Statistics 2025-12-03 Sangwoo Park , Matteo Zecchin , Osvaldo Simeone

Computerized Adaptive Testing (CAT) offers an efficient and personalized method for assessing examinee proficiency by dynamically adjusting test questions based on individual performance. Compared to traditional, non-personalized testing…

Sample size calculations for power analysis are critical for clinical research and trial design, yet their complexity and reliance on statistical expertise create barriers for many researchers. We introduce PowerGPT, an AI-powered system…

Pretrained on web-scale open data, VLMs offer powerful capabilities for solving downstream tasks after being adapted to task-specific labeled data. Yet, data labeling can be expensive and may demand domain expertise. Active Learning (AL)…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Tong Wang , Jiaqi Wang , Shu Kong

To understand and predict the performance of scientific applications, several analytical and machine learning approaches have been proposed, each having its advantages and disadvantages. In this paper, we propose and validate a hybrid…

Performance · Computer Science 2019-02-27 Huda Ibeid , Siping Meng , Oliver Dobon , Luke Olson , William Gropp

We present a novel hierarchical triplet loss (HTL) capable of automatically collecting informative training samples (triplets) via a defined hierarchical tree that encodes global context information. This allows us to cope with the main…

Computer Vision and Pattern Recognition · Computer Science 2018-10-17 Weifeng Ge , Weilin Huang , Dengke Dong , Matthew R. Scott

Continual learning involves training neural networks incrementally for new tasks while retaining the knowledge of previous tasks. However, efficiently fine-tuning the model for sequential tasks with minimal computational resources remains a…

Sound · Computer Science 2024-01-03 Nithish Muthuchamy Selvaraj , Xiaobao Guo , Adams Kong , Bingquan Shen , Alex Kot

Machine learning assumes a pivotal role in our data-driven world. The increasing scale of models and datasets necessitates quick and reliable algorithms for model training. This dissertation investigates adaptivity in machine learning…

Machine Learning · Computer Science 2023-11-20 Slavomír Hanzely

Accelerated life testing (ALT) is a method of reducing the lifetime of components through exposure to extreme stress. This method of obtaining lifetime information involves the design of a testing experiment, i.e., an accelerated test plan.…

Applications · Statistics 2025-11-10 Owen McGrath , Kevin Burke

Neural networks have demonstrated exceptional performance in supervised learning, benefiting from abundant high-quality annotated data. However, obtaining such data in real-world scenarios is costly and labor-intensive. Semi-supervised…

Machine Learning · Computer Science 2025-06-03 Shuai Zhao , Heyan Huang , Xinge Li , Xiaokang Chen , Rui Wang

An effective online recommendation system should jointly capture users' long-term and short-term preferences in both users' internal behaviors (from the target recommendation task) and external behaviors (from other tasks). However, it is…

Information Retrieval · Computer Science 2021-11-29 Ruobing Xie , Yalong Wang , Rui Wang , Yuanfu Lu , Yuanhang Zou , Feng Xia , Leyu Lin

We introduce HAML (Hamiltonian Adaptation via Meta-Learning), a framework for fast online adaptation of effective Hamiltonian models of superconducting quantum processors. HAML proceeds in two phases. A supervised training phase uses an…

Quantum Physics · Physics 2026-04-29 Arielle Sanford , Andrew T. Kamen , Frederic T. Chong , Andy J. Goldschmidt

We develop a hyperparameter optimisation algorithm, Automated Budget Constrained Training (AutoBCT), which balances the quality of a model with the computational cost required to tune it. The relationship between hyperparameters, model…

Machine Learning · Statistics 2024-02-06 Lukas Cironis , Jan Palczewski , Georgios Aivaliotis

Multi-task learning (MTL) has recently contributed to learning better representations in service of various NLP tasks. MTL aims at improving the performance of a primary task, by jointly training on a secondary task. This paper introduces…

Machine Learning · Computer Science 2017-09-21 Davis Liang , Yan Shu

Informed sampling-based planning algorithms exploit problem knowledge for better search performance. This knowledge is often expressed as heuristic estimates of solution cost and used to order the search. The practical improvement of this…

Robotics · Computer Science 2020-12-10 Marlin P. Strub , Jonathan D. Gammell

The exponential growth of volume, variety and velocity of data is raising the need for investigations of automated or semi-automated ways to extract useful patterns from the data. It requires deep expert knowledge and extensive…

Machine Learning · Computer Science 2020-07-22 Abbas Raza Ali , Marcin Budka , Bogdan Gabrys

The combination of LLM agents with external tools enables models to solve complex tasks beyond their knowledge base. Human-designed tools are inflexible and restricted to solutions within the scope of pre-existing tools created by experts.…

Artificial Intelligence · Computer Science 2025-11-18 Mohd Ariful Haque , Justin Williams , Sunzida Siddique , Md. Hujaifa Islam , Hasmot Ali , Kishor Datta Gupta , Roy George

Neural networks require a large amount of annotated data to learn. Meta-learning algorithms propose a way to decrease the number of training samples to only a few. One of the most prominent optimization-based meta-learning algorithms is…

Machine Learning · Computer Science 2022-06-14 Kostiantyn Khabarlak