English
Related papers

Related papers: MATT-CTR: Unleashing a Model-Agnostic Test-Time Pa…

200 papers

This research designs a unified architecture of CTR prediction benchmark (Bench-CTR) platform that offers flexible interfaces with datasets and components of a wide range of CTR prediction models. Moreover, we construct a comprehensive…

Information Retrieval · Computer Science 2025-12-02 Shan Gao , Yanwu Yang

Test time adaptation (TTA) equips deep learning models to handle unseen test data that deviates from the training distribution, even when source data is inaccessible. While traditional TTA methods often rely on entropy as a confidence…

Machine Learning · Computer Science 2024-09-17 Afshar Shamsi , Rejisa Becirovic , Ahmadreza Argha , Ehsan Abbasnejad , Hamid Alinejad-Rokny , Arash Mohammadi

Model evolution and constant availability of data are two common phenomena in large-scale real-world machine learning applications, e.g. ads and recommendation systems. To adapt, the real-world system typically retrain with all available…

Information Retrieval · Computer Science 2023-07-06 Jian Zhu , Congcong Liu , Pei Wang , Xiwei Zhao , Zhangang Lin , Jingping Shao

Covariate shift has been shown to sharply degrade both predictive accuracy and the calibration of uncertainty estimates for deep learning models. This is worrying, because covariate shift is prevalent in a wide range of real world…

Machine Learning · Computer Science 2021-01-18 Zachary Nado , Shreyas Padhy , D. Sculley , Alexander D'Amour , Balaji Lakshminarayanan , Jasper Snoek

Chain-of-thought (CoT) reasoning has emerged as a powerful tool for improving large language model performance on complex tasks, but recent work shows that reasoning steps often fail to causally influence the final answer, creating brittle…

Reasoning about human motion is a core component of modern human-robot interactive systems. In particular, one of the main uses of behavior prediction in autonomous systems is to inform robot motion planning and control. However, a majority…

Robotics · Computer Science 2021-01-15 Boris Ivanovic , Amine Elhafsi , Guy Rosman , Adrien Gaidon , Marco Pavone

Click-Through Rate (CTR) prediction has become an essential task in digital industries, such as digital advertising or online shopping. Many deep learning-based methods have been implemented and have become state-of-the-art models in the…

Information Retrieval · Computer Science 2024-06-19 Ibrahim Can Yilmaz , Said Aldemir

Test-time adaptation (TTA) enables efficient adaptation of deployed models, yet it often leads to poorly calibrated predictive uncertainty - a critical issue in high-stakes domains such as autonomous driving, finance, and healthcare.…

Machine Learning · Computer Science 2025-12-09 Gilhyun Nam , Taewon Kim , Joonhyun Jeong , Eunho Yang

Constructing valid confidence sets is a crucial task in statistical inference, yet traditional methods often face challenges when dealing with complex models or limited observed sample sizes. These challenges are frequently encountered in…

Due to the vast testing space, the increasing demand for effective and efficient testing of deep neural networks (DNNs) has led to the development of various DNN test case prioritization techniques. However, the fact that DNNs can deliver…

Software Engineering · Computer Science 2024-09-17 Jialuo Chen , Jingyi Wang , Xiyue Zhang , Youcheng Sun , Marta Kwiatkowska , Jiming Chen , Peng Cheng

Deep neural networks (DNNs) have made great strides in pushing the state-of-the-art in several challenging domains. Recent studies reveal that they are prone to making overconfident predictions. This greatly reduces the overall trust in…

Computer Vision and Pattern Recognition · Computer Science 2023-09-07 Vinith Kugathasan , Muhammad Haris Khan

Confounding is a significant obstacle to unbiased estimation of causal effects from observational data. For settings with high-dimensional covariates -- such as text data, genomics, or the behavioral social sciences -- researchers have…

Artificial Intelligence · Computer Science 2024-02-01 Katherine A. Keith , Sergey Feldman , David Jurgens , Jonathan Bragg , Rohit Bhattacharya

Test-time adaptation aims to improve model robustness under distribution shifts by adapting models with access to unlabeled target samples. A primary cause of performance degradation under such shifts is the model's reliance on features…

Machine Learning · Computer Science 2025-10-14 Yingnan Liu , Rui Qiao , Mong Li Lee , Wynne Hsu

Click-through rate (CTR) prediction is a vital task in industrial recommendation systems. Most existing methods focus on the network architecture design of the CTR model for better accuracy and suffer from the data sparsity problem.…

Information Retrieval · Computer Science 2023-12-19 Qi Liu , Xuyang Hou , Defu Lian , Zhe Wang , Haoran Jin , Jia Cheng , Jun Lei

Neural NLP models are often miscalibrated and overconfident, assigning high confidence to incorrect predictions and failing to express uncertainty during internal evidence aggregation. This undermines selective prediction and high-stakes…

Artificial Intelligence · Computer Science 2026-03-11 Elias Hossain , Shubhashis Roy Dipta , Subash Neupane , Rajib Rana , Ravid Shwartz-Ziv , Ivan Garibay , Niloofar Yousefi

Connectionist Temporal Classification (CTC) is a widely used criterion for training supervised sequence-to-sequence (seq2seq) models. It enables learning the relations between input and output sequences, termed alignments, by marginalizing…

Computation and Language · Computer Science 2024-03-08 Eliya Segev , Maya Alroy , Ronen Katsir , Noam Wies , Ayana Shenhav , Yael Ben-Oren , David Zar , Oren Tadmor , Jacob Bitterman , Amnon Shashua , Tal Rosenwein

Recent advances in foundation models have established scaling laws that enable the development of larger models to achieve enhanced performance, motivating extensive research into large-scale recommendation models. However, simply…

Trust prediction is a key issue in human-robot collaboration, especially in construction scenarios where maintaining appropriate trust calibration is critical for safety and efficiency. This paper introduces the Performance-guided…

Human-Computer Interaction · Computer Science 2025-06-23 Hao Guo , Wei Fan , Shaohui Liu , Feng Jiang , Chunzhi Yi

Parameter-efficient transfer learning (PETL) has shown great potential in adapting a vision transformer (ViT) pre-trained on large-scale datasets to various downstream tasks. Existing studies primarily focus on minimizing the number of…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Zheng Liu , Jinchao Zhu , Nannan Li , Gao Huang

We study rotation-robust learning for image inputs using Convolutional Model Trees (CMTs) [1], whose split and leaf coefficients can be structured on the image grid and transformed geometrically at deployment time. In a controlled MNIST…

Computer Vision and Pattern Recognition · Computer Science 2026-01-09 Hongyi Li , William Ward Armstrong , Jun Xu