English
Related papers

Related papers: BOSE: A Systematic Evaluation Method Optimized for…

200 papers

Iterative learning control (ILC) is a method for reducing system tracking or estimation errors over multiple iterations by using information from past iterations. The disturbance observer (DOB) is used to estimate and mitigate disturbances…

Robotics · Computer Science 2024-04-23 Harsh Modi , Zhu Chen , Xiao Liang , Minghui Zheng

The performance of Large Language Models (LLMs) on downstream tasks is fundamentally constrained by the capabilities acquired during pre-training. However, traditional benchmarks like MMLU often fail to reflect a base model's plasticity in…

Computation and Language · Computer Science 2026-05-13 Xiaoyuan Li , Yubo Ma , Kexin Yang , Moxin Li , Keqin Bao , Wenie Wang , Fuli Feng , Dayiheng Liu

Pattern recognition applications often suffer from skewed data distributions between classes, which may vary during operations w.r.t. the design data. Two-class classification systems designed using skewed data tend to recognize the…

Machine Learning · Computer Science 2019-12-02 Roghayeh Soleymani , Eric Granger , Giorgio Fumera

Background: Symbolic models, particularly decision trees, are widely used in software engineering for explainable analytics in defect prediction, configuration tuning, and software quality assessment. Most of these models rely on…

Software Engineering · Computer Science 2026-02-19 Amirali Rayegan , Tim Menzies

We consider the problem of learning linear prediction models with model misspecification bias. In such case, the collinearity among input variables may inflate the error of parameter estimation, resulting in instability of prediction…

Machine Learning · Computer Science 2019-12-02 Zheyan Shen , Peng Cui , Tong Zhang , Kun Kuang

This paper presents an end-to-end framework for safe learning-based control (LbC) using nonlinear stochastic MPC and distributionally robust optimization (DRO). This work is motivated by several open challenges in LbC literature. In…

Systems and Control · Electrical Eng. & Systems 2023-10-31 Aaron Kandel , Scott J. Moura

In-context Learning (ICL) is the ability of Large Language Models (LLMs) to perform new tasks when conditioned on prompts comprising a few task examples. However, ICL performance can be critically sensitive to the choice of examples. To…

Computation and Language · Computer Science 2024-02-23 Shivanshu Gupta , Clemens Rosenbaum , Ethan R. Elenberg

In addition to high accuracy, robustness is becoming increasingly important for machine learning models in various applications. Recently, much research has been devoted to improving the model robustness by training with noise…

Machine Learning · Computer Science 2021-03-30 Kun-Peng Ning , Lue Tao , Songcan Chen , Sheng-Jun Huang

Selective classifiers improve model reliability by abstaining on inputs the model deems uncertain. However, few practical approaches achieve the gold-standard performance of a perfect-ordering oracle that accepts examples exactly in order…

Machine Learning · Computer Science 2025-10-27 Stephan Rabanser , Nicolas Papernot

Learning by examples, which learns to solve a new problem by looking into how similar problems are solved, is an effective learning method in human learning. When a student learns a new topic, he/she finds out exemplar topics that are…

Machine Learning · Computer Science 2021-09-23 Shentong Mo , Pengtao Xie

Imbalanced learning (IL), i.e., learning unbiased models from class-imbalanced data, is a challenging problem. Typical IL methods including resampling and reweighting were designed based on some heuristic assumptions. They often suffer from…

Machine Learning · Computer Science 2020-10-20 Zhining Liu , Pengfei Wei , Jing Jiang , Wei Cao , Jiang Bian , Yi Chang

Large language models (LLMs) often produce confident but incorrect answers in settings where abstention would be safer. Standard evaluation protocols, however, require a response and do not account for how confidence should guide decisions…

Computation and Language · Computer Science 2026-04-06 Sean Wu , Fredrik K. Gustafsson , Edward Phillips , Boyan Gao , Anshul Thakur , David A. Clifton

The deployment of pre-trained perception models in novel environments often leads to performance degradation due to distributional shifts. Although recent artificial intelligence approaches for metacognition use logical rules to…

Instruction finetuning is standard practice for improving LLM performance, yet it remains unclear whether it enhances reasoning or merely induces surface-level pattern matching. We investigate this by evaluating base and instruction-tuned…

Machine Learning · Computer Science 2026-01-21 Prateek Munjal , Clement Christophe , Ronnie Rajan , Praveenkumar Kanithi

The formalism of Bayesian model selection provides a very elegant way of ranking different physical models in terms of how compatible they are with a given set of observed data. However, its practical application is often hampered by the…

Cosmology and Nongalactic Astrophysics · Physics 2026-01-19 Nathan Cohen , Jan Hamann , Ameek Malhotra

Reinforcement learning has significantly enhanced the reasoning capabilities of Large Language Models (LLMs) in complex problem-solving tasks. Recently, the introduction of DeepSeek R1 has inspired a surge of interest in leveraging…

Machine Learning · Computer Science 2025-08-07 Jinghang Han , Jiawei Chen , Hang Shao , Hao Ma , Mingcheng Li , Xintian Shen , Lihao Zheng , Wei Chen , Tao Wei , Lihua Zhang

Continual learning aims to accumulate knowledge over a data stream while mitigating catastrophic forgetting. In Non-exemplar Class Incremental Learning (NECIL), forgetting arises during incremental optimization because old classes are…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Haori Lu , Xusheng Cao , Linlan Huang , Enguang Wang , Fei Yang , Xialei Liu

While Large Audio-Language Models (LALMs) have been shown to exhibit degraded instruction-following capabilities, their ability to infer task patterns from in-context examples under audio conditioning remains unstudied. To address this gap,…

Large language models (LLMs) have shown tremendous success in following user instructions and generating helpful responses. Nevertheless, their robustness is still far from optimal, as they may generate significantly inconsistent responses…

Computation and Language · Computer Science 2024-03-25 Yukun Zhao , Lingyong Yan , Weiwei Sun , Guoliang Xing , Shuaiqiang Wang , Chong Meng , Zhicong Cheng , Zhaochun Ren , Dawei Yin

Visual prompting, an efficient method for transfer learning, has shown its potential in vision tasks. However, previous works focus exclusively on VP from standard source models, it is still unknown how it performs under the scenario of a…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Qi Li , Liangzhi Li , Zhouqiang Jiang , Bowen Wang