English
Related papers

Related papers: PACO: Proxy-Task Alignment and Online Calibration …

200 papers

Offline meta-reinforcement learning aims to equip agents with the ability to rapidly adapt to new tasks by training on data from a set of different tasks. Context-based approaches utilize a history of state-action-reward transitions --…

Machine Learning · Computer Science 2025-01-23 Mohammadreza Nakhaei , Aidan Scannell , Joni Pajarinen

We focus on a relatively unexplored learning paradigm known as {\em Online Unsupervised Continual Learning} (O-UCL), where an agent receives a non-stationary, unlabeled data stream and progressively learns to identify an increasing number…

Machine Learning · Computer Science 2024-09-26 Cameron Taylor , Vassilis Vassiliades , Constantine Dovrolis

Anomalies are ubiquitous in all scientific fields and can express an unexpected event due to incomplete knowledge about the data distribution or an unknown process that suddenly comes into play and distorts observations. Due to such events'…

Computer Vision and Pattern Recognition · Computer Science 2021-12-14 Fabio Valerio Massoli , Fabrizio Falchi , Alperen Kantarci , Şeymanur Akti , Hazim Kemal Ekenel , Giuseppe Amato

Classical approaches for one-class problems such as one-class SVM and isolation forest require careful feature engineering when applied to structured domains like images. State-of-the-art methods aim to leverage deep learning to learn…

Machine Learning · Computer Science 2020-08-18 Sachin Goyal , Aditi Raghunathan , Moksh Jain , Harsha Vardhan Simhadri , Prateek Jain

Change Detection (CD) is a fundamental task in remote sensing. It monitors the evolution of land cover over time. Based on this, Open-Vocabulary Change Detection (OVCD) introduces a new requirement. It aims to reduce the reliance on…

Computer Vision and Pattern Recognition · Computer Science 2026-04-27 Xu Zhang , Danyang Li , Yingjie Xia , Xiaohang Dong , Hualong Yu , Jianye Wang , Qicheng Li

Online convex optimization (OCO) is a widely used framework in online learning. In each round, the learner chooses a decision in a convex set and an adversary chooses a convex loss function, and then the learner suffers the loss associated…

Machine Learning · Computer Science 2024-04-02 Raunak Kumar , Sarah Dean , Robert Kleinberg

Open-world object detection (OWOD) is a challenging problem that combines object detection with incremental learning and open-set learning. Compared to standard object detection, the OWOD setting is task to: 1) detect objects seen during…

Computer Vision and Pattern Recognition · Computer Science 2023-02-24 Jinan Yu , Liyan Ma , Zhenglin Li , Yan Peng , Shaorong Xie

Log anomaly detection (LAD) is essential to ensure safe and stable operation of software systems. Although current LAD methods exhibit significant potential in addressing challenges posed by unstable log events and temporal sequence…

Software Engineering · Computer Science 2024-10-23 Jiyu Tian , Mingchu Li , Zumin Wang , Liming Chen , Jing Qin , Runfa Zhang

This paper presents a model based on an hybrid system to numerically simulate the climbing phase of an aircraft. This model is then used within a trajectory prediction tool. Finally, the Covariance Matrix Adaptation Evolution Strategy…

Artificial Intelligence · Computer Science 2012-12-18 Areski Hadjaz , Gaétan Marceau , Pierre Savéant , Marc Schoenauer

Out of distribution (OOD) detection remains a critical challenge in malware classification due to the substantial intra family variability introduced by polymorphic and metamorphic malware variants. Most existing deep learning based malware…

Cryptography and Security · Computer Science 2025-12-22 Tosin Ige , Christopher Kiekintveld , Aritran Piplai , Asif Rahman , Olukunle Kolade , Sasidhar Kunapuli

Pairwise learning refers to learning tasks where the loss function depends on a pair of instances. It instantiates many important machine learning tasks such as bipartite ranking and metric learning. A popular approach to handle streaming…

Machine Learning · Computer Science 2021-11-25 Zhenhuan Yang , Yunwen Lei , Puyu Wang , Tianbao Yang , Yiming Ying

In the realm of high-frequency data streams, achieving real-time learning within varying memory constraints is paramount. This paper presents Ferret, a comprehensive framework designed to enhance online accuracy of Online Continual Learning…

Machine Learning · Computer Science 2025-03-18 Yuhao Zhou , Yuxin Tian , Jindi Lv , Mingjia Shi , Yuanxi Li , Qing Ye , Shuhao Zhang , Jiancheng Lv

We study offline meta-reinforcement learning, a practical reinforcement learning paradigm that learns from offline data to adapt to new tasks. The distribution of offline data is determined jointly by the behavior policy and the task.…

Machine Learning · Computer Science 2022-06-22 Haoqi Yuan , Zongqing Lu

Diffusion Language Models (DLMs) have recently achieved significant success due to their any-order generation capabilities. However, existing inference methods typically rely on local, immediate-step metrics such as confidence or entropy…

Computation and Language · Computer Science 2025-12-03 Kecheng Chen , Ziru Liu , Xijia Tao , Hui Liu , Xinyu Fu , Suiyun Zhang , Dandan Tu , Lingpeng Kong , Rui Liu , Haoliang Li

We propose a plan online and learn offline (POLO) framework for the setting where an agent, with an internal model, needs to continually act and learn in the world. Our work builds on the synergistic relationship between local model-based…

Machine Learning · Computer Science 2019-01-29 Kendall Lowrey , Aravind Rajeswaran , Sham Kakade , Emanuel Todorov , Igor Mordatch

Similarity/Distance measures play a key role in many machine learning, pattern recognition, and data mining algorithms, which leads to the emergence of metric learning field. Many metric learning algorithms learn a global distance function…

Machine Learning · Computer Science 2022-01-04 Baida Hamdan , Davood Zabihzadeh , Monsefi Reza

High Content Imaging (HCI) plays a vital role in modern drug discovery and development pipelines, facilitating various stages from hit identification to candidate drug characterization. Applying machine learning models to these datasets can…

Computer Vision and Pattern Recognition · Computer Science 2023-11-22 Johan Fredin Haslum , Christos Matsoukas , Karl-Johan Leuchowius , Kevin Smith

In many dynamic systems, decisions on system operation are updated over time, and the decision maker requires an online learning approach to optimize its strategy in response to the changing environment. When the loss and constraint…

Information Theory · Computer Science 2021-07-13 Juncheng Wang , Min Dong , Ben Liang , Gary Boudreau

Causal confusion is a phenomenon where an agent learns a policy that reflects imperfect spurious correlations in the data. Such a policy may falsely appear to be optimal during training if most of the training data contain such spurious…

Machine Learning · Computer Science 2023-12-29 Gunshi Gupta , Tim G. J. Rudner , Rowan Thomas McAllister , Adrien Gaidon , Yarin Gal

Although an ever-growing number of applications employ deep learning based systems for prediction, decision-making, or state estimation, almost no certification processes have been established that would allow such systems to be deployed in…

Machine Learning · Computer Science 2024-03-25 Romeo Valentin