English
Related papers

Related papers: Lightweight Conditional Model Extrapolation for St…

200 papers

In this paper, a novel extreme learning machine based online multi-label classifier for real-time data streams is proposed. Multi-label classification is one of the actively researched machine learning paradigm that has gained much…

Machine Learning · Computer Science 2016-09-16 Rajasekar Venkatesan , Meng Joo Er , Shiqian Wu , Mahardhika Pratama

We address the problem of active learning under label shift: when the class proportions of source and target domains differ. We introduce a "medial distribution" to incorporate a tradeoff between importance weighting and class-balanced…

Machine Learning · Computer Science 2021-03-01 Eric Zhao , Anqi Liu , Animashree Anandkumar , Yisong Yue

In this paper, we present a new idea for Transfer Learning (TL) based on Gibbs Sampling. Gibbs sampling is an algorithm in which instances are likely to transfer to a new state with a higher possibility with respect to a probability…

Machine Learning · Computer Science 2020-06-26 Hossein Shahabadi Farahani , Alireza Fatehi , Mahdi Aliyari Shoorehdeli

Training state-of-the-art vision models has become prohibitively expensive for researchers and practitioners. For the sake of accessibility and resource reuse, it is important to focus on adapting these models to a variety of downstream…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Malik Boudiaf , Romain Mueller , Ismail Ben Ayed , Luca Bertinetto

In this study, we present a meta-learning model to adapt the predictions of the network's capacity between viewers who participate in a live video streaming event. We propose the MELANIE model, where an event is formulated as a Markov…

Networking and Internet Architecture · Computer Science 2021-11-19 Stefanos Antaris , Dimitrios Rafailidis , Sarunas Girdzijauskas

This paper focuses on supervised and unsupervised online label shift, where the class marginals $Q(y)$ varies but the class-conditionals $Q(x|y)$ remain invariant. In the unsupervised setting, our goal is to adapt a learner, trained on some…

Machine learning methods adapt the parameters of a model, constrained to lie in a given model class, by using a fixed learning procedure based on data or active observations. Adaptation is done on a per-task basis, and retraining is needed…

Machine Learning · Computer Science 2021-10-22 Osvaldo Simeone , Sangwoo Park , Joonhyuk Kang

In scenarios where obtaining real-time labels proves challenging, conventional approaches may result in sub-optimal performance. This paper presents an optimal strategy for streaming contexts with limited labeled data, introducing an…

Machine Learning · Computer Science 2024-04-25 Rene Richard , Nabil Belacel

Online learning, where feature spaces can change over time, offers a flexible learning paradigm that has attracted considerable attention. However, it still faces three significant challenges. First, the heterogeneity of real-world data…

Machine Learning · Computer Science 2025-07-17 Shengda Zhuo , Di Wu , Yi He , Shuqiang Huang , Xindong Wu

Unsupervised learning from continuous visual streams is a challenging problem that cannot be naturally and efficiently managed in the classic batch-mode setting of computation. The information stream must be carefully processed accordingly…

Machine Learning · Computer Science 2020-06-17 Matteo Tiezzi , Stefano Melacci , Alessandro Betti , Marco Maggini , Marco Gori

Transfer learning enhances prediction accuracy on a target distribution by leveraging data from a source distribution, demonstrating significant benefits in various applications. This paper introduces a novel dissimilarity measure that…

Machine Learning · Statistics 2024-12-12 Mitsuhiro Fujikawa , Yohei Akimoto , Jun Sakuma , Kazuto Fukuchi

This work proposes a decentralized architecture, where individual agents aim at solving a classification problem while observing streaming features of different dimensions and arising from possibly different distributions. In the context of…

Machine Learning · Computer Science 2022-12-27 Virginia Bordignon , Stefan Vlaski , Vincenzo Matta , Ali H. Sayed

Transfer learning techniques aim to leverage information from multiple related datasets to enhance prediction quality against a target dataset. Such methods have been adopted in the context of high-dimensional sparse regression, and some…

Machine Learning · Statistics 2025-01-31 Koki Okajima , Tomoyuki Obuchi

This work proposes a new way of combining independently trained classifiers over space and time. Combination over space means that the outputs of spatially distributed classifiers are aggregated. Combination over time means that the…

Signal Processing · Electrical Eng. & Systems 2021-04-19 Virginia Bordignon , Stefan Vlaski , Vincenzo Matta , Ali H. Sayed

In this paper we consider the machine learning (ML) task of predicting tipping point transitions and long-term post-tipping-point behavior associated with the time evolution of an unknown (or partially unknown), non-stationary, potentially…

Machine Learning · Computer Science 2023-03-08 Dhruvit Patel , Edward Ott

Large scale, streaming datasets are ubiquitous in modern machine learning. Streaming algorithms must be scalable, amenable to incremental training and robust to the presence of non-stationarity. In this work consider the problem of learning…

Machine Learning · Statistics 2017-12-15 Ricardo Pio Monti , Christoforos Anagnostopoulos , Giovanni Montana

Modern deep learning requires large-scale extensively labelled datasets for training. Few-shot learning aims to alleviate this issue by learning effectively from few labelled examples. In previously proposed few-shot visual classifiers, it…

Computer Vision and Pattern Recognition · Computer Science 2022-12-13 Peyman Bateni , Jarred Barber , Raghav Goyal , Vaden Masrani , Jan-Willem van de Meent , Leonid Sigal , Frank Wood

The i.i.d. assumption is a useful idealization that underpins many successful approaches to supervised machine learning. However, its violation can lead to models that learn to exploit spurious correlations in the training data, rendering…

Machine Learning · Computer Science 2020-06-15 Daniel Pace , Alessandra Russo , Murray Shanahan

Stream mining poses unique challenges to machine learning: predictive models are required to be scalable, incrementally trainable, must remain bounded in size (even when the data stream is arbitrarily long), and be nonparametric in order to…

Machine Learning · Statistics 2015-08-21 Rocco De Rosa , Francesco Orabona , Nicolò Cesa-Bianchi

Standard Large Language Models (LLMs) are predominantly designed for static inference with pre-defined inputs, which limits their applicability in dynamic, real-time scenarios. To address this gap, the streaming LLM paradigm has emerged.…

Computation and Language · Computer Science 2026-04-21 Junlong Tong , Zilong Wang , YuJie Ren , Peiran Yin , Hao Wu , Wei Zhang , Xiaoyu Shen