English
Related papers

Related papers: Avalanche: an End-to-End Library for Continual Lea…

200 papers

Continuous/Lifelong learning of high-dimensional data streams is a challenging research problem. In fact, fully retraining models each time new data become available is infeasible, due to computational and storage issues, while na\"ive…

Computer Vision and Pattern Recognition · Computer Science 2017-05-11 Vincenzo Lomonaco , Davide Maltoni

While knowledge distillation (transfer) has been attracting attentions from the research community, the recent development in the fields has heightened the need for reproducible studies and highly generalized frameworks to lower barriers to…

Machine Learning · Computer Science 2021-11-17 Yoshitomo Matsubara

What is the state of the art in continual machine learning? Although a natural question for predominant static benchmarks, the notion to train systems in a lifelong manner entails a plethora of additional challenges with respect to set-up…

Machine Learning · Computer Science 2022-02-02 Martin Mundt , Steven Lang , Quentin Delfosse , Kristian Kersting

The alarming decline in global biodiversity, driven by various factors, underscores the urgent need for large-scale wildlife monitoring. In response, scientists have turned to automated deep learning methods for data processing in wildlife…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Andres Hernandez , Zhongqi Miao , Luisa Vargas , Sara Beery , Rahul Dodhia , Pablo Arbelaez , Juan M. Lavista Ferres

One of the more challenging real-world problems in computational intelligence is to learn from non-stationary streaming data, also known as concept drift. Perhaps even a more challenging version of this scenario is when -- following a small…

Machine Learning · Computer Science 2020-12-01 Muhammad Umer , Robi Polikar

Local execution of AI on edge devices is important for low latency and offline operation. However, deploying models on diverse hardware remains fragmented, often requiring model conversion or complete reimplementation outside the PyTorch…

Learning-to-Rank deals with maximizing the utility of a list of examples presented to the user, with items of higher relevance being prioritized. It has several practical applications such as large-scale search, recommender systems,…

Anomaly detection is of paramount importance in many real-world domains, characterized by evolving behavior. Lifelong learning represents an emerging trend, answering the need for machine learning models that continuously adapt to new…

Machine Learning · Computer Science 2024-04-03 Kamil Faber , Roberto Corizzo , Bartlomiej Sniezynski , Nathalie Japkowicz

Large Language Models (LLMs) have witnessed remarkable advancements in recent years, prompting the exploration of tool learning, which integrates LLMs with external tools to address diverse real-world challenges. Assessing the capability of…

Computation and Language · Computer Science 2025-03-06 Zhicheng Guo , Sijie Cheng , Hao Wang , Shihao Liang , Yujia Qin , Peng Li , Zhiyuan Liu , Maosong Sun , Yang Liu

Continual Learning (CL) is a field dedicated to devise algorithms able to achieve lifelong learning. Overcoming the knowledge disruption of previously acquired concepts, a drawback affecting deep learning models and that goes by the name of…

Computer Vision and Pattern Recognition · Computer Science 2023-01-04 Francesco Pelosin

Automated machine learning makes it easier for data scientists to develop pipelines by searching over possible choices for hyperparameters, algorithms, and even pipeline topologies. Unfortunately, the syntax for automated machine learning…

Machine Learning · Computer Science 2020-07-07 Guillaume Baudart , Martin Hirzel , Kiran Kate , Parikshit Ram , Avraham Shinnar

As data are generated more and more from multiple disparate sources, multiview data sets, where each sample has features in distinct views, have ballooned in recent years. However, no comprehensive package exists that enables…

Continual learning is a machine learning sub-field specialized in settings with non-iid data. Hence, the training data distribution is not static and drifts through time. Those drifts might cause interferences in the trained model and…

Machine Learning · Computer Science 2021-02-15 Arthur Douillard , Timothée Lesort

We present ByzFL, an open-source Python library for developing and benchmarking robust federated learning (FL) algorithms. ByzFL provides a unified and extensible framework that includes implementations of state-of-the-art robust…

Machine Learning · Computer Science 2025-06-02 Marc González , Rachid Guerraoui , Rafael Pinot , Geovani Rizk , John Stephan , François Taïani

Hybrid quantum-classical machine learning represents a frontier in computational research, combining the potential advantages of quantum computing with established classical optimization techniques. PennyLane provides a Python framework…

Software Engineering · Computer Science 2025-11-20 Sidney Shapiro

The rapid growth in the size of deep learning models strains the capabilities of traditional dense computation paradigms. Leveraging sparse computation has become increasingly popular for training and deploying large-scale models, but…

Machine Learning · Computer Science 2024-06-21 Bobby Yan , Alexander J. Root , Trevor Gale , David Broman , Fredrik Kjolstad

The ability to learn in dynamic, nonstationary environments without forgetting previous knowledge, also known as Continual Learning (CL), is a key enabler for scalable and trustworthy deployments of adaptive solutions. While the importance…

Machine Learning · Computer Science 2021-03-25 Andrea Cossu , Antonio Carta , Davide Bacciu

Some real-world domains are best characterized as a single task, but for others this perspective is limiting. Instead, some tasks continually grow in complexity, in tandem with the agent's competence. In continual learning, also referred to…

TensorX is a Python library for prototyping, design, and deployment of complex neural network models in TensorFlow. A special emphasis is put on ease of use, performance, and API consistency. It aims to make available high-level components…

Machine Learning · Computer Science 2021-01-05 Davide Nunes , Luis Antunes

The feasibility of deep neural networks (DNNs) to address data stream problems still requires intensive study because of the static and offline nature of conventional deep learning approaches. A deep continual learning algorithm, namely…

Machine Learning · Computer Science 2020-01-10 Andri Ashfahani , Mahardhika Pratama