English
Related papers

Related papers: FEET: A Framework for Evaluating Embedding Techniq…

200 papers

We tackle the challenge of feature embedding for the purposes of improving the click-through rate prediction process. We select three models: logistic regression, factorization machines and deep factorization machines, as our baselines and…

Machine Learning · Computer Science 2022-09-21 Samo Pahor , Davorin Kopič , Jure Demšar

Foundation models (FMs) have achieved significant success across various tasks, leading to research on benchmarks for reasoning abilities. However, there is a lack of studies on FMs performance in exceptional scenarios, which we define as…

Artificial Intelligence · Computer Science 2024-12-06 Suho Kang , Jungyang Park , Joonseo Ha , SoMin Kim , JinHyeong Kim , Subeen Park , Kyungwoo Song

Federated Learning (FL) presents a robust paradigm for privacy-preserving, decentralized machine learning. However, a significant gap persists between the theoretical design of FL algorithms and their practical performance, largely because…

Networking and Internet Architecture · Computer Science 2025-09-05 Osama Abu Hamdan , Hao Che , Engin Arslan , Md Arifuzzaman

Pretrained foundation models learn embeddings that can be used for a wide range of downstream tasks. These embeddings optimise general performance, and if insufficiently accurate at a specific task the model can be fine-tuned to improve…

Machine Learning · Computer Science 2025-02-20 Matthew P. Wilson , Edward O. Pyzer-Knapp , Nicolas Galichet , Luke Dicks

The deployment of machine learning models in operational contexts represents a significant investment for any organisation. Consequently, the risk of these models being misappropriated by competitors needs to be addressed. In recent years,…

Machine Learning · Computer Science 2025-05-26 Augustin Godinot , Erwan Le Merrer , Camilla Penzo , François Taïani , Gilles Trédan

Evaluating foundation models under appropriate adaptation settings is essential for understanding the quality and transferability of the learned representations. Recent EEG foundation models have demonstrated promising transfer capabilities…

Machine Learning · Computer Science 2026-05-28 Aditya Kommineni , Emily Zhou , Kleanthis Avramidis , Tiantian Feng , Shrikanth Narayanan

Most modern multiple object tracking (MOT) systems follow the tracking-by-detection paradigm, consisting of a detector followed by a method for associating detections into tracks. There is a long history in tracking of combining motion and…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Mohamed Chaabane , Peter Zhang , J. Ross Beveridge , Stephen O'Hara

Numerous benchmarks for Few-Shot Learning have been proposed in the last decade. However all of these benchmarks focus on performance averaged over many tasks, and the question of how to reliably evaluate and tune models trained for…

Machine Learning · Computer Science 2023-07-07 Luísa Shimabucoro , Timothy Hospedales , Henry Gouk

Modern multiple object tracking (MOT) systems usually follow the \emph{tracking-by-detection} paradigm. It has 1) a detection model for target localization and 2) an appearance embedding model for data association. Having the two models…

Computer Vision and Pattern Recognition · Computer Science 2020-07-15 Zhongdao Wang , Liang Zheng , Yixuan Liu , Yali Li , Shengjin Wang

The finite element simulation of dynamic wetting phenomena, requiring the computation of flow in a domain confined by intersecting a liquid-fluid free surface and a liquid-solid interface, with the three-phase contact line moving across the…

Computational Physics · Physics 2012-02-20 J. E. Sprittles , Y. D. Shikhmurzaev

This paper presents new state-of-the-art models for three tasks, part-of-speech tagging, syntactic parsing, and semantic parsing, using the cutting-edge contextualized embedding framework known as BERT. For each task, we first replicate and…

Computation and Language · Computer Science 2020-05-26 Han He , Jinho D. Choi

The Finite Element Method (FEM) is a powerful modeling tool for predicting soft robots' behavior, but its computation time can limit practical applications. In this paper, a learning-based approach based on condensation of the FEM model is…

Gait patterns play a critical role in human identification and healthcare analytics, yet current progress remains constrained by small, narrowly designed models that fail to scale or generalize. Building a unified gait foundation model…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Dingqiang Ye , Chao Fan , Kartik Narayan , Bingzhe Wu , Chengwen Luo , Jianqiang Li , Vishal M. Patel

Foundation models have gained growing interest in the IoT domain due to their reduced reliance on labeled data and strong generalizability across tasks, which address key limitations of traditional machine learning approaches. However, most…

Machine Learning · Computer Science 2025-10-10 Hui Wei , Dong Yoon Lee , Shubham Rohal , Zhizhang Hu , Ryan Rossi , Shiwei Fang , Shijia Pan

When we are primarily interested in solving several problems jointly with a given prescribed high performance accuracy for each target application, then Foundation Models should for most cases be used rather than problem-specific models. We…

Computer Vision and Pattern Recognition · Computer Science 2024-06-27 Nikolaos Dionelis , Casper Fibaek , Luke Camilleri , Andreas Luyts , Jente Bosmans , Bertrand Le Saux

Although feature models are widely used in practice, for example, representing variability in software product lines, their integration is still a challenge. Many integration techniques have been proposed, although none of these have proven…

Software Engineering · Computer Science 2018-10-01 Vinicius Bischoff

The electrocardiogram (ECG) is a cost-effective, highly accessible and widely employed diagnostic tool. With the advent of Foundation Models (FMs), the field of AI-assisted ECG interpretation has begun to evolve, as they enable model reuse…

Artificial Intelligence · Computer Science 2026-01-30 Francesca Filice , Edoardo De Rose , Simone Bartucci , Francesco Calimeri , Simona Perri

Recent progress in self-supervision shows that pre-training large neural networks on vast amounts of unsupervised data can lead to impressive increases in generalisation for downstream tasks. Such models, recently coined as foundation…

Gait recognition under multiple views is an important computer vision and pattern recognition task. In the emerging convolutional neural network based approaches, the information of view angle is ignored to some extent. Instead of direct…

Computer Vision and Pattern Recognition · Computer Science 2021-08-13 Tianrui Chai , Xinyu Mei , Annan Li , Yunhong Wang

Embedding models have been an effective learning paradigm for high-dimensional data. However, one open issue of embedding models is that their representations (latent factors) often result in large parameter space. We observe that existing…

Machine Learning · Computer Science 2021-12-15 Xupeng Miao , Hailin Zhang , Yining Shi , Xiaonan Nie , Zhi Yang , Yangyu Tao , Bin Cui