English
Related papers

Related papers: Keys in the Weights: Transformer Authentication Us…

200 papers

In 5G wireless communication, Intelligent Transportation Systems (ITS) and automobile applications, such as autonomous driving, are widely examined. These applications have strict requirements and often require high Quality of Service…

Networking and Internet Architecture · Computer Science 2023-02-24 Donglin Wang , Anjie Qiu , Sanket Partani , Qiuheng Zhou , Hans D. Schotten

In computer vision applications, such as domain adaptation (DA), few shot learning (FSL) and zero-shot learning (ZSL), we encounter new objects and environments, for which insufficient examples exist to allow for training "models from…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Pengkai Zhu , Hanxiao Wang , Venkatesh Saligrama

Transformer models have recently achieved impressive performance on NLP tasks, owing to new algorithms for self-supervised pre-training on very large text corpora. In contrast, recent literature suggests that simple average word models…

Computer Vision and Pattern Recognition · Computer Science 2020-05-19 Muhammet Bastan , Arnau Ramisa , Mehmet Tek

Multimodal language models (MLMs) integrate visual and textual information by coupling a vision encoder with a large language model through the specific adapter. While existing approaches commonly rely on a single pre-trained vision…

Computer Vision and Pattern Recognition · Computer Science 2025-02-24 Matvey Skripkin , Elizaveta Goncharova , Dmitrii Tarasov , Andrey Kuznetsov

Transformer-based models have delivered impressive results on many tasks, particularly vision and language tasks. In many model training situations, conventional configurations are typically adopted. For example, we often set the base model…

Machine Learning · Computer Science 2023-05-19 Fuzhao Xue , Jianghai Chen , Aixin Sun , Xiaozhe Ren , Zangwei Zheng , Xiaoxin He , Yongming Chen , Xin Jiang , Yang You

To successfully apply trained neural network models to new domains, powerful transfer learning solutions are essential. We propose to introduce a novel cross-domain latent modulation mechanism to a variational autoencoder framework so as to…

Machine Learning · Computer Science 2024-02-01 Jinyong Hou , Jeremiah D. Deng , Stephen Cranefield , Xuejie Din

Zero-shot learning (ZSL) is a challenging task aiming at recognizing novel classes without any training instances. In this paper we present a simple but high-performance ZSL approach by generating pseudo feature representations (GPFR).…

Computer Vision and Pattern Recognition · Computer Science 2018-09-11 Jiang Lu , Jin Li , Ziang Yan , Changshui Zhang

The need to address the scarcity of task-specific annotated data has resulted in concerted efforts in recent years for specific settings such as zero-shot learning (ZSL) and domain generalization (DG), to separately address the issues of…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Shivam Chandhok , Sanath Narayan , Hisham Cholakkal , Rao Muhammad Anwer , Vineeth N Balasubramanian , Fahad Shahbaz Khan , Ling Shao

The relentless pursuit of miniaturization and performance enhancement in electronic devices has led to a fundamental challenge in the field of circuit design and simulation: how to accurately account for the inherent stochastic nature of…

Machine Learning · Computer Science 2023-11-13 Jack Hutchins , Shamiul Alam , Dana S. Rampini , Bakhrom G. Oripov , Adam N. McCaughan , Ahmedullah Aziz

Due to the lack of properly annotated medical data, exploring the generalization capability of the deep model is becoming a public concern. Zero-shot learning (ZSL) has emerged in recent years to equip the deep model with the ability to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Cheng Bian , Chenglang Yuan , Kai Ma , Shuang Yu , Dong Wei , Yefeng Zheng

We posit that handwriting recognition benefits from complementary cues carried by the rasterized complex glyph and the pen's trajectory, yet most systems exploit only one modality. We introduce an end-to-end network that performs early…

Computer Vision and Pattern Recognition · Computer Science 2025-06-26 Ayush Lodh , Ritabrata Chakraborty , Shivakumara Palaiahnakote , Umapada Pal

Zero-shot learning (ZL) is crucial for tasks involving unseen categories, such as natural language processing, image classification, and cross-lingual transfer.Current applications often fail to accurately infer and handle new relations…

Artificial Intelligence · Computer Science 2025-04-08 Bingchen Liu , Jingchen Li , Yuanyuan Fang , Xin Li

Fine-grained object recognition that aims to identify the type of an object among a large number of subcategories is an emerging application with the increasing resolution that exposes new details in image data. Traditional fully supervised…

Computer Vision and Pattern Recognition · Computer Science 2017-12-12 Gencer Sumbul , Ramazan Gokberk Cinbis , Selim Aksoy

We propose a comprehensive end-to-end pipeline for Twitter hashtags recommendation system including data collection, supervised training setting and zero shot training setting. In the supervised training setting, we have proposed and…

Information Retrieval · Computer Science 2019-06-13 Abhay Kumar , Nishant Jain , Suraj Tripathi , Chirag Singh

The proliferation of zero-day threats (ZDTs) to companies' networks has been immensely costly and requires novel methods to scan traffic for malicious behavior at massive scale. The diverse nature of normal behavior along with the huge…

Network embedding aims at projecting the network data into a low-dimensional feature space, where the nodes are represented as a unique feature vector and network structure can be effectively preserved. In recent years, more and more online…

Social and Information Networks · Computer Science 2017-11-28 Jiawei Zhang , Congying Xia , Chenwei Zhang , Limeng Cui , Yanjie Fu , Philip S. Yu

The Transformer architecture is shown to provide a powerful framework as an end-to-end model for building expression trees from online handwritten gestures corresponding to glyph strokes. In particular, the attention mechanism was…

Computation and Language · Computer Science 2022-11-07 Mirco Ramo , Guénolé C. M. Silvestre

In this paper, we try to understand neural machine translation (NMT) via simplifying NMT architectures and training encoder-free NMT models. In an encoder-free model, the sums of word embeddings and positional embeddings represent the…

Computation and Language · Computer Science 2019-07-19 Gongbo Tang , Rico Sennrich , Joakim Nivre

Transformer-based models have achieved strong performance in remote sensing image captioning by capturing long-range dependencies and contextual information. However, their practical deployment is hindered by high computational costs,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Swadhin Das , Divyansh Mundra , Priyanshu Dayal , Raksha Sharma

Molecular generative models often assume meaningful latent geometry, but apparent property predictability can reflect sequence-level shortcuts rather than chemical organization. We study this issue in an unsupervised autoregressive…

Machine Learning · Computer Science 2026-05-08 Zakaria Elabid , Jan Andrzejewski , Bartosz Brzoza , Attila Cangi