English
Related papers

Related papers: Learning Where to Embed: Noise-Aware Positional Em…

200 papers

Knowledge graph embedding, which aims to represent entities and relations as low dimensional vectors (or matrices, tensors, etc.), has been shown to be a powerful technique for predicting missing links in knowledge graphs. Existing…

Machine Learning · Computer Science 2022-04-07 Zhanqiu Zhang , Jianyu Cai , Yongdong Zhang , Jie Wang

Object detection models demand large-scale annotated datasets, which are costly and labor-intensive to create. This motivated Imaginary Supervised Object Detection (ISOD), where models train on synthetic images and test on real images.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Zhiyuan Chen , Yuelin Guo , Zitong Huang , Haoyu He , Renhao Lu , Weizhe Zhang

Transformer models are permutation equivariant. To supply the order and type information of the input tokens, position and segment embeddings are usually added to the input. Recent works proposed variations of positional encodings with…

Computation and Language · Computer Science 2021-11-04 Pu-Chin Chen , Henry Tsai , Srinadh Bhojanapalli , Hyung Won Chung , Yin-Wen Chang , Chun-Sung Ferng

Unsupervised dimensionality reduction is one of the commonly used techniques in the field of high dimensional data recognition problems. The deep autoencoder network which constrains the weights to be non-negative, can learn a low…

Computer Vision and Pattern Recognition · Computer Science 2020-09-18 Anyong Qin , Zhaowei Shang , Zhuolin Tan , Taiping Zhang , Yuan Yan Tang

Hyperspectral image (HSI) classification (HSIC) requires effective modeling of complex spatial-spectral dependencies under limited labeled data and high dimensionality. While transformer-based models have shown strong capability in…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Muhammad Ahmad

Ultrasound denoising is essential for mitigating speckle-induced degradations, thereby enhancing image quality and improving diagnostic reliability. Nevertheless, because speckle patterns inherently encode both texture and fine anatomical…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Zhenyu Bu , Yuanxin Xie , Guang-Quan Zhou

Human pose estimation (HPE) has attracted a significant amount of attention from the computer vision community in the past decades. Moreover, HPE has been applied to various domains, such as human-computer interaction, sports analysis, and…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Gongjin Lan , Yu Wu , Fei Hu , Qi Hao

Visual Grounding aims to localize the referring object in an image given a natural language expression. Recent advancements in DETR-based visual grounding methods have attracted considerable attention, as they directly predict the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Yabing Wang , Zhuotao Tian , Qingpei Guo , Zheng Qin , Sanping Zhou , Ming Yang , Le Wang

Auto-regressive neural sequence models have been shown to be effective across text generation tasks. However, their left-to-right decoding order prevents generation from being parallelized. Insertion Transformer (Stern et al., 2019) is an…

Computation and Language · Computer Science 2023-02-01 Zhisong Zhang , Yizhe Zhang , Bill Dolan

Manifold learning now plays a very important role in machine learning and many relevant applications. Although its superior performance in dealing with nonlinear data distribution, data sparsity is always a thorny knot. There are few…

Machine Learning · Computer Science 2019-09-17 Shenglan Liu , Yang Yu , Yang Liu , Hong Qiao , Lin Feng , Jiashi Feng

The main challenge for small object detection algorithms is to ensure accuracy while pursuing real-time performance. The RT-DETR model performs well in real-time object detection, but performs poorly in small object detection accuracy. In…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Ji Huang , Hui Wang

Image-text retrieval has developed rapidly in recent years. However, it is still a challenge in remote sensing due to visual-semantic imbalance, which leads to incorrect matching of non-semantic visual and textual features. To solve this…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Qing Ma , Jiancheng Pan , Cong Bai

Purpose: Drop-in gamma probes are widely used in robotic-assisted minimally invasive surgery (RAMIS) for lymph node detection. However, these devices only provide audio feedback on signal intensity, lacking the visual feedback necessary for…

Image and Video Processing · Electrical Eng. & Systems 2024-10-31 Songyu Xu , Yicheng Hu , Jionglong Su , Daniel Elson , Baoru Huang

The field of computer vision has experienced significant advancements through scalable vision encoders and multimodal pre-training frameworks. However, existing approaches often treat vision encoders and large language models (LLMs) as…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Eugene Lee , Ting-Yu Chang , Jui-Huang Tsai , Jiajie Diao , Chen-Yi Lee

Next-generation particle accelerators demand advanced beam-diagnostic capabilities to ensure high performance, operational reliability, and sustainable machine operation. Increasing beam intensities and stored energies make the precise…

Accelerator Physics · Physics 2026-03-10 Francis René Osswald , Mohammed Chahbaoui , Xinyi Liang

The existing crowd counting methods usually adopted attention mechanism to tackle background noise, or applied multi-level features or multi-scales context fusion to tackle scale variation. However, these approaches deal with these two…

Computer Vision and Pattern Recognition · Computer Science 2021-06-07 Fusen Wang , Jun Sang , Zhongyuan Wu , Qi Liu , Nong Sang

The dissection of hyperspectral images into intrinsic components through hyperspectral intrinsic image decomposition (HIID) enhances the interpretability of hyperspectral data, providing a foundation for more accurate classification…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Zhiqiang Gong , Xian Zhou , Wen Yao , Xiaohu Zheng , Ping Zhong

Autoregressive decoding with generative Large Language Models (LLMs) on accelerators (GPUs/TPUs) is often memory-bound where most of the time is spent on transferring model parameters from high bandwidth memory (HBM) to cache. On the other…

Machine Learning · Computer Science 2024-02-15 Yashas Samaga B L , Varun Yerram , Chong You , Srinadh Bhojanapalli , Sanjiv Kumar , Prateek Jain , Praneeth Netrapalli

Learning embeddings that are invariant to the pose of the object is crucial in visual image retrieval and re-identification. The existing approaches for person, vehicle, or animal re-identification tasks suffer from high intra-class…

Computer Vision and Pattern Recognition · Computer Science 2020-08-27 Olga Moskvyak , Frederic Maire , Feras Dayoub , Mahsa Baktashmotlagh

Discovering hidden physical laws and identifying governing system parameters from sparse observations are central challenges in computational science and engineering. Existing data-driven methods, such as physics-informed neural networks…

Machine Learning · Computer Science 2026-04-16 Dibakar Roy Sarkar , Vijay Kag , Birupaksha Pal , Somdatta Goswami