English
Related papers

Related papers: A Low Dimensionality Representation for Language V…

200 papers

To better select the correct training sample and obtain the robust representation of the query sample, this paper proposes a discriminant-based sparse optimization learning model. This learning model integrates discriminant and sparsity…

Computer Vision and Pattern Recognition · Computer Science 2017-12-06 Qingxiang Feng , Yicong Zhou

Vector Quantization (VQ) is an appealing model compression method to obtain a tiny model with less accuracy loss. While methods to obtain better codebooks and codes under fixed clustering dimensionality have been extensively studied,…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Zezhou Zhu , Yucong Zhou , Zhao Zhong

Approaches for compressing large-language models using low-rank decomposition have made strides, particularly with the introduction of activation and loss-aware SVD, which improves the trade-off between decomposition rank and downstream…

Machine Learning · Computer Science 2025-12-17 Sidhant Sundrani , Francesco Tudisco , Pasquale Minervini

Recent advances in foundation models present new opportunities for interpretable visual recognition -- one can first query Large Language Models (LLMs) to obtain a set of attributes that describe each class, then apply vision-language…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 An Yan , Yu Wang , Yiwu Zhong , Chengyu Dong , Zexue He , Yujie Lu , William Wang , Jingbo Shang , Julian McAuley

Generating diverse responses from large language models (LLMs) is crucial for applications such as planning/search and synthetic data generation, where diversity provides distinct answers across generations. Prior approaches rely on…

Computation and Language · Computer Science 2024-10-15 Justin Wong , Yury Orlovskiy , Michael Luo , Sanjit A. Seshia , Joseph E. Gonzalez

Convolutional Dictionary Learning (CDL) has emerged as a powerful approach for signal representation by learning translation-invariant features through convolution operations. While existing CDL methods are predominantly designed and used…

Signal Processing · Electrical Eng. & Systems 2025-05-22 Hao Chen , Dayuan Tan

Current multilingual vision-language models either require a large number of additional parameters for each supported language, or suffer performance degradation as languages are added. In this paper, we propose a Scalable Multilingual…

Computer Vision and Pattern Recognition · Computer Science 2020-08-31 Andrea Burns , Donghyun Kim , Derry Wijaya , Kate Saenko , Bryan A. Plummer

In human-level NLP tasks, such as predicting mental health, personality, or demographics, the number of observations is often smaller than the standard 768+ hidden state sizes of each layer within modern transformer-based language models,…

Computation and Language · Computer Science 2023-06-05 Adithya V Ganesan , Matthew Matero , Aravind Reddy Ravula , Huy Vu , H. Andrew Schwartz

Low rank tensor representation (LRTR) methods are very useful for hyperspectral anomaly detection (HAD). To overcome the limitations that they often overlook spectral anomaly and rely on large-scale matrix singular value decomposition, we…

Computer Vision and Pattern Recognition · Computer Science 2025-03-10 Quan Yu , Yu-Hong Dai , Minru Bai

This paper proposes a powerful Visual Speech Recognition (VSR) method for multiple languages, especially for low-resource languages that have a limited number of labeled data. Different from previous methods that tried to improve the VSR…

Computer Vision and Pattern Recognition · Computer Science 2024-01-15 Jeong Hun Yeo , Minsu Kim , Shinji Watanabe , Yong Man Ro

Low-resource languages (LRLs) lack sufficient linguistic resources and are underrepresented in benchmark datasets, resulting in persistently lower translation quality than high-resource languages, especially in privacy-sensitive and…

Computation and Language · Computer Science 2025-08-25 Yewei Song , Lujun Li , Cedric Lothritz , Saad Ezzini , Lama Sleem , Niccolo Gentile , Radu State , Tegawendé F. Bissyandé , Jacques Klein

The field of cross-lingual sentence embeddings has recently experienced significant advancements, but research concerning low-resource languages has lagged due to the scarcity of parallel corpora. This paper shows that cross-lingual word…

Computation and Language · Computer Science 2024-04-04 Zhongtao Miao , Qiyu Wu , Kaiyan Zhao , Zilong Wu , Yoshimasa Tsuruoka

This paper discusses the critical decision process of extracting or selecting the features in a supervised learning context. It is often confusing to find a suitable method to reduce dimensionality. There are pros and cons to deciding…

Machine Learning · Computer Science 2022-06-22 Jean-Sébastien Dessureault , Daniel Massicotte

Large Language Models (LLMs) are increasingly integrated into users' daily lives, driving a growing demand for personalized outputs. Prior work has primarily leveraged a user's own history, often overlooking inter-user differences that are…

Information Retrieval · Computer Science 2025-11-20 Suyu Chen , Yimeng Bai , Yulong Huang , Xiaoyan Zhao , Yang Zhang

Learning expressive low-dimensional representations of ultrahigh-dimensional data, e.g., data with thousands/millions of features, has been a major way to enable learning methods to address the curse of dimensionality. However, existing…

Machine Learning · Computer Science 2018-06-14 Guansong Pang , Longbing Cao , Ling Chen , Huan Liu

Recognition of low resolution face images is a challenging problem in many practical face recognition systems. Methods have been proposed in the face recognition literature for the problem which assume that the probe is low resolution, but…

Computer Vision and Pattern Recognition · Computer Science 2017-07-11 Sumit Shekhar , Vishal M. Patel , Rama Chellappa

Language barriers affect 27.3 million U.S. residents with non-English language preference, yet professional medical translation remains costly and often unavailable. We evaluated four frontier large language models (GPT-5.1, Claude Opus…

In sentiment classification, the enormous amount of textual data, its immense dimensionality, and inherent noise make it extremely difficult for machine learning classifiers to extract high-level and complex abstractions. In order to make…

Information Retrieval · Computer Science 2020-06-09 Aftab Anjum , Mazharul Islam , Lin Wang

The sparse dictionary coding framework represents signals as a linear combination of a few predefined dictionary atoms. It has been employed for images, time series, graph signals and recently for 2-way (or 2D) spatio-temporal data…

Machine Learning · Computer Science 2024-06-12 Boya Ma , Maxwell McNeil , Abram Magner , Petko Bogdanov

Large Language Models (LLMs) are increasingly being studied for Software Vulnerability Detection (SVD) and Repair (SVR). Individual LLMs have demonstrated code understanding abilities, but they frequently struggle when identifying complex…

Software Engineering · Computer Science 2025-12-16 Arastoo Zibaeirad , Marco Vieira