English
Related papers

Related papers: Combatting Dimensional Collapse in LLM Pre-Trainin…

200 papers

In this research. we analyze the potential of Feature Density (HD) as a way to comparatively estimate machine learning (ML) classifier performance prior to training. The goal of the study is to aid in solving the problem of…

Computation and Language · Computer Science 2022-06-07 Juuso Eronen , Michal Ptaszynski , Fumito Masui , Gniewosz Leliwa , Michal Wroczynski

The boom of DL technology leads to massive DL models built and shared, which facilitates the acquisition and reuse of DL models. For a given task, we encounter multiple DL models available with the same functionality, which are considered…

Software Engineering · Computer Science 2021-03-10 Linghan Meng , Yanhui Li , Lin Chen , Zhi Wang , Di Wu , Yuming Zhou , Baowen Xu

Feature selection has evolved to be an important step in several machine learning paradigms. In domains like bio-informatics and text classification which involve data of high dimensions, feature selection can help in drastically reducing…

Machine Learning · Computer Science 2019-04-23 Nand Sharma , Prathamesh Verlekar , Rehab Ashary , Sui Zhiquan

Along with the flourish of the information age, massive amounts of data are generated day by day. Due to the large-scale and high-dimensional characteristics of these data, it is often difficult to achieve better decision-making in…

Machine Learning · Computer Science 2023-04-04 Peican Zhu , Xin Hou , Keke Tang , Zhen Wang , Feiping Nie

Optimization methods are widely employed in deep learning to identify and mitigate undesired model responses. While gradient-based techniques have proven effective for image models, their application to language models is hindered by the…

Machine Learning · Computer Science 2025-02-18 Zi Wang , Divyam Anshumaan , Ashish Hooda , Yudong Chen , Somesh Jha

Dimensionality reduction (DR) plays a vital role in the visual analysis of high-dimensional data. One main aim of DR is to reveal hidden patterns that lie on intrinsic low-dimensional manifolds. However, DR often overlooks important…

Machine Learning · Computer Science 2023-02-28 Takanori Fujiwara , Yun-Hsin Kuo , Anders Ynnerman , Kwan-Liu Ma

Large language models have driven significant progress in natural language processing, but their deployment requires substantial compute and memory resources. As models scale, compression techniques become essential for balancing model…

Machine Learning · Computer Science 2025-05-13 Vithursan Thangarasa , Ganesh Venkatesh , Mike Lasby , Nish Sinnadurai , Sean Lie

In modern LLMs, linguistic features function not as stylistic artifacts but as probes of probability mass, allocated under training alignment objectives. Language models trained with contemporary pipelines exhibit severe reshaping of…

Computation and Language · Computer Science 2026-05-29 Rohan Mahapatra

Feature selection involes identifying the most relevant subset of input features, with a view to improving generalization of predictive models by reducing overfitting. Directly searching for the most relevant combination of attributes is…

Machine Learning · Computer Science 2014-10-28 Jayadeva , Sanjit S. Batra , Siddharth Sabharwal

Self-evolving reasoning frameworks let LLMs improve their reasoning capabilities by iteratively generating and solving problems without external supervision, using verifiable rewards. Ideally, such systems are expected to explore a diverse…

Machine Learning · Computer Science 2026-03-17 Vaibhav Mishra

In this work, we propose Dimple, the first Discrete Diffusion Multimodal Large Language Model (DMLLM). We observe that training with a purely discrete diffusion approach leads to significant training instability, suboptimal performance, and…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Runpeng Yu , Xinyin Ma , Xinchao Wang

Aiming at improving performance of visual classification in a cost-effective manner, this paper proposes an incremental semi-supervised learning paradigm called Deep Co-Space (DCS). Unlike many conventional semi-supervised learning methods…

Computer Vision and Pattern Recognition · Computer Science 2017-08-01 Ziliang Chen , Keze Wang , Xiao Wang , Pai Peng , Ebroul Izquierdo , Liang Lin

Large Language Models (LLMs) have demonstrated their exceptional performance in various complex code generation tasks. However, their broader adoption is limited by significant computational demands and high resource requirements,…

Machine Learning · Computer Science 2025-01-10 Laura Puccioni , Alireza Farshin , Mariano Scazzariello , Changjie Wang , Marco Chiesa , Dejan Kostic

Large language models (LLMs) alignment aims to ensure that the behavior of LLMs meets human preferences. While collecting data from multiple fine-grained, aspect-specific preferences becomes more and more feasible, existing alignment…

Machine Learning · Computer Science 2026-03-03 Jia Zhang , Yao Liu , Chen-Xi Zhang , Yi Liu , Yi-Xuan Jin , Lan-Zhe Guo , Yu-Feng Li

Data selection in instruction tuning emerges as a pivotal process for acquiring high-quality data and training instruction-following large language models (LLMs), but it is still a new and unexplored research area for vision-language models…

Computation and Language · Computer Science 2024-02-21 Ruibo Chen , Yihan Wu , Lichang Chen , Guodong Liu , Qi He , Tianyi Xiong , Chenxi Liu , Junfeng Guo , Heng Huang

Learning problems in the text processing domain often map the text to a space whose dimensions are the measured features of the text, e.g., its words. Three characteristic properties of this domain are (a) very high dimensionality, (b) both…

cmp-lg · Computer Science 2008-02-03 Ido Dagan , Yael Karov , Dan Roth

As large language models(LLMs) become commonplace in practical applications, the security issues of LLMs have attracted societal concerns. Although extensive efforts have been made to safety alignment, LLMs remain vulnerable to jailbreak…

Computation and Language · Computer Science 2024-09-20 Xu Zhang , Dinghao Jing , Xiaojun Wan

Text ranking is a critical task in information retrieval. Recent advances in pre-trained language models (PLMs), especially large language models (LLMs), present new opportunities for applying them to text ranking. While supervised…

Information Retrieval · Computer Science 2024-06-04 Longhui Zhang , Yanzhao Zhang , Dingkun Long , Pengjun Xie , Meishan Zhang , Min Zhang

Federated Split Learning has been identified as an efficient approach to address the computational resource constraints of clients in classical federated learning, while guaranteeing data privacy for distributed model training across data…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-30 Yimeng Shan , Zhaorui Zhang , Sheng Di , Yu Liu , Xiaoyi Lu , Benben Liu

For green AI, it is crucial to measure and reduce the carbon footprint emitted during the training of large language models. In NLP, performing pre-training on Transformer models requires significant computational resources. This…

Computation and Language · Computer Science 2024-04-30 Sharayu Hiwarkhedkar , Saloni Mittal , Vidula Magdum , Omkar Dhekane , Raviraj Joshi , Geetanjali Kale , Arnav Ladkat
‹ Prev 1 4 5 6 7 8 10 Next ›