English
Related papers

Related papers: Pre-Filtering Code Suggestions using Developer Beh…

200 papers

Large language models (LLMs) are increasingly used in natural language processing tasks. Recommender systems traditionally use methods such as collaborative filtering and matrix factorization, as well as advanced techniques like deep…

Information Retrieval · Computer Science 2024-09-13 Makbule Gulcin Ozsoy

Large Language Models (LLMs) have demonstrated exceptional capabilities in generalizing to new tasks in a zero-shot or few-shot manner. However, the extent to which LLMs can comprehend user preferences based on their previous behavior…

Information Retrieval · Computer Science 2023-05-12 Wang-Cheng Kang , Jianmo Ni , Nikhil Mehta , Maheswaran Sathiamoorthy , Lichan Hong , Ed Chi , Derek Zhiyuan Cheng

Evaluation of large language model (LLM) outputs requires users to make critical judgments about the best outputs across various configurations. This process is costly and takes time given the large amounts of data. LLMs are increasingly…

Data profiling is critical in machine learning for generating descriptive statistics, supporting both deeper understanding and downstream tasks like data valuation and curation. This work addresses profiling specifically in the context of…

Software Engineering · Computer Science 2025-03-21 Pankaj Thorat , Adnan Qidwai , Adrija Dhar , Aishwariya Chakraborty , Anand Eswaran , Hima Patel , Praveen Jayachandran

The rapid advancements in large language models (LLMs) have greatly expanded the potential for automated code-related tasks. Two primary methodologies are used in this domain: prompt engineering and fine-tuning. Prompt engineering involves…

Software Engineering · Computer Science 2025-02-21 Jiho Shin , Clark Tang , Tahmineh Mohati , Maleknaz Nayebi , Song Wang , Hadi Hemmati

Recent advances in Large Language Models (LLMs) and Vision-Language Models (VLMs) have enabled powerful semantic and multimodal reasoning capabilities, creating new opportunities to enhance sample efficiency, high-level planning, and…

Machine Learning · Computer Science 2026-02-03 Elad Sharony , Tom Jurgenson , Orr Krupnik , Dotan Di Castro , Shie Mannor

Natural language to code generation is an important application area of LLMs and has received wide attention from the community. The majority of relevant studies have exclusively concentrated on increasing the quantity and functional…

Machine Learning · Computer Science 2023-11-28 Naman Jain , Tianjun Zhang , Wei-Lin Chiang , Joseph E. Gonzalez , Koushik Sen , Ion Stoica

LLM discovery and optimization systems are increasingly applied across domains, implementing a common propose-evaluate-revise loop. Such optimization or discovery progresses via context conditioning on received feedback from an environment.…

Artificial Intelligence · Computer Science 2026-05-20 Dmitry Redko , Albert Fazlyev , Konstantin Sozykin , Maria Ivanova , Evgeny Burnaev , Egor Shvetsov

This study evaluates the efficiency of code generation by Large Language Models (LLMs) and measures their performance against human-crafted solutions using a dataset from Leetcode. We compare 18 LLMs, considering factors such as model…

Software Engineering · Computer Science 2024-08-01 Tristan Coignion , Clément Quinton , Romain Rouvoy

Personalized algorithms can inadvertently expose users to discomforting recommendations, potentially triggering negative consequences. The subjectivity of discomfort and the black-box nature of these algorithms make it challenging to…

Information Retrieval · Computer Science 2025-01-24 Jiahao Liu , Yiyang Shao , Peng Zhang , Dongsheng Li , Hansu Gu , Chao Chen , Longzhi Du , Tun Lu , Ning Gu

Prompting large language models has gained immense popularity in recent years due to the advantage of producing good results even without the need for labelled data. However, this requires prompt tuning to get optimal prompts that lead to…

Computation and Language · Computer Science 2024-03-06 Jacob-Junqi Tian , David Emerson , Sevil Zanjani Miyandoab , Deval Pandya , Laleh Seyyed-Kalantari , Faiza Khan Khattak

Large language models are trained in two stages: (1) unsupervised pretraining from raw text, to learn general-purpose representations, and (2) large scale instruction tuning and reinforcement learning, to better align to end tasks and user…

Computation and Language · Computer Science 2023-05-22 Chunting Zhou , Pengfei Liu , Puxin Xu , Srini Iyer , Jiao Sun , Yuning Mao , Xuezhe Ma , Avia Efrat , Ping Yu , Lili Yu , Susan Zhang , Gargi Ghosh , Mike Lewis , Luke Zettlemoyer , Omer Levy

Latent Action Models (LAMs) have rapidly gained traction as an important component in the pre-training pipelines of leading Vision-Language-Action models. However, they fail when observations contain action-correlated distractors, often…

Algorithm selection, a critical process of automated machine learning, aims to identify the most suitable algorithm for solving a specific problem prior to execution. Mainstream algorithm selection techniques heavily rely on problem…

Machine Learning · Computer Science 2024-05-17 Xingyu Wu , Yan Zhong , Jibin Wu , Bingbing Jiang , Kay Chen Tan

Compared with Large Language Models (LLMs), Large Vision-Language Models (LVLMs) can also accept images as input, thus showcasing more interesting emergent capabilities and demonstrating impressive performance on various vision-language…

Computer Vision and Pattern Recognition · Computer Science 2024-09-26 Runpeng Yu , Weihao Yu , Xinchao Wang

Large language model (LLM)-based coding assistants have made substantial progress, yet most systems remain reactive, requiring developers to explicitly formulate their needs. Proactive coding assistants aim to infer latent developer intent…

Software Engineering · Computer Science 2026-05-08 Lehui Li , Ruixuan Jia , Guo-Ye Yang , Jia Li

The advent of Large Language Models (LLMs) has significantly advanced the field of automated code generation. LLMs rely on large and diverse datasets to learn syntax, semantics, and usage patterns of programming languages. For low-resource…

Software Engineering · Computer Science 2025-02-03 Alessandro Giagnorio , Alberto Martin-Lopez , Gabriele Bavota

Previous learning-based vulnerability detection methods relied on either medium-sized pre-trained models or smaller neural networks from scratch. Recent advancements in Large Pre-Trained Language Models (LLMs) have showcased remarkable…

Software Engineering · Computer Science 2024-01-30 Xin Zhou , Ting Zhang , David Lo

Large language models (LLMs) has experienced exponential growth, they demonstrate remarkable performance across various tasks. Notwithstanding, contemporary research primarily centers on enhancing the size and quality of pretraining data,…

Programming Languages · Computer Science 2024-04-16 Mengnan Qi , Yufan Huang , Yongqiang Yao , Maoquan Wang , Bin Gu , Neel Sundaresan

The observed similarities in the behavior of humans and Large Language Models (LLMs) have prompted researchers to consider the potential of using LLMs as models of human cognition. However, several significant challenges must be addressed…

Artificial Intelligence · Computer Science 2025-05-07 Jian-Qiao Zhu , Haijiang Yan , Thomas L. Griffiths