中文
相关论文

相关论文: AutoSDT: Scaling Data-Driven Discovery Tasks Towar…

200 篇论文

We introduce DS-1000, a code generation benchmark with a thousand data science problems spanning seven Python libraries, such as NumPy and Pandas. Compared to prior works, DS-1000 incorporates three core features. First, our problems…

LLM-based agents have shown promising capabilities in a growing range of software engineering (SWE) tasks. However, advancing this field faces two critical challenges. First, high-quality training data is scarce, especially data that…

Designing heuristics for combinatorial optimization problems (COPs) is a fundamental yet challenging task that traditionally requires extensive domain expertise. Recently, Large Language Model (LLM)-based Automated Heuristic Design (AHD)…

人工智能 · 计算机科学 2026-04-28 Bin Chen , Shouliang Zhu , Beidan Liu , Yong Zhao , Tianle Pu , Huichun Li , Zhengqiu Zhu

We introduce LeetCodeDataset, a high-quality benchmark for evaluating and training code-generation models, addressing two key challenges in LLM research: the lack of reasoning-focused coding benchmarks and self-contained training testbeds.…

机器学习 · 计算机科学 2025-04-22 Yunhui Xia , Wei Shen , Yan Wang , Jason Klein Liu , Huifeng Sun , Siyue Wu , Jian Hu , Xiaolong Xu

Since language models (LMs) now outperform average humans on many challenging tasks, it has become increasingly difficult to develop challenging, high-quality, and realistic evaluations. We address this issue by examining LMs' capabilities…

While a lot of recent research focuses on enhancing the textual reasoning capabilities of Large Language Models (LLMs) by optimizing the multi-agent framework or reasoning chains, several benchmark tasks can be solved with 100\% success…

计算与语言 · 计算机科学 2025-03-04 Yongchao Chen , Harsh Jhamtani , Srinagesh Sharma , Chuchu Fan , Chi Wang

We present SuperCoder2.0, an advanced autonomous system designed to enhance software development through artificial intelligence. The system combines an AI-native development approach with intelligent agents to enable fully autonomous…

软件工程 · 计算机科学 2024-10-29 Anmol Gautam , Kishore Kumar , Adarsh Jha , Mukunda NS , Ishaan Bhola

As AI promises to accelerate scientific discovery, it remains unclear whether fully AI-driven research is possible and whether it can adhere to key scientific values, such as transparency, traceability and verifiability. Mimicking human…

其他定量生物学 · 定量生物学 2024-04-30 Tal Ifargan , Lukas Hafner , Maor Kern , Ori Alcalay , Roy Kishony

Robot design is a complex and time-consuming process that requires specialized expertise. Gaining a deeper understanding of robot design data can enable various applications, including automated design generation, retrieving example designs…

机器人学 · 计算机科学 2025-03-11 Tri Le , Toan Nguyen , Quang Tran , Quang Nguyen , Baoru Huang , Hoan Nguyen , Minh Nhat Vu , Tung D. Ta , Anh Nguyen

In recent years, we have witnessed the growing interest from academia and industry in applying data science technologies to analyze large amounts of data. In this process, a myriad of artifacts (datasets, pipeline scripts, etc.) are…

Data science plays a critical role in transforming complex data into actionable insights across numerous domains. Recent developments in large language models (LLMs) and artificial intelligence (AI) agents have significantly automated data…

This paper describes the system submitted by team \textbf{Archaeology} to SemEval-2026 Task~13 on AI-generated code detection. The shared task consists of three subtasks; we participate in Subtask-A (binary classification: human-written…

计算与语言 · 计算机科学 2026-05-05 Jany-Gabriel Ispas , Sergiu Nisioi

Pre-trained on massive amounts of code and text data, large language models (LLMs) have demonstrated remarkable achievements in performing code generation tasks. With additional execution-based feedback, these models can act as agents with…

计算与语言 · 计算机科学 2024-11-14 Jierui Li , Hung Le , Yingbo Zhou , Caiming Xiong , Silvio Savarese , Doyen Sahoo

Large Language Models have revolutionized code generation ability by converting natural language descriptions into executable code. However, generating complex code within real-world scenarios remains challenging due to intricate…

软件工程 · 计算机科学 2024-10-15 Xinyi He , Jiaru Zou , Yun Lin , Mengyu Zhou , Shi Han , Zejian Yuan , Dongmei Zhang

Recent advances in machine learning have significantly improved the understanding of source code data and achieved good performance on a number of downstream tasks. Open source repositories like GitHub enable this process with rich…

软件工程 · 计算机科学 2022-06-20 Ming Zhu , Aneesh Jain , Karthik Suresh , Roshan Ravindran , Sindhu Tipirneni , Chandan K. Reddy

The ability to automatically generate accurate protocols for scientific experiments would represent a major step towards the automation of science. Large Language Models (LLMs) have impressive capabilities on a wide range of tasks, such as…

Autonomous driving techniques have been flourishing in recent years while thirsting for huge amounts of high-quality data. However, it is difficult for real-world datasets to keep up with the pace of changing requirements due to their…

图像与视频处理 · 电气工程与系统科学 2024-02-29 Zhihang Song , Zimin He , Xingyu Li , Qiming Ma , Ruibo Ming , Zhiqi Mao , Huaxin Pei , Lihui Peng , Jianming Hu , Danya Yao , Yi Zhang

Recent advances in code large language models (CodeLLMs) have made them indispensable tools in modern software engineering. However, these models occasionally produce outputs that contain proprietary or sensitive code snippets, raising…

软件工程 · 计算机科学 2025-07-24 Tianlin Li , Yunxiang Wei , Zhiming Li , Aishan Liu , Qing Guo , Xianglong Liu , Dongning Sun , Yang Liu

Unlike human daily activities, existing publicly available sensor datasets for work activity recognition in industrial domains are limited by difficulties in collecting realistic data as close collaboration with industrial sites is…

计算机视觉与模式识别 · 计算机科学 2024-04-23 Naoya Yoshimura , Jaime Morales , Takuya Maekawa , Takahiro Hara

Domain reweighting is an emerging research area aimed at adjusting the relative weights of different data sources to improve the effectiveness and efficiency of LLM pre-training. We show that data mixtures that perform well at smaller…

机器学习 · 计算机科学 2025-10-03 Feiyang Kang , Yifan Sun , Bingbing Wen , Si Chen , Dawn Song , Rafid Mahmood , Ruoxi Jia