English
Related papers

Related papers: Large-Scale Validation of Hypothesis Generation Sy…

200 papers

The widespread adoption of Large Language Models (LLMs) and publicly available ChatGPT have marked a significant turning point in the integration of Artificial Intelligence (AI) into people's everyday lives. This study examines the ability…

Computation and Language · Computer Science 2025-10-28 Sandeep Kumar , Tirthankar Ghosal , Vinayak Goyal , Asif Ekbal

Synthesizing user-intended programs from a small number of input-output examples is a challenging problem with several important applications like spreadsheet manipulation, data wrangling and code refactoring. Existing synthesis systems…

Artificial Intelligence · Computer Science 2018-09-17 Ashwin Kalyan , Abhishek Mohta , Oleksandr Polozov , Dhruv Batra , Prateek Jain , Sumit Gulwani

Hallucinations in Large Language Models (LLMs), defined as the generation of content inconsistent with facts or context, represent a core obstacle to their reliable deployment in critical domains. Current research primarily focuses on…

Computation and Language · Computer Science 2026-03-20 Yanyi Liu , Qingwen Yang , Tiezheng Guo , Feiyu Qu , Jun Liu , Yingyou Wen

Retrieval-augmented generation (RAG) enhances large language models (LLMs) by incorporating external knowledge to generate a response within a context with improved accuracy and reduced hallucinations. However, multi-modal RAG systems face…

Machine Learning · Computer Science 2025-01-09 Matin Mortaheb , Mohammad A. Amir Khojastepour , Srimat T. Chakradhar , Sennur Ulukus

The rise of generative AI, has driven significant advancements in high-risk sectors like healthcare and finance. The Retrieval-Augmented Generation (RAG) architecture, combining language models (LLMs) with search engines, is particularly…

Artificial Intelligence · Computer Science 2025-07-30 Grégoire Martinon , Alexandra Lorenzo de Brionne , Jérôme Bohard , Antoine Lojou , Damien Hervault , Nicolas J-B. Brunel

Synthetic verification techniques such as generating test cases and reward modelling are common ways to enhance the coding capabilities of large language models (LLM) beyond predefined tests. Additionally, code verification has recently…

Artificial Intelligence · Computer Science 2025-07-31 Aleksander Ficek , Somshubra Majumdar , Vahid Noroozi , Boris Ginsburg

Owing to the advancement of deep learning, artificial systems are now rival to humans in several pattern recognition tasks, such as visual recognition of object categories. However, this is only the case with the tasks for which correct…

Machine Learning · Computer Science 2019-06-03 Xing Liu , Takayuki Okatani

Ensuring that code accurately reflects the algorithms and methods described in research papers is critical for maintaining credibility and fostering trust in AI research. This paper presents a novel system designed to verify code…

Software Engineering · Computer Science 2025-02-04 Rajat Keshri , Arun George Zachariah , Michael Boone

Nowadays, the use of synthetic data has gained popularity as a cost-efficient strategy for enhancing data augmentation for improving machine learning models performance as well as addressing concerns related to sensitive data privacy.…

Machine Learning · Computer Science 2025-10-27 Ioannis E. Livieris , Nikos Alimpertis , George Domalis , Dimitris Tsakalidis

Healthcare research and development face significant obstacles due to data scarcity and stringent privacy regulations, such as HIPAA and the GDPR, restricting access to essential real-world medical data. These limitations impede innovation,…

Machine Learning · Computer Science 2025-10-17 Md Ibrahim Shikder Mahin , Md Shamsul Arefin , Md Tanvir Hasan

The allocation of limited resources to a large number of potential candidates presents a pervasive challenge. In the context of ranking and selecting top candidates from heteroscedastic units, conventional methods often result in…

Methodology · Statistics 2023-06-16 Bowen Gang , Luella Fu , Gareth James , Wenguang Sun

Generative recommender systems have recently emerged as a promising paradigm by formulating next-item prediction as an auto-regressive semantic IDs generation, such as OneRec series works. However, with the next-item-agnostic prediction…

Information Retrieval · Computer Science 2026-04-29 Yu Liu , Jiangxia Cao

The rapid expansion of scholarly publications across diverse disciplines has made it increasingly difficult to systematically evaluate how research contributes to the United Nations Sustainable Development Goals (SDGs). Domain…

Digital Libraries · Computer Science 2026-01-27 Sahil Dewani , Kiran Sharma

Numerous applications in biology, statistics, science, and engineering require generating samples from high-dimensional probability distributions. In recent years, the Hamiltonian Monte Carlo (HMC) method has emerged as a state-of-the-art…

Computational Engineering, Finance, and Science · Computer Science 2024-05-09 Dhruv V. Patel , Jonghyun Lee , Matthew W. Farthing , Peter K. Kitanidis , Eric F. Darve

To advance the development of science and technology, research proposals are submitted to open-court competitive programs developed by government agencies (e.g., NSF). Proposal classification is one of the most important tasks to achieve…

Machine Learning · Computer Science 2022-09-20 Meng Xiao , Ziyue Qiao , Yanjie Fu , Yi Du , Pengyang Wang

Empirical research in Natural Language Processing (NLP) has adopted a narrow set of principles for assessing hypotheses, relying mainly on p-value computation, which suffers from several known issues. While alternative proposals have been…

Computation and Language · Computer Science 2020-05-06 Erfan Sadeqi Azer , Daniel Khashabi , Ashish Sabharwal , Dan Roth

Large Vision-Language Models (LVLMs) have made remarkable strides in multimodal tasks such as visual question answering, visual grounding, and complex reasoning. However, they remain limited by static training data, susceptibility to…

Artificial Intelligence · Computer Science 2025-08-27 Chan-Wei Hu , Yueqi Wang , Shuo Xing , Chia-Ju Chen , Suofei Feng , Ryan Rossi , Zhengzhong Tu

Bayesian belief networks can be used to represent and to reason about complex systems with uncertain, incomplete and conflicting information. Belief networks are graphs encoding and quantifying probabilistic dependence and conditional…

Artificial Intelligence · Computer Science 2013-03-08 Carlos Rojas-Guzman , Mark A. Kramer

Synthetic datasets are important for evaluating and testing machine learning models. When evaluating real-life recommender systems, high-dimensional categorical (and sparse) datasets are often considered. Unfortunately, there are not many…

Information Retrieval · Computer Science 2024-12-11 Miha Malenšek , Blaž Škrlj , Blaž Mramor , Jure Demšar

Hypothesis formulation and testing are central to empirical research. A strong hypothesis is a best guess based on existing evidence and informed by a comprehensive view of relevant literature. However, with exponential increase in the…

Computation and Language · Computer Science 2024-03-27 Sai Koneru , Jian Wu , Sarah Rajtmajer