English
Related papers

Related papers: Verify Implementation Equivalence of Large Models

200 papers

Reasoning is essential for the development of large knowledge graphs, especially for completion, which aims to infer new triples based on existing ones. Both rules and embeddings can be used for knowledge graph reasoning and they have their…

Artificial Intelligence · Computer Science 2019-03-22 Wen Zhang , Bibek Paudel , Liang Wang , Jiaoyan Chen , Hai Zhu , Wei Zhang , Abraham Bernstein , Huajun Chen

As large language models (LLMs) become integral to code-related tasks, a central question emerges: Do LLMs truly understand program semantics? We introduce EquiBench, a new benchmark for evaluating LLMs through equivalence checking, i.e.,…

Machine Learning · Computer Science 2025-09-23 Anjiang Wei , Jiannan Cao , Ran Li , Hongyu Chen , Yuhui Zhang , Ziheng Wang , Yuan Liu , Thiago S. F. X. Teixeira , Diyi Yang , Ke Wang , Alex Aiken

An e-graph efficiently represents a congruence relation over many expressions. Although they were originally developed in the late 1970s for use in automated theorem provers, a more recent technique known as equality saturation repurposes…

Programming Languages · Computer Science 2021-01-08 Max Willsey , Chandrakana Nandi , Yisu Remy Wang , Oliver Flatt , Zachary Tatlock , Pavel Panchekha

Video frame interpolation, the task of synthesizing new frames in between two or more given ones, is becoming an increasingly popular research target. However, the current evaluation of frame interpolation techniques is not ideal. Due to…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Simon Kiefhaber , Simon Niklaus , Feng Liu , Simone Schaub-Meyer

Large Language Models (LLMs) are transforming a wide range of domains, yet verifying their outputs remains a significant challenge, especially for complex open-ended tasks such as consolidation, summarization, and knowledge extraction. To…

Hypergraphs are generalisation of graphs in which a hyperedge can connect any number of vertices. It can describe n-ary relationships and high-order information among entities compared to conventional graphs. In this paper, we study the…

Databases · Computer Science 2023-02-21 Zhengyi Yang , Wenjie Zhang , Xuemin Lin , Ying Zhang , Shunyang Li

Network alignment is useful for multiple applications that require increasingly large graphs to be processed. Existing research approaches this as an optimization problem or computes the similarity based on node representations. However,…

Social and Information Networks · Computer Science 2020-08-03 Kyle K. Qin , Flora D. Salim , Yongli Ren , Wei Shao , Mark Heimann , Danai Koutra

Vision-Language Models (VLMs) often generate plausible but incorrect responses to visual queries. However, reliably quantifying the effect of such hallucinations in free-form responses to open-ended queries is challenging as it requires…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Viraj Prabhu , Senthil Purushwalkam , An Yan , Caiming Xiong , Ran Xu

This work studies electrocardiogram (ECG) biometrics at large scale, directly addressing a critical gap in the literature: the scarcity of large-scale evaluations with operational metrics and protocols that enable meaningful standardization…

Machine Learning · Computer Science 2026-02-05 Scagnetto Arjuna

The goal of graph inference is to design algorithms for learning properties of a hidden graph using queries to an oracle that returns information about the graph. Graph reconstruction, verification, and property testing are all types of…

Data Structures and Algorithms · Computer Science 2025-02-26 Huck Bennett , Mitchell Black , Amir Nayyeri , Evelyn Warton

E-graphs are a data structure that compactly represents equivalent expressions. They are constructed via the repeated application of rewrite rules. Often in practical applications, conditional rewrite rules are crucial, but their…

Data Structures and Algorithms · Computer Science 2023-08-16 Samuel Coward , George A. Constantinides , Theo Drane

Verifying hardware designs in embedded systems is crucial but often labor-intensive and time-consuming. While existing solutions have improved automation, they frequently rely on unrealistic assumptions. To address these challenges, we…

Hardware Architecture · Computer Science 2024-11-26 Yuchen Hu , Junhao Ye , Ke Xu , Jialin Sun , Shiyue Zhang , Xinyao Jiao , Dingrong Pan , Jie Zhou , Ning Wang , Weiwei Shan , Xinwei Fang , Xi Wang , Nan Guan , Zhe Jiang

Rapid and massive adoption of mobile/ online payment services has brought new challenges to the service providers as well as regulators in safeguarding the proper uses such services/ systems. In this paper, we leverage recent advances in…

Social and Information Networks · Computer Science 2019-06-14 Da Sun Handason Tam , Wing Cheong Lau , Bin Hu , Qiu Fang Ying , Dah Ming Chiu , Hong Liu

To enable heterogeneous computing systems with autonomous programming and optimization capabilities, we propose a unified, end-to-end, programmable graph representation learning (PGL) framework that is capable of mining the complexity of…

Machine Learning · Computer Science 2022-04-27 Yao Xiao , Guixiang Ma , Nesreen K. Ahmed , Mihai Capota , Theodore Willke , Shahin Nazarian , Paul Bogdan

Pattern matching is a fundamental tool for answering complex graph queries. Unfortunately, existing solutions have limited capabilities: they do not scale to process large graphs and/or support only a restricted set of search templates or…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-09-22 Tahsin Reza , Hassan Halawa , Matei Ripeanu , Geoffrey Sanders , Roger Pearce

Entity resolution is a widely studied problem with several proposals to match records across relations. Matching textual content is a widespread task in many applications, such as question answering and search. While recent methods achieve…

Databases · Computer Science 2021-12-17 Naser Ahmadi , Hansjorg Sand , Paolo Papotti

Graph matching is an important and persistent problem in computer vision and pattern recognition for finding node-to-node correspondence between graph-structured data. However, as widely used, graph matching that incorporates pairwise…

Computer Vision and Pattern Recognition · Computer Science 2019-01-17 Fu-Dong Wang , Gui-Song Xia , Nan Xue , Yipeng Zhang , Marcello Pelillo

Entity matching (EM) is a critical task in data integration, aiming to identify records across different datasets that refer to the same real-world entities. Traditional methods often rely on manually engineered features and rule-based…

Computation and Language · Computer Science 2024-06-03 Qianyu Huang , Tongfang Zhao

Formal verification is the next frontier for ensuring the correctness of code generated by Large Language Models (LLMs). While methods that co-generate code and formal specifications in formal languages, like Dafny, can, in principle, prove…

Programming Languages · Computer Science 2026-04-21 Lingfei Zeng , Fengdi Che , Xuhan Huang , Fei Ye , Xu Xu , Binhang Yuan , Jie Fu

Formulating optimization problems for industrial applications demands significant manual effort and domain expertise. While Large Language Models (LLMs) show promise in automating this process, evaluating their performance remains difficult…

Machine Learning · Computer Science 2025-11-03 Zhuohan Wang , Ziwei Zhu , Ziniu Li , Congliang Chen , Yizhou Han , Yufeng Lin , Zhihang Lin , Angyang Gu , Xinglin Hu , Ruoyu Sun , Tian Ding