English
Related papers

Related papers: Refining GPT-3 Embeddings with a Siamese Structure…

200 papers

Siamese trackers based on 3D region proposal network (RPN) have shown remarkable success with deep Hough voting. However, using a single seed point feature as the cue for voting fails to produce high-quality 3D proposals. Additionally, the…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Jiahao Nie , Zhiwei He , Yuxiang Yang , Xudong Lv , Mingyu Gao , Jing Zhang

In this vision paper, we propose a shift in perspective for improving the effectiveness of similarity search. Rather than focusing solely on enhancing the data quality, particularly machine learning-generated embeddings, we advocate for a…

Databases · Computer Science 2023-08-03 Renzhi Wu , Jingfan Meng , Jie Jeff Xu , Huayi Wang , Kexin Rong

Semantic sentence embeddings are usually supervisedly built minimizing distances between pairs of embeddings of sentences labelled as semantically similar by annotators. Since big labelled datasets are rare, in particular for non-English…

Computation and Language · Computer Science 2021-10-06 Marco Di Giovanni , Marco Brambilla

This study proposes a comprehensive methodology for identifying three techniques utilized in foreign-operated information manipulation campaigns: Copy-Pasta, Rewording, and Translation. Our approach, dubbed the ``$3\Delta$-space duplicate…

Social and Information Networks · Computer Science 2024-01-01 Manon Richard , Lisa Giordani , Cristian Brokate , Jean Liénard

We fine-tune GPT-3 to answer long-form questions using a text-based web-browsing environment, which allows the model to search and navigate the web. By setting up the task so that it can be performed by humans, we are able to train models…

Advances in Large Language Models (e.g., GPT-4, LLaMA) have improved the generation of coherent sentences resembling human writing on a large scale, resulting in the creation of so-called deepfake texts. However, this progress poses…

Computation and Language · Computer Science 2023-10-11 Adaku Uchendu , Jooyoung Lee , Hua Shen , Thai Le , Ting-Hao 'Kenneth' Huang , Dongwon Lee

Large language models are increasingly capable of generating fluent-appearing text with relatively little task-specific supervision. But can these models accurately explain classification decisions? We consider the task of generating…

Computation and Language · Computer Science 2022-05-06 Sarah Wiegreffe , Jack Hessel , Swabha Swayamdipta , Mark Riedl , Yejin Choi

Assessing the trustworthiness of artificial intelligence systems requires knowledge from many different disciplines. These disciplines do not necessarily share concepts between them and might use words with different meanings, or even use…

Information Retrieval · Computer Science 2022-08-10 Dennis Vetter , Jesmin Jahan Tithi , Magnus Westerlund , Roberto V. Zicari , Gemma Roig

Decoder transformers have continued increasing in scale reaching hundreds of billions of parameters. Due to their scale the same decoder sets state-of-the-art results on various language tasks via prompting or fine-tuning. Yet, these large…

Computation and Language · Computer Science 2022-08-08 Niklas Muennighoff

We explore the effectiveness of an LLM-guided query refinement paradigm for extending the usability of embedding models to challenging zero-shot search and classification tasks. Our approach refines the embedding representation of a user…

Computation and Language · Computer Science 2026-05-13 Ariel Gera , Shir Ashury-Tahan , Gal Bloch , Ohad Eytan , Assaf Toledo

The integration of generative AI into developer forums like Stack Overflow presents an opportunity to enhance problem-solving by allowing users to post screenshots of code or Integrated Development Environments (IDEs) instead of traditional…

Software Engineering · Computer Science 2025-04-29 Faiz Ahmed , Xuchen Tan , Folajinmi Adewole , Suprakash Datta , Maleknaz Nayebi

Duplicate records pose significant challenges in customer relationship management (CRM)and healthcare, often leading to inaccuracies in analytics, impaired user experiences, and compliance risks. Traditional deduplication methods rely…

Machine Learning · Computer Science 2026-03-27 Mohammed Omer Shakeel Ahmed

The recent advances in language modeling significantly improved the generative capabilities of deep neural models: in 2019 OpenAI released GPT-2, a pre-trained language model that can autonomously generate coherent, non-trivial and…

Computation and Language · Computer Science 2021-06-09 Tiziano Fagni , Fabrizio Falchi , Margherita Gambini , Antonio Martella , Maurizio Tesconi

Language Models (LMs) continue to advance, improving response quality and coherence. Given Internet-scale training datasets, LMs have likely encountered much of what users may ask them to generate in some form during their training. A…

Artificial Intelligence · Computer Science 2026-01-27 Michael Majurski , Cynthia Matuszek

Detecting near duplicate images is fundamental to the content ecosystem of photo sharing web applications. However, such a task is challenging when involving a web-scale image corpus containing billions of images. In this paper, we present…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 Andrey Gusev , Jiajing Xu

This paper presents a novel method to enhance the reliability of image classification models during deployment in the face of transient hardware errors. By utilizing enriched text embeddings derived from GPT-3 with question prompts per…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Syed Talal Wasim , Kabila Haile Soboka , Abdulrahman Mahmoud , Salman Khan , David Brooks , Gu-Yeon Wei

Semantic and Cross-language code clone generation may be useful for code reuse, code comprehension, refactoring and benchmarking. OpenAI's GPT model has potential in such clone generation as GPT is used for text generation. When developers…

Software Engineering · Computer Science 2023-09-13 Palash R. Roy , Ajmain I. Alam , Farouq Al-omari , Banani Roy , Chanchal K. Roy , Kevin A. Schneider

The emergence of large language models (LLMs), such as Generative Pre-trained Transformer 4 (GPT-4) used by ChatGPT, has profoundly impacted the academic and broader community. While these models offer numerous advantages in terms of…

Computation and Language · Computer Science 2024-01-17 Zhicheng Dou , Yuchen Guo , Ching-Chun Chang , Huy H. Nguyen , Isao Echizen

Feature transformation plays a critical role in enhancing machine learning model performance by optimizing data representations. Recent state-of-the-art approaches address this task as a continuous embedding optimization problem, converting…

Machine Learning · Computer Science 2025-08-29 Yang Gao , Dongjie Wang , Scott Piersall , Ye Zhang , Liqiang Wang

Human-curated knowledge graphs provide critical supportive information to various natural language processing tasks, but these graphs are usually incomplete, urging auto-completion of them. Prevalent graph embedding approaches, e.g.,…

Computation and Language · Computer Science 2021-02-25 Bo Wang , Tao Shen , Guodong Long , Tianyi Zhou , Yi Chang