English
Related papers

Related papers: EasyTUS: A Comprehensive Framework for Fast and Ac…

200 papers

Large Language Models (LLMs) trained on large volumes of data excel at various natural language tasks, but they cannot handle tasks requiring knowledge that has not been trained on previously. One solution is to use a retriever that fetches…

Sorted Table Search Procedures are the quintessential query-answering tool, with widespread usage that now includes also Web Applications, e.g, Search Engines (Google Chrome) and ad Bidding Systems (AppNexus). Speeding them up, at very…

Machine Learning · Computer Science 2020-07-31 Domenico Amato , Giosué Lo Bosco , Raffaele Giancarlo

In recent years, instruction tuning has gained increasing attention and emerged as a crucial technique to enhance the capabilities of Large Language Models (LLMs). To construct high-quality instruction datasets, many instruction processing…

Computation and Language · Computer Science 2024-06-25 Yixin Ou , Ningyu Zhang , Honghao Gui , Ziwen Xu , Shuofei Qiao , Yida Xue , Runnan Fang , Kangwei Liu , Lei Li , Zhen Bi , Guozhou Zheng , Huajun Chen

Developing a universal model that can efficiently and effectively respond to a wide range of information access requests -- from retrieval to recommendation to question answering -- has been a long-lasting goal in the information retrieval…

Information Retrieval · Computer Science 2023-04-27 Hansi Zeng , Surya Kallumadi , Zaid Alibadi , Rodrigo Nogueira , Hamed Zamani

Instruction tuning is a crucial technique for aligning language models with humans' actual goals in the real world. Extensive research has highlighted the quality of instruction data is essential for the success of this alignment. However,…

Artificial Intelligence · Computer Science 2024-10-15 Chenglin Li , Qianglong Chen , Zhi Li , Feng Tao , Yicheng Li , Hao Chen , Fei Yu , Yin Zhang

Large language models (LLMs) exhibit remarkable capabilities across diverse tasks, yet aligning them efficiently and effectively with human expectations remains a critical challenge. This thesis advances LLM alignment by introducing novel…

Computation and Language · Computer Science 2025-06-12 Yuxin Jiang

Tabular foundation models represent a growing paradigm in structured data learning, extending the benefits of large-scale pretraining to tabular domains. However, their adoption remains limited due to heterogeneous preprocessing pipelines,…

Machine Learning · Computer Science 2025-12-03 Aditya Tanna , Pratinav Seth , Mohamed Bouadi , Utsav Avaiya , Vinay Kumar Sankarapu

Text clustering serves as a fundamental technique for organizing and interpreting unstructured textual data, particularly in contexts where manual annotation is prohibitively costly. With the rapid advancement of Large Language Models…

Computation and Language · Computer Science 2025-10-08 Chen Huang , Guoxiu He

Significant efforts have been expended in the research and development of a database management system (DBMS) that has a wide range of applications for managing an enormous collection of multisource, heterogeneous, complex, or growing data.…

Databases · Computer Science 2021-04-01 Chunkai Zhang , Zilin Du , Quanjian Dai , Wensheng Gan , Jian Weng , Philip S. Yu

Translating natural language questions into SQL queries, known as text-to-SQL, is a long-standing research problem. Effective text-to-SQL synthesis can become very challenging due to (i) the extensive size of database catalogs (descriptions…

Machine Learning · Computer Science 2024-11-27 Shayan Talaei , Mohammadreza Pourreza , Yu-Chen Chang , Azalia Mirhoseini , Amin Saberi

To address intricate real-world tasks, there has been a rising interest in tool utilization in applications of large language models (LLMs). To develop LLM-based agents, it usually requires LLMs to understand many tool functions from…

Computation and Language · Computer Science 2024-03-28 Siyu Yuan , Kaitao Song , Jiangjie Chen , Xu Tan , Yongliang Shen , Ren Kan , Dongsheng Li , Deqing Yang

Schema matching is a crucial task in data integration, involving the alignment of a source schema with a target schema to establish correspondence between their elements. This task is challenging due to textual and semantic heterogeneity,…

Databases · Computer Science 2024-05-31 Eitam Sheetrit , Menachem Brief , Moshik Mishaeli , Oren Elisha

Deep clustering (DC), a fusion of deep representation learning and clustering, has recently demonstrated positive results in data science, particularly text processing and computer vision. However, joint optimization of feature learning and…

Databases · Computer Science 2024-05-29 Hafiz Tayyab Rauf , Andre Freitas , Norman W. Paton

Large Audio Language Models (LALMs) are rapidly advancing, but evaluating them remains challenging due to inefficient and non-standardized toolkits that limit fair comparison and systematic assessment. Existing evaluation frameworks exhibit…

The release of tabular benchmarks, such as NAS-Bench-101 and NAS-Bench-201, has significantly lowered the computational overhead for conducting scientific research in neural architecture search (NAS). Although they have been widely adopted…

Large Language Models (LLMs) increasingly rely on inference-time reasoning algorithms such as chain-of-thought and multi-branch reasoning to improve accuracy on complex tasks. These methods, however, substantially increase token usage and…

Machine Learning · Computer Science 2025-09-30 Weifan Jiang , Rana Shahout , Yilun Du , Michael Mitzenmacher , Minlan Yu

Large Language Models improve with increasing amounts of high-quality training data. However, leveraging larger datasets requires balancing quality, quantity, and diversity across sources. After evaluating nine baseline methods under both…

Computation and Language · Computer Science 2025-01-27 William Held , Bhargavi Paranjape , Punit Singh Koura , Mike Lewis , Frank Zhang , Todor Mihaylov

Enterprise data lakes often suffer from substantial amounts of duplicate and redundant data, with data volumes ranging from terabytes to petabytes. This leads to both increased storage costs and unnecessarily high maintenance costs for…

Traditional data lakes provide critical data infrastructure for analytical workloads by enabling time travel, running SQL queries, ingesting data with ACID transactions, and visualizing petabyte-scale datasets on cloud storage. They allow…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-12-15 Sasun Hambardzumyan , Abhinav Tuli , Levon Ghukasyan , Fariz Rahman , Hrant Topchyan , David Isayan , Mark McQuade , Mikayel Harutyunyan , Tatevik Hakobyan , Ivo Stranic , Davit Buniatyan

The task of condensing large chunks of textual information into concise and structured tables has gained attention recently due to the emergence of Large Language Models (LLMs) and their potential benefit for downstream tasks, such as text…

Computation and Language · Computer Science 2024-12-06 Zheye Deng , Chunkit Chan , Weiqi Wang , Yuxi Sun , Wei Fan , Tianshi Zheng , Yauwai Yim , Yangqiu Song