English
Related papers

Related papers: MLLM-Tool: A Multimodal Large Language Model For T…

200 papers

Large Language Models (LLMs) have revolutionized various aspects of engineering and science. Their utility is often bottlenecked by the lack of interaction with the external digital environment. To overcome this limitation and achieve…

Software Engineering · Computer Science 2024-12-24 Ioannis Tzachristas

This paper presents a novel design of a multi-agent system framework that applies large language models (LLMs) to automate the parametrization of simulation models in digital twins. This framework features specialized LLM agents tasked with…

Artificial Intelligence · Computer Science 2024-07-23 Yuchen Xia , Daniel Dittler , Nasser Jazdi , Haonan Chen , Michael Weyrich

Using tools by Large Language Models (LLMs) is a promising avenue to extend their reach beyond language or conversational settings. The number of tools can scale to thousands as they enable accessing sensory information, fetching updated…

Information Retrieval · Computer Science 2024-12-06 Mohammad Kachuee , Sarthak Ahuja , Vaibhav Kumar , Puyang Xu , Xiaohu Liu

Vehicle motion planning is an essential component of autonomous driving technology. Current rule-based vehicle motion planning methods perform satisfactorily in common scenarios but struggle to generalize to long-tailed situations.…

Recent advancements in Large Language Models (LLMs) have shown significant progress in understanding complex natural language. One important application of LLM is LLM-based AI Agent, which leverages the ability of LLM as well as external…

Computation and Language · Computer Science 2024-07-19 Zelong Li , Shuyuan Xu , Kai Mei , Wenyue Hua , Balaji Rama , Om Raheja , Hao Wang , He Zhu , Yongfeng Zhang

Large language models (LLMs) have recently been applied in software engineering to perform tasks such as translating code between programming languages, generating code from natural language, and autocompleting code as it is being written.…

Human-Computer Interaction · Computer Science 2023-02-15 Steven I. Ross , Fernando Martinez , Stephanie Houde , Michael Muller , Justin D. Weisz

Although multimodal large language models (MLLMs) have achieved promising results on a wide range of vision-language tasks, their ability to perceive and understand human faces is rarely explored. In this work, we comprehensively evaluate…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Haomiao Sun , Mingjie He , Tianheng Lian , Hu Han , Shiguang Shan

We present Natural Language Tools (NLT), a framework that replaces programmatic JSON tool calling in large language models (LLMs) with natural language outputs. By decoupling tool selection from response generation, NLT eliminates task…

Computation and Language · Computer Science 2025-10-17 Reid T. Johnson , Michelle D. Pain , Jordan D. West

This paper introduces LogitLens4LLMs, a toolkit that extends the Logit Lens technique to modern large language models. While Logit Lens has been a crucial method for understanding internal representations of language models, it was…

Computation and Language · Computer Science 2025-03-18 Zhenyu Wang

In recent years, Large Language Models (LLMs) have shown great abilities in various tasks, including question answering, arithmetic problem solving, and poem writing, among others. Although research on LLM-as-an-agent has shown that LLM can…

Multiagent Systems · Computer Science 2024-05-21 Chuanneng Sun , Songjun Huang , Dario Pompili

With the recent emergence of revolutionary autonomous agentic systems, research community is witnessing a significant shift from traditional static, passive, and domain-specific AI agents toward more dynamic, proactive, and generalizable…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Huanjin Yao , Ruifei Zhang , Jiaxing Huang , Jingyi Zhang , Yibo Wang , Bo Fang , Ruolin Zhu , Yongcheng Jing , Shunyu Liu , Guanbin Li , Dacheng Tao

Large Language Models (LLMs) have introduced a paradigm shift in interaction with AI technology, enabling knowledge workers to complete tasks by specifying their desired outcome in natural language. LLMs have the potential to increase…

Human-Computer Interaction · Computer Science 2025-03-24 Michelle Brachman , Amina El-Ashry , Casey Dugan , Werner Geyer

While contemporary large language models (LLMs) are increasingly capable in isolation, there are still many difficult problems that lie beyond the abilities of a single LLM. For such tasks, there is still uncertainty about how best to take…

Artificial Intelligence · Computer Science 2026-02-27 Ryan Liu , Dilip Arumugam , Cedegao E. Zhang , Sean Escola , Xaq Pitkow , Thomas L. Griffiths

Large language models (LLMs) are trained on text-only data that go far beyond the languages with paired speech and text data. At the same time, Dual Encoder (DE) based retrieval systems project queries and documents into the same embedding…

Computation and Language · Computer Science 2024-07-11 Frank Palma Gomez , Ramon Sanabria , Yun-hsuan Sung , Daniel Cer , Siddharth Dalmia , Gustavo Hernandez Abrego

Large Language Models (LLMs) have emerged as formidable instruments capable of comprehending and producing human-like text. This paper explores the potential of LLMs, to shape user perspectives and subsequently influence their decisions on…

Artificial Intelligence · Computer Science 2024-09-04 Ganesh Prasath Ramani , Shirish Karande , Santhosh V , Yash Bhatia

As organizations increasingly seek to leverage machine learning (ML) capabilities, the technical complexity of implementing ML solutions creates significant barriers to adoption and impacts operational efficiency. This research examines how…

Human-Computer Interaction · Computer Science 2025-07-09 Jiapeng Yao , Lantian Zhang , Jiping Huang

Large language models (LLMs) have opened up new possibilities for intelligent agents, endowing them with human-like thinking and cognitive abilities. In this work, we delve into the potential of large language models (LLMs) in autonomous…

Computer Vision and Pattern Recognition · Computer Science 2025-12-18 Erfei Cui , Wenhai Wang , Zhiqi Li , Jiangwei Xie , Haoming Zou , Hanming Deng , Gen Luo , Lewei Lu , Xizhou Zhu , Jifeng Dai

Inspired by the exceptional general intelligence of Large Language Models (LLMs), researchers have begun to explore their application in pioneering the next generation of recommender systems - systems that are conversational, explainable,…

Information Retrieval · Computer Science 2024-08-06 Wensheng Lu , Jianxun Lian , Wei Zhang , Guanghua Li , Mingyang Zhou , Hao Liao , Xing Xie

The rapid development of Large Language Models (LLMs) demonstrates remarkable multilingual capabilities in natural language processing, attracting global attention in both academia and industry. To mitigate potential discrimination and…

Computation and Language · Computer Science 2025-01-08 Kaiyu Huang , Fengran Mo , Xinyu Zhang , Hongliang Li , You Li , Yuanchi Zhang , Weijian Yi , Yulong Mao , Jinchen Liu , Yuzhuang Xu , Jinan Xu , Jian-Yun Nie , Yang Liu

Large Language Models (LLMs) have emerged as integral tools for reasoning, planning, and decision-making, drawing upon their extensive world knowledge and proficiency in language-related tasks. LLMs thus hold tremendous potential for…

Artificial Intelligence · Computer Science 2024-05-24 Xudong Guo , Kaixuan Huang , Jiale Liu , Wenhui Fan , Natalia Vélez , Qingyun Wu , Huazheng Wang , Thomas L. Griffiths , Mengdi Wang