English
Related papers

Related papers: Open Assistant Toolkit -- version 2

200 papers

Real-time speech interaction, serving as a fundamental interface for human-machine collaboration, holds immense potential. However, current open-source models face limitations such as high costs in voice data collection, weakness in dynamic…

Computation and Language · Computer Science 2025-02-19 Ailin Huang , Boyong Wu , Bruce Wang , Chao Yan , Chen Hu , Chengli Feng , Fei Tian , Feiyu Shen , Jingbei Li , Mingrui Chen , Peng Liu , Ruihang Miao , Wang You , Xi Chen , Xuerui Yang , Yechang Huang , Yuxiang Zhang , Zheng Gong , Zixin Zhang , Hongyu Zhou , Jianjian Sun , Brian Li , Chengting Feng , Changyi Wan , Hanpeng Hu , Jianchang Wu , Jiangjie Zhen , Ranchen Ming , Song Yuan , Xuelin Zhang , Yu Zhou , Bingxin Li , Buyun Ma , Hongyuan Wang , Kang An , Wei Ji , Wen Li , Xuan Wen , Xiangwen Kong , Yuankai Ma , Yuanwei Liang , Yun Mou , Bahtiyar Ahmidi , Bin Wang , Bo Li , Changxin Miao , Chen Xu , Chenrun Wang , Dapeng Shi , Deshan Sun , Dingyuan Hu , Dula Sai , Enle Liu , Guanzhe Huang , Gulin Yan , Heng Wang , Haonan Jia , Haoyang Zhang , Jiahao Gong , Junjing Guo , Jiashuai Liu , Jiahong Liu , Jie Feng , Jie Wu , Jiaoren Wu , Jie Yang , Jinguo Wang , Jingyang Zhang , Junzhe Lin , Kaixiang Li , Lei Xia , Li Zhou , Liang Zhao , Longlong Gu , Mei Chen , Menglin Wu , Ming Li , Mingxiao Li , Mingliang Li , Mingyao Liang , Na Wang , Nie Hao , Qiling Wu , Qinyuan Tan , Ran Sun , Shuai Shuai , Shaoliang Pang , Shiliang Yang , Shuli Gao , Shanshan Yuan , Siqi Liu , Shihong Deng , Shilei Jiang , Sitong Liu , Tiancheng Cao , Tianyu Wang , Wenjin Deng , Wuxun Xie , Weipeng Ming , Wenqing He , Wen Sun , Xin Han , Xin Huang , Xiaomin Deng , Xiaojia Liu , Xin Wu , Xu Zhao , Yanan Wei , Yanbo Yu , Yang Cao , Yangguang Li , Yangzhen Ma , Yanming Xu , Yaoyu Wang , Yaqiang Shi , Yilei Wang , Yizhuang Zhou , Yinmin Zhong , Yang Zhang , Yaoben Wei , Yu Luo , Yuanwei Lu , Yuhe Yin , Yuchu Luo , Yuanhao Ding , Yuting Yan , Yaqi Dai , Yuxiang Yang , Zhe Xie , Zheng Ge , Zheng Sun , Zhewei Huang , Zhichao Chang , Zhisheng Guan , Zidong Yang , Zili Zhang , Binxing Jiao , Daxin Jiang , Heung-Yeung Shum , Jiansheng Chen , Jing Li , Shuchang Zhou , Xiangyu Zhang , Xinhao Zhang , Yibo Zhu

Since its inception in 2016, the Alexa Prize program has enabled hundreds of university students to explore and compete to develop conversational agents through the SocialBot Grand Challenge. The goal of the challenge is to build agents…

In this paper, we propose Tutoring bot, a generative chatbot trained on a large scale of tutor-student conversations for English-language learning. To mimic a human tutor's behavior in language education, the tutor bot leverages diverse…

Artificial Intelligence · Computer Science 2023-02-27 Hyungjoo Chae , Minjin Kim , Chaehyeong Kim , Wonseok Jeong , Hyejoong Kim , Junmyung Lee , Jinyoung Yeo

Artificial Intelligence (AI)-assisted coding environments operate within finite context windows of 128,000-1,000,000 tokens (as of early 2026), yet existing tools offer limited support for monitoring and optimizing token consumption. As…

Software Engineering · Computer Science 2026-04-10 Vahid Farajijobehdar , İlknur Köseoğlu Sarı , Nazım Kemal Üre , Engin Zeydan

Athena 2.0 is an Alexa Prize SocialBot that has been a finalist in the last two Alexa Prize Grand Challenges. One reason for Athena's success is its novel dialogue management strategy, which allows it to dynamically construct dialogues and…

Agentic systems, AI architectures that autonomously execute multi-step workflows to achieve complex goals, are often built using repeated large language model (LLM) calls for closed-set decision tasks such as routing, shortlisting, gating,…

Computation and Language · Computer Science 2026-02-19 Ido Levy , Eilam Shapira , Yinon Goldshtein , Avi Yaeli , Nir Mashkif , Segev Shlomov

This paper introduces EmpathyEar, a pioneering open-source, avatar-based multimodal empathetic chatbot, to fill the gap in traditional text-only empathetic response generation (ERG) systems. Leveraging the advancements of a large language…

Multimedia · Computer Science 2024-06-24 Hao Fei , Han Zhang , Bin Wang , Lizi Liao , Qian Liu , Erik Cambria

Task-oriented dialogue (TOD) systems function as digital assistants, guiding users through various tasks such as booking flights or finding restaurants. Existing toolkits for building TOD systems often fall short of in delivering…

Smart autonomous agents are becoming increasingly important in various real-life applications, including robotics and autonomous vehicles. One crucial skill that these agents must possess is the ability to interact with their surrounding…

Robotics · Computer Science 2024-08-09 Niyati Rawal , Roberto Bigazzi , Lorenzo Baraldi , Rita Cucchiara

Large-scale language models (LLMs), such as ChatGPT, are becoming increasingly sophisticated and exhibit human-like capabilities, playing an essential role in assisting humans in a variety of everyday tasks. An important application of AI…

Computers and Society · Computer Science 2023-12-07 Yugen Sato , Taisei Nakajima , Tatsuki Kawamoto , Tomohiro Takagi

Solving complex reasoning tasks may involve visual understanding, domain knowledge retrieval, numerical calculation, and multi-step reasoning. Existing methods augment large language models (LLMs) with external tools but are restricted to…

Machine Learning · Computer Science 2026-04-15 Pan Lu , Bowen Chen , Sheng Liu , Rahul Thapa , Joseph Boen , James Zou

Sensemaking in collaborative work and learning is increasingly supported by GenAI systems, however, emerging evidence suggests that poorly designed GenAI systems tend to provide explicit instruction that groups passively follow, fostering…

Human-Computer Interaction · Computer Science 2026-03-12 Yihang Zhao , Wenxin Zhang , Amy Rechkemmer , Albert Meroño Peñuela , Elena Simperl

The combination of LLM agents with external tools enables models to solve complex tasks beyond their knowledge base. Human-designed tools are inflexible and restricted to solutions within the scope of pre-existing tools created by experts.…

Artificial Intelligence · Computer Science 2025-11-18 Mohd Ariful Haque , Justin Williams , Sunzida Siddique , Md. Hujaifa Islam , Hasmot Ali , Kishor Datta Gupta , Roy George

The integration of large language models (LLMs) with external tools has significantly expanded the capabilities of AI agents. However, as the diversity of both LLMs and tools increases, selecting the optimal model-tool combination becomes a…

Computation and Language · Computer Science 2026-01-08 Jinyang Wu , Guocheng Zhai , Ruihan Jin , Jiahao Yuan , Yuhao Shen , Shuai Zhang , Zhengqi Wen , Jianhua Tao

Databases for OLTP are often the backbone for applications such as hotel room or cinema ticket booking applications. However, developing a conversational agent (i.e., a chatbot-like interface) to allow end-users to interact with an…

The availability of generative Artificial Intelligence (AI) tools such as ChatGPT or GitHub Copilot is reshaping the way in which software is developed, evolved, and maintained. Oftentimes, developers leave traces of such an usage in…

Deploying production-ready multi-agent systems (MAS) in complex industrial environments remains challenging due to limitations in scalability, observability, and autonomous evolution. We present OxyGent, an open-source framework driven by…

Artificial Intelligence · Computer Science 2026-04-30 Junxing Hu , Tianlong Li , Lei Yu , Ai Han

The rapid expansion of the open-source language model landscape presents an opportunity to merge the competencies of these model checkpoints by combining their parameters. Advances in transfer learning, the process of fine-tuning pretrained…

Computation and Language · Computer Science 2025-01-13 Charles Goddard , Shamane Siriwardhana , Malikeh Ehghaghi , Luke Meyers , Vlad Karpukhin , Brian Benedict , Mark McQuade , Jacob Solawetz

Retrieval-augmented generation is increasingly effective in answering scientific questions from literature, but many state-of-the-art systems are expensive and closed-source. We introduce Ai2 Scholar QA, a free online scientific question…

We present TacoBot, a task-oriented dialogue system built for the inaugural Alexa Prize TaskBot Challenge, which assists users in completing multi-step cooking and home improvement tasks. TacoBot is designed with a user-centered principle…

Computation and Language · Computer Science 2022-07-22 Shijie Chen , Ziru Chen , Xiang Deng , Ashley Lewis , Lingbo Mo , Samuel Stevens , Zhen Wang , Xiang Yue , Tianshu Zhang , Yu Su , Huan Sun