English
Related papers

Related papers: OralAgent: Integrating Reasoning, Tools, and Knowl…

200 papers

The intricate nature of modern surgical care necessitates intelligent systems that can synthesize extensive patient records, support collaborative decision-making, and provide transparent, auditable reasoning across the entire perioperative…

Computation and Language · Computer Science 2026-05-29 Dongsheng Shi , Yue Li , Xin Yi , Yongyi Cui , Huawei Feng , Linlin Wang

Scientific reasoning poses an excessive challenge for even the most advanced Large Language Models (LLMs). To make this task more practical and solvable for LLMs, we introduce a new task setting named tool-augmented scientific reasoning.…

Computation and Language · Computer Science 2024-02-22 Yubo Ma , Zhibin Gou , Junheng Hao , Ruochen Xu , Shuohang Wang , Liangming Pan , Yujiu Yang , Yixin Cao , Aixin Sun , Hany Awadalla , Weizhu Chen

Dashboards are powerful visualization tools for data-driven decision-making, integrating multiple interactive views that allow users to explore, filter, and navigate data. Unlike static charts, dashboards support rich interactivity, which…

Data annotation remains a significant bottleneck in the Humanities and Social Sciences, particularly for complex semantic tasks such as metaphor identification. While Large Language Models (LLMs) show promise, a significant gap remains…

Computation and Language · Computer Science 2026-02-06 Bingru Li

As single-task accuracy on individual language and image tasks has improved substantially in the last few years, the long-term goal of a generally skilled agent that can both see and talk becomes more feasible to explore. In this work, we…

Computation and Language · Computer Science 2020-01-17 Da Ju , Kurt Shuster , Y-Lan Boureau , Jason Weston

Speech is essential for human communication, yet millions of people face impairments such as dysarthria, stuttering, and aphasia conditions that often lead to social isolation and reduced participation. Despite recent progress in automatic…

Systems and Control · Electrical Eng. & Systems 2025-10-24 Haowei Lou , Chengkai Huang , Hye-young Paik , Yongquan Hu , Aaron Quigley , Wen Hu , Lina Yao

In modern medicine, clinical diagnosis relies on the comprehensive analysis of primarily textual and visual data, drawing on medical expertise to ensure systematic and rigorous reasoning. Recent advances in large Vision-Language Models…

Artificial Intelligence · Computer Science 2025-07-03 Ziyue Wang , Junde Wu , Linghan Cai , Chang Han Low , Xihong Yang , Qiaxuan Li , Yueming Jin

Specialized visual tools can augment large language models or vision language models with expert knowledge (e.g., grounding, spatial reasoning, medical knowledge, etc.), but knowing which tools to call (and when to call them) can be…

Computation and Language · Computer Science 2025-12-09 Nithin Sivakumaran , Justin Chih-Yao Chen , David Wan , Yue Zhang , Jaehong Yoon , Elias Stengel-Eskin , Mohit Bansal

Dermatological care via telemedicine often lacks the rich context of in-person visits. Clinicians must make diagnoses based on a handful of images and brief descriptions, without the benefit of physical exams, second opinions, or reference…

Artificial Intelligence · Computer Science 2025-08-27 Karishma Thakrar , Shreyas Basavatia , Akshay Daftardar

High-quality scientific review and perspective papers require substantial time and effort, limiting researchers' ability to synthesize emerging knowledge. While Large Language Models (LLMs) leverage AI Scientists for scientific workflows,…

Artificial Intelligence · Computer Science 2026-03-03 Sasi Kiran Gaddipati , Farhana Keya , Gollam Rabby , Sören Auer

Tables condense key transactional and administrative information into compact layouts, but practical extraction requires more than text recognition: systems must also recover structure (rows, columns, merged cells, headers) and interpret…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Laziz Hamdi , Amine Tamasna , Thierry Paquet

Large Language Models (LLMs) have become increasingly integral to enhancing developer productivity, particularly in code generation, comprehension, and repair tasks. However, fine-tuning these models with high-quality, real-world data is…

Software Engineering · Computer Science 2024-12-12 Xiaoyun Liang , Jingyi Ren , Jiayi Qi , Chao Peng , Bo Jiang

Spreadsheets are ubiquitous across the World Wide Web, playing a critical role in enhancing work efficiency across various domains. Large language model (LLM) has been recently attempted for automatic spreadsheet manipulation but has not…

Artificial Intelligence · Computer Science 2025-03-04 Yibin Chen , Yifu Yuan , Zeyu Zhang , Yan Zheng , Jinyi Liu , Fei Ni , Jianye Hao , Hangyu Mao , Fuzheng Zhang

Medical Image Quality Assessment (IQA) serves as the first-mile safety gate for clinical AI, yet existing approaches remain constrained by scalar, score-based metrics and fail to reflect the descriptive, human-like reasoning process central…

The advancement of artificial intelligence (AI) for organ segmentation and tumor detection is propelled by the growing availability of computed tomography (CT) datasets with detailed, per-voxel annotations. However, these AI models often…

Image and Video Processing · Electrical Eng. & Systems 2024-05-29 Jie Liu , Yixiao Zhang , Kang Wang , Mehmet Can Yavuz , Xiaoxi Chen , Yixuan Yuan , Haoliang Li , Yang Yang , Alan Yuille , Yucheng Tang , Zongwei Zhou

Sharing ideas through communication with peers is the primary mode of human interaction. Consequently, extensive research has been conducted in the area of conversational AI, leading to an increase in the availability and diversity of…

Computation and Language · Computer Science 2024-05-24 Shivani Kumar , Sumit Bhatia , Milan Aggarwal , Tanmoy Chakraborty

Large language models (LLMs), despite their remarkable progress across various general domains, encounter significant barriers in medicine and healthcare. This field faces unique challenges such as domain-specific terminologies and…

Computation and Language · Computer Science 2024-06-06 Xiangru Tang , Anni Zou , Zhuosheng Zhang , Ziming Li , Yilun Zhao , Xingyao Zhang , Arman Cohan , Mark Gerstein

Long-form video understanding represents a significant challenge within computer vision, demanding a model capable of reasoning over long multi-modal sequences. Motivated by the human cognitive process for long-form video understanding, we…

Computer Vision and Pattern Recognition · Computer Science 2024-03-18 Xiaohan Wang , Yuhui Zhang , Orr Zohar , Serena Yeung-Levy

Artificial intelligence has dramatically reshaped our interaction with digital technologies, ushering in an era where advancements in AI algorithms and Large Language Models (LLMs) have natural language processing (NLP) systems like…

Computation and Language · Computer Science 2024-06-12 Masoumeh Farhadi Nia , Mohsen Ahmadi , Elyas Irankhah

Video Question Answering (VQA) inherently relies on multimodal reasoning, integrating visual, temporal, and linguistic cues to achieve a deeper understanding of video content. However, many existing methods rely on feeding frame-level…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Noriyuki Kugo , Xiang Li , Zixin Li , Ashish Gupta , Arpandeep Khatua , Nidhish Jain , Chaitanya Patel , Yuta Kyuragi , Yasunori Ishii , Masamoto Tanabiki , Kazuki Kozuka , Ehsan Adeli