中文
相关论文

相关论文: JT-SAFE-V2: Safety-by-Design Foundation Model with…

200 篇论文

Can generative agents be trusted in multimodal environments? Despite advances in large language and vision-language models that enable agents to act autonomously and pursue goals in rich settings, their ability to reason about safety,…

人工智能 · 计算机科学 2025-10-10 Alhim Vera , Karen Sanchez , Carlos Hinojosa , Haidar Bin Hamid , Donghoon Kim , Bernard Ghanem

The advancement of large language models (LLMs) prompts the development of multi-modal agents, which are used as a controller to call external tools, providing a feasible way to solve practical tasks. In this paper, we propose a multi-modal…

人工智能 · 计算机科学 2025-02-04 Zhi Gao , Bofei Zhang , Pengxiang Li , Xiaojian Ma , Tao Yuan , Yue Fan , Yuwei Wu , Yunde Jia , Song-Chun Zhu , Qing Li

Recent advances in large language models (LLMs) have catalyzed the rise of autonomous AI agents capable of perceiving, reasoning, and acting in dynamic, open-ended environments. These large-model agents mark a paradigm shift from static…

人工智能 · 计算机科学 2025-07-01 Hang Su , Jun Luo , Chang Liu , Xiao Yang , Yichi Zhang , Yinpeng Dong , Jun Zhu

Fine-tuning Large Language Models (LLMs) has emerged as a common practice for tailoring models to individual needs and preferences. The choice of datasets for fine-tuning can be diverse, introducing safety concerns regarding the potential…

计算与语言 · 计算机科学 2024-10-15 Hyeong Kyu Choi , Xuefeng Du , Yixuan Li

Large Language Models are a promising tool for automated vulnerability detection, thanks to their success in code generation and repair. However, despite widespread adoption, a critical question remains: Are LLMs truly effective at…

密码学与安全 · 计算机科学 2025-04-21 Yue Li , Xiao Li , Hao Wu , Minghui Xu , Yue Zhang , Xiuzhen Cheng , Fengyuan Xu , Sheng Zhong

This report provides an architecture-led analysis of two modern vision-language models (VLMs), Qwen2.5-VL-7B-Instruct and Llama-4-Scout-17B-16E-Instruct, and explains how their architectural properties map to a practical video-to-artifact…

计算机视觉与模式识别 · 计算机科学 2025-12-30 Thomson Tong , Diba Darooneh

In this work, we present JT-DA-8B (JiuTian Data Analyst 8B), a specialized large language model designed for complex table reasoning tasks across diverse real-world scenarios. To address the lack of high-quality supervision in tabular…

人工智能 · 计算机科学 2025-12-09 Ce Chi , Xing Wang , Zhendong Wang , Xiaofan Liu , Ce Li , Zhiyan Song , Chen Zhao , Kexin Yang , Boshen Shi , Jingjing Yang , Chao Deng , Junlan Feng

Multi-vector dense models, such as ColBERT, have proven highly effective in information retrieval. ColBERT's late interaction scoring approximates the joint query-document attention seen in cross-encoders while maintaining inference…

Previous studies on federated learning (FL) often encounter performance degradation due to data heterogeneity among different clients. In light of the recent advances in multimodal large language models (MLLMs), such as GPT-4v and LLaVA,…

人工智能 · 计算机科学 2024-12-03 Jianyi Zhang , Hao Frank Yang , Ang Li , Xin Guo , Pu Wang , Haiming Wang , Yiran Chen , Hai Li

Despite emerging efforts to enhance the safety of Vision-Language Models (VLMs), current approaches face two main shortcomings. 1) Existing safety-tuning datasets and benchmarks only partially consider how image-text interactions can yield…

计算机视觉与模式识别 · 计算机科学 2025-11-26 Youngwan Lee , Kangsan Kim , Kwanyong Park , Ilcahe Jung , Soojin Jang , Seanie Lee , Yong-Ju Lee , Sung Ju Hwang

While explicit Chain-of-Thought (CoT) empowers large reasoning models (LRMs), it enables the generation of riskier final answers. Current alignment paradigms primarily rely on externally enforced compliance, optimizing models to detect…

人工智能 · 计算机科学 2026-05-12 Yi Zhang , Yuxin Chen , Leheng Sheng , Dongcheng Zhang , Chaochao Lu , Xiang Wang , An Zhang

The rapid expansion of IoT devices has outpaced current identification methods, creating significant risks for security, privacy, and network accountability. These challenges are heightened in open-world environments, where traffic metadata…

机器学习 · 计算机科学 2025-10-17 Rameen Mahmood , Tousif Ahmed , Sai Teja Peddinti , Danny Yuxing Huang

Multi-modal large language models (MLLMs) have made significant progress, yet their safety alignment remains limited. Typically, current open-source MLLMs rely on the alignment inherited from their language module to avoid harmful…

密码学与安全 · 计算机科学 2025-04-15 Yanbo Wang , Jiyang Guan , Jian Liang , Ran He

Vision-Language-Action (VLA) models have emerged as a powerful framework that unifies perception, language, and control, enabling robots to perform diverse tasks through multimodal understanding. However, current VLA models typically…

Model fusion is a key strategy for robust recognition in unconstrained scenarios, as different models provide complementary strengths. This is especially important for whole-body human recognition, where biometric cues such as face, gait,…

计算机视觉与模式识别 · 计算机科学 2026-03-31 Jie Zhu , Xiao Guo , Yiyang Su , Anil Jain , Xiaoming Liu

Modern top-performing object detectors depend heavily on backbone networks, whose advances bring consistent performance gains through exploring more effective network structures. In this paper, we propose a novel and flexible backbone…

计算机视觉与模式识别 · 计算机科学 2022-11-23 Tingting Liang , Xiaojie Chu , Yudong Liu , Yongtao Wang , Zhi Tang , Wei Chu , Jingdong Chen , Haibin Ling

Human drivers possess spatial and causal intelligence, enabling them to perceive driving scenarios, anticipate hazards, and react to dynamic environments. In contrast, autonomous vehicles lack these abilities, making it challenging to…

机器人学 · 计算机科学 2025-09-12 Shucheng Huang , Freda Shi , Chen Sun , Jiaming Zhong , Minghao Ning , Yufeng Yang , Yukun Lu , Hong Wang , Amir Khajepour

Safety is a critical requirement for the real-world deployment of robotic systems. Unfortunately, while current robot foundation models show promising generalization capabilities across a wide variety of tasks, they fail to address safety,…

We introduce T5Gemma 2, the next generation of the T5Gemma family of lightweight open encoder-decoder models, featuring strong multilingual, multimodal and long-context capabilities. T5Gemma 2 follows the adaptation recipe (via UL2) in…

Diffusion models have revolutionized generative tasks through high-fidelity outputs, yet flow matching (FM) offers faster inference and empirical performance gains. However, current foundation FM models are computationally prohibitive for…

计算机视觉与模式识别 · 计算机科学 2025-06-04 Johannes Schusterbauer , Ming Gui , Frank Fundel , Björn Ommer