跳到主要导航 跳到搜索 跳到主要内容

Pet-Bench: Benchmarking the Abilities of Large Language Models as E-Pets in Social Network Services

  • Hongcheng Guo
  • , Zheyong Xie
  • , Shaosheng Cao*
  • , Boyang Wang
  • , Weiting Liu
  • , Zheyu Ye
  • , Zhoujun Li
  • , Zuozhu Liu
  • , Wei Lu
  • *此作品的通讯作者
  • Fudan University
  • Xiaohongshu
  • Beihang University
  • Zhejiang University
  • Singapore University of Technology and Design

科研成果: 书/报告/会议事项章节会议稿件同行评审

摘要

As interest in using Large Language Models for interactive and emotionally rich experiences grows, virtual pet companionship emerges as a novel yet underexplored application. Existing approaches focus on basic pet role-playing interactions without systematically benchmarking LLMs for comprehensive companionship. In this paper, we introduce PET-BENCH, a dedicated benchmark that evaluates LLMs across both self-interaction and human-interaction dimensions. Unlike prior work, PET-BENCH emphasizes self-evolution and developmental behaviors alongside interactive engagement, offering a more realistic reflection of pet companionship. It features diverse tasks such as intelligent scheduling, memory-based dialogues, and psychological conversations, with over 7,500 interaction instances designed to simulate pet behaviors. Evaluation of 28 LLMs reveals significant performance variations linked to model size and inherent capabilities, underscoring the need for specialized optimization in this domain. PET-BENCH serves as a foundational resource for benchmarking pet-related LLM abilities and advancing emotionally immersive human-pet interactions.

源语言英语
主期刊名CIKM 2025 - Proceedings of the 34th ACM International Conference on Information and Knowledge Management
出版商Association for Computing Machinery, Inc
6402-6407
页数6
ISBN(电子版)9798400720406
DOI
出版状态已出版 - 10 11月 2025
活动34th ACM International Conference on Information and Knowledge Management, CIKM 2025 - Seoul, 韩国
期限: 10 11月 202514 11月 2025

出版系列

姓名CIKM 2025 - Proceedings of the 34th ACM International Conference on Information and Knowledge Management

会议

会议34th ACM International Conference on Information and Knowledge Management, CIKM 2025
国家/地区韩国
Seoul
时期10/11/2514/11/25

指纹

探究 'Pet-Bench: Benchmarking the Abilities of Large Language Models as E-Pets in Social Network Services' 的科研主题。它们共同构成独一无二的指纹。

引用此