跳到主要导航 跳到搜索 跳到主要内容

A Single Machine System for Querying Big Graphs with PRAM

  • Yang Liu
  • , Wenfei Fan
  • , Shuhao Liu*
  • , Xiaoke Zhu
  • , Jianxin Li
  • *此作品的通讯作者
  • Beihang University
  • Shenzhen Institute of Computing Sciences
  • University of Edinburgh

科研成果: 期刊稿件会议文章同行评审

摘要

This paper develops Planar (Plug and play PRAM), a single-machine system for graph analytics by reusing existing PRAM algorithms, without the need for designing new parallel algorithms. Planar supports both out-of-core and in-memory analytics. When a graph is too big to fit into the memory of a machine, Planar adapts PRAM to limited resources by extending a fix point model with multi-coreparallelism, using disk as memory extension. For an in-memory task, it dedicates all available CPU cores to the task, and allow sparallelly scalable PRAM algorithms to retain the property, i.e., the more cores are available, the less runtime is taken. We develop a graph partitioning and work scheduling strategy to accommodate sub graph I/O, balance memory usage and reduce runtime, beyond traditional partitioners for multi-machine systems. Using real-life graphs, we empirically verify that Planar outperforms SOTA in memory and out-of-core systems in efficiency and scalability.

源语言英语
页(从-至)756-769
页数14
期刊Proceedings of the VLDB Endowment
18
3
DOI
出版状态已出版 - 2025
活动51st International Conference on Very Large Data Bases, VLDB 2025 - London, 英国
期限: 1 9月 20255 9月 2025

指纹

探究 'A Single Machine System for Querying Big Graphs with PRAM' 的科研主题。它们共同构成独一无二的指纹。

引用此