A Single Machine System for Querying Big Graphs with PRAM

  • Yang Liu
  • , Wenfei Fan
  • , Shuhao Liu*
  • , Xiaoke Zhu
  • , Jianxin Li
  • *Corresponding author for this work

Research output: Contribution to journalConference articlepeer-review

Abstract

This paper develops Planar (Plug and play PRAM), a single-machine system for graph analytics by reusing existing PRAM algorithms, without the need for designing new parallel algorithms. Planar supports both out-of-core and in-memory analytics. When a graph is too big to fit into the memory of a machine, Planar adapts PRAM to limited resources by extending a fix point model with multi-coreparallelism, using disk as memory extension. For an in-memory task, it dedicates all available CPU cores to the task, and allow sparallelly scalable PRAM algorithms to retain the property, i.e., the more cores are available, the less runtime is taken. We develop a graph partitioning and work scheduling strategy to accommodate sub graph I/O, balance memory usage and reduce runtime, beyond traditional partitioners for multi-machine systems. Using real-life graphs, we empirically verify that Planar outperforms SOTA in memory and out-of-core systems in efficiency and scalability.

Original languageEnglish
Pages (from-to)756-769
Number of pages14
JournalProceedings of the VLDB Endowment
Volume18
Issue number3
DOIs
StatePublished - 2025
Event51st International Conference on Very Large Data Bases, VLDB 2025 - London, United Kingdom
Duration: 1 Sep 20255 Sep 2025

Fingerprint

Dive into the research topics of 'A Single Machine System for Querying Big Graphs with PRAM'. Together they form a unique fingerprint.

Cite this