TY - GEN
T1 - Incremental graph computations
T2 - 2017 ACM SIGMOD International Conference on Management of Data, SIGMOD 2017
AU - Fan, Wenfei
AU - Hu, Chunming
AU - Tian, Chao
PY - 2017/5/9
Y1 - 2017/5/9
N2 - The incremental problem for a class Q of graph queries aims to compute, given a query Q ∈ Q, graph G, output Q(G) and updates ΔG to G as input, changes ΔO to Q(G) such that Q (G⊕ΔG) = Q(G)⊕ΔO. It is called bounded if its cost can be expressed as a polynomial function in the sizes of Q, ΔG and ΔO. It is to reduce computations on possibly big G to small ΔG and ΔO. No matter how desirable, however, our first results are negative: for common graph queries such as graph traversal, connectivity, keyword search and pattern matching, their incremental problems are unbounded. In light of the negative results, we propose two characterizations for the effectiveness of incremental computation: (a) localizable, if its cost is decided by small neighbors of nodes in ΔG instead of the entire G; and (b) bounded relative to a batch algorithm T, if the cost is determined by the sizes of ΔG and changes to the affected area that is necessarily checked by T. We show that the incremental computations above are either localizable or relatively bounded, by providing corresponding incremental algorithms. That is, we can either reduce the incremental computations on big graphs to small data, or incrementalize batch algorithms by minimizing unnecessary recomputation. Using real-life graphs, we experimentally verify the effectiveness of our algorithms.
AB - The incremental problem for a class Q of graph queries aims to compute, given a query Q ∈ Q, graph G, output Q(G) and updates ΔG to G as input, changes ΔO to Q(G) such that Q (G⊕ΔG) = Q(G)⊕ΔO. It is called bounded if its cost can be expressed as a polynomial function in the sizes of Q, ΔG and ΔO. It is to reduce computations on possibly big G to small ΔG and ΔO. No matter how desirable, however, our first results are negative: for common graph queries such as graph traversal, connectivity, keyword search and pattern matching, their incremental problems are unbounded. In light of the negative results, we propose two characterizations for the effectiveness of incremental computation: (a) localizable, if its cost is decided by small neighbors of nodes in ΔG instead of the entire G; and (b) bounded relative to a batch algorithm T, if the cost is determined by the sizes of ΔG and changes to the affected area that is necessarily checked by T. We show that the incremental computations above are either localizable or relatively bounded, by providing corresponding incremental algorithms. That is, we can either reduce the incremental computations on big graphs to small data, or incrementalize batch algorithms by minimizing unnecessary recomputation. Using real-life graphs, we experimentally verify the effectiveness of our algorithms.
UR - https://www.scopus.com/pages/publications/85021246613
U2 - 10.1145/3035918.3035944
DO - 10.1145/3035918.3035944
M3 - 会议稿件
AN - SCOPUS:85021246613
T3 - Proceedings of the ACM SIGMOD International Conference on Management of Data
SP - 155
EP - 169
BT - SIGMOD 2017 - Proceedings of the 2017 ACM International Conference on Management of Data
PB - Association for Computing Machinery
Y2 - 14 May 2017 through 19 May 2017
ER -