Ring: Real-Time Emerging Anomaly Monitoring System over Text Streams

Microblog platforms have been extremely popular in the big data era due to its real-time diffusion of information. It's important to know what anomalous events are trending on the social network and be able to monitor their evolution and find related anomalies. In this paper we demonstrate Ring, a real-time emerging anomaly monitoring system over microblog text streams. Ring integrates our efforts on both emerging anomaly monitoring research and system research. From the anomaly monitoring perspective, Ring proposes a graph analytic approach such that (1) Ring is able to detect emerging anomalies at an earlier stage compared to the existing methods, (2) Ring is among the first to discover emerging anomalies correlations in a streaming fashion, (3) Ring is able to monitor anomaly evolutions in real-time at different time scales from minutes to months. From the system research perspective, Ring (1) optimizes time-ranged keyword query performance of a full-text search engine to improve the efficiency of monitoring anomaly evolution, (2) improves the dynamic graph processing performance of Spark and implements our graph stream model on it, As a result, Ring is able to process big data to the entire Weibo or Twitter text stream with linear horizontal scalability. The system clearly presents its advantages over existing systems and methods from both the event monitoring perspective and the system perspective for the emerging event monitoring task.