2014年12月17日 星期三

[Paper note] Monitoring and analyzing big traffic data of a large-scale cellular network with Hadoop




Network traffic monitoring and analysis is of theoretical and practical significance for optimizing network resource and improving user experience. However, existing solutions, which usually rely on a high-performance server with large storage capacity, are not scalable for detailed analysis of a large volume of traffic data. In this article, we present a traffic monitoring and analysis system for large-scale networks based on Hadoop, an open-source distributed computing platform for big data processing on commodity hardware. This system has been deployed in the core network of a large cellular network and extensively evaluated. The results demonstrate that the system can efficiently processes 4.2 Tbytes of traffic data from 123 Gb/s links with high performance and low cost every day.

網路流量監控和分析
現在的solution主要都依賴於有著大儲存容量的high-performance server,都沒有可擴展為大量的業務數據的詳細分析。這篇文章提出一個流量監控分析系統基於hadoop,一個開源的分散式計算平台for大數據處理的大型網路。

該系統已經被部署在大型蜂窩網絡的核心網絡和廣泛評價。的結果表明,該系統可以有效地處理4.2 TB的業務數據,從具有高的性能價格比每天123 Gb / s。