Optimized Elastic Query Mesh for Cloud Data Streams

Abstract

Many recent applications in several domains such as sensor networks, financial applications, network monitoring and click-streams generate continuous, unbounded, rapid, time varying datasets which are called data streams. In this paper we propose the optimized and elastic query mesh (OEQM) framework for data streams processing based on cloud computing to suit the changeable nature of data streams. OEQM processes the streams tuples over multiple query plans, each plan is suitable for a sub-set of data with the nearest properties and it provides elastic processing of data streams on the cloud environment. We also propose the Auto Scaling Cloud Query Mesh (AS-CQM) algorithm that supports streams processing with multiple plans and provides elastic scaling of the processing resources on demand. Our experimental results show that, the proposed solution OEQM reduces the cost for data streams processing on the cloud environment and efficiently exploits cloud resources.