• Revati Khushal Rane
• Samadhan Sonavane

With the development of cloud computing technologies and mobile internet data[14] is getting generated tremendously hence creating big data. There is a great challenge to analyse and extract important data from it and also getting benefit out of it. Therefore big data processing is facing incredible challenges. In order to provide solution to this issue, this paper focuses on storage of big data and system performance optimization. This paper integrates three big data tools i.e Hive, Impala and SparkSQL which supports SQL-like queries in big data environment. These platforms are used to fast respond to user’s query when the optimized system will automatically select the particular platform to best perform a query. In addition to this approach this paper provides in-memory cache and in-disk cache for the fast data retrieval for the repeated SQL commands. The proposed approach improves performance and efficiency of the data retrieval significantly.

Big data tools, In-memory cache , In-disk cache, Big data processing, Optimized platform selection.

"Enhanced Big Data Platforms for Fast Query Response with Hive,Impala and SparkSQL", International Journal of Emerging Technologies and Innovative Research (www.jetir.org), ISSN:2349-5162, Vol.6, Issue 4, page no.285-292, April-2019, Available :http://www.jetir.org/papers/JETIR1904M44.pdf

"Enhanced Big Data Platforms for Fast Query Response with Hive,Impala and SparkSQL", International Journal of Emerging Technologies and Innovative Research (www.jetir.org | UGC and issn Approved), ISSN:2349-5162, Vol.6, Issue 4, page no. pp285-292, April-2019, Available at : http://www.jetir.org/papers/JETIR1904M44.pdf