• Bindu Alugula

Data Analytics Done by Real Time Data using Hadoop and Spark is a Business Analytics Application. Its main goal is to migrate and transfer the data from client and Application server to HIVE with the help of Spark. This Application is generally handled by Data Engineer. Develop the data mindset and analytical skills to make informed business decisions here the main decision which I made is deals with data which can be migrated and transfer using Avro format and finally comes in parquet format which is default format of spark is dump in hive. Generally we have Client Server, Application Server, Spark and Hive. My Project Deals with these software’s only. In Client Server data is stored in form of Key Value pair and Maximum deals with MySQL. In Application Server is a Key Data. Spark is used for the speed access and manipulate of the data with the help of .jar files .Spark make use of HBASE to convert Avro format to data frames .These Data Frames are dump into HIVE in tabular format (parquet). Benefit is Client can monitor the transfer through log files. Finally internal data serialization and data migration is done.

Hadoop, Real Time, Data Engineer, Business Analytics, Key Value, Avro Format, Spark, Hive, HBase, Application Server, Client Server, MySQL.

"DATA ANALYTICS DONE BY REAL TIME DATA USING HADOOP AND SPARK", International Journal of Emerging Technologies and Innovative Research (www.jetir.org), ISSN:2349-5162, Vol.9, Issue 1, page no.b182-b192, January-2022, Available :http://www.jetir.org/papers/JETIR2201125.pdf

"DATA ANALYTICS DONE BY REAL TIME DATA USING HADOOP AND SPARK", International Journal of Emerging Technologies and Innovative Research (www.jetir.org | UGC and issn Approved), ISSN:2349-5162, Vol.9, Issue 1, page no. ppb182-b192, January-2022, Available at : http://www.jetir.org/papers/JETIR2201125.pdf