• Santosh kumar J
• Dr.B.K. Raghavendra
• Meenakshi

Big data is the data which is not able to store and process by our traditional system. There are many tools now a days to store and process big data each and every device generates the lot of data every seconds nearly data generation is growing like anything past many years lot of data generated but not analyzed and used it now companies like amazon use the analysis on stored data and number one company in the world. So data analysis is very important to grow or development big data is not only about huge data along with that variety and velocity of data the speed at which data generated is also one of the challenges to store and manage the streaming data. And data is not of uniform in nature variety of data like structured whose fields and data types are known, semi structured whose data types are not known but fields are known and unstructured whose data types and fields are not known. to process Hadoop had very important components basically it has main two components like HDFS and Map Reduce to store and process big data on top of that the component YARN added for resource management on top of Hadoop framework many components like H-base, hive, pig, zoo-keeper, Oozie, flume and many are added to make user friendly and improve the performance one of the components which overcome drawbacks of Hadoop is spark and spark itself have many drawbacks to overcome one more framework flink added which also have many drawbacks which will be stated and tried to give solutions Here we ran wordcount for the sample input file with single mapper reducer and multiple reducers with Pig script without orderby and Hive with order by and we achieved enhanced performance with hive with order by along multiple reducers.

Hadoop,HDFS,MapReduce,Spark,Flink

"A SURVEY ON BIG DATA PROCESSING", International Journal of Emerging Technologies and Innovative Research (www.jetir.org), ISSN:2349-5162, Vol.6, Issue 2, page no.32-36, February-2019, Available :http://www.jetir.org/papers/JETIR1902C07.pdf

"A SURVEY ON BIG DATA PROCESSING", International Journal of Emerging Technologies and Innovative Research (www.jetir.org | UGC and issn Approved), ISSN:2349-5162, Vol.6, Issue 2, page no. pp32-36, February-2019, Available at : http://www.jetir.org/papers/JETIR1902C07.pdf