Map Reduce Overview and Functionality

Abstract

In today s modern world the data has become one of the essential entities to be taken care of properly. New social media platforms that have emerged during last decade, has plethora of data volume and the complexity of that data is also a big concern which could not be solved by the traditional programming models. Hence Map Reduce was introduced. This is one of the best models to perform various tasks on a huge amount of data which was not possible by traditional way. Many real world tasks are expressed in MapReduce model, which is a programming model that processes and generated large datasets. MapReduce makes use of user specified functions map() and reduce() to perform its functionality. The former one process a key-value pair and generates set of key-value pairs which are used by later one for merging. The run-time system takes responsibility of partitioning input, scheduling and handling failures as well. MapReduce is widely used nowadays.