MapReduce
Sign in to saveMapReduce is a programming model and an associated implementation for processing and generating big data sets with a parallel and distributed algorithm on a cluster.
Wikidata facts
Show 2 more facts
- Commons category
- MapReduce
- Stack Exchange tag
- stackoverflow.com/tags/mapreduce
Sources (2)
via Wikidata · CC0
~20 min read
Article
20 sectionsContents
- Overview
- Logical view
- Examples
- Dataflow
- Input reader
- Map function
- Partition function
- Comparison function
- Reduce function
- Output writer
- Theoretical background
- Performance considerations
- Distribution and reliability
- Uses
- Criticism
- Lack of novelty
- Restricted programming framework
- See also
- Implementations of MapReduce
- References
MapReduce is a programming model and an associated implementation for processing and generating big data sets with a parallel and distributed algorithm on a cluster.
A MapReduce program is composed of a map procedure, which performs filtering and sorting (such as sorting students by first name into queues, one queue for each name), and a reduce method, which performs a summary operation (such as counting the number of students in each queue, yielding name frequencies). The "MapReduce System" (also called "infrastructure" or "framework") orchestrates the processing by marshalling the distributed servers, running the various tasks in parallel, managing all communications and data transfers between the various parts of the system, and providing for redundancy and fault tolerance.