Friday, October 12, 2012

Map-Reduce implementation in Python

Recently I discovered a Python implementation of the Map-Reduce framework.
It is mincemeat.py, and can be found here: https://github.com/michaelfairley/mincemeatpy
The advantage is that it is an only-file implementation and it is quite efficient.
There is an example attached with the downloaded file.
To run it, you need just to execute example.py, which will perform the server tasks.
For each client, just run mincemeat.py specifying the server port (127.0.0.1 by default).

Other implementations of the Map-Reduce pattern in python are:

octopy
hadoopy
dino
mrjob