Minni: Lightweight MapReduce Library

Issue 25: [lib+master] Enable Mapper Task Assignment of Multiple Blocks

Reported by Wolfgang Richter, Jul 1, 2010

This represents a significant shift in the job assignment algorithms 
and design in the master.

The only coordination in the library that will be needed is to be 
able to process a starting CID and an ending CID from the job 
properties map.

Comment 1 by Wolfgang Richter, Jul 7, 2010

Master has been modified to handle this job assignment.  Maximum 
number of map jobs in the MapReduceSpecification from the user is 
now respected.

Comment 2 by Athula Balachandran, Jul 7, 2010

Map code in the library has also been modified to handle this kind 
of job assignment. The mapper reads chunks in the range passed to it 
one by one.

Comment 3 by Wolfgang Richter, Jul 7, 2010

Master code in commit bdb9cb.

Comment 4 by Athula Balachandran, Jul 7, 2010

Lib code in commit 82bfd

Comment 5 by Athula Balachandran, Jul 7, 2010

Status: Fixed

Created: 15 years 19 days ago by Wolfgang Richter

Updated: 15 years 13 days ago

Status: Fixed

Owner: Wolfgang Richter

Followed by: 1 person

Labels:
OpSys:All
Type:Enhancement
Component:Logic
Other:Usability
Priority:Critical