org.apache.giraph.master

Class MasterGlobalCommHandler

java.lang.Object

org.apache.giraph.master.MasterGlobalCommHandler

All Implemented Interfaces:

MasterGlobalCommUsage, MasterGlobalCommUsageAggregators

public class MasterGlobalCommHandler
extends Object
implements MasterGlobalCommUsage

Handler for all master communications

Constructor Summary

Constructors

Constructor and Description
MasterGlobalCommHandler(MasterAggregatorHandler aggregatorHandler, MasterInputSplitsHandler inputSplitsHandler) Constructor

Method Summary

Modifier and Type	Method and Description
void	broadcast(String name, org.apache.hadoop.io.Writable value) Broadcast given value to all workers for next computation.
MasterAggregatorHandler	getAggregatorHandler()
Iterable<PartitionStats>	getAllPartitionStats(int numWorkers, org.apache.hadoop.util.Progressable progressable) Get all partition stats.
MasterInputSplitsHandler	getInputSplitsHandler()
<R extends org.apache.hadoop.io.Writable> R	getReduced(String name) Get reduced value from previous worker computation.
void	receivedPartitionStats(List<PartitionStats> partitionStats) Received partition stats from a worker
<S,R extends org.apache.hadoop.io.Writable> void	registerReducer(String name, ReduceOperation<S,R> reduceOp) Register reducer to be reduced in the next worker computation, using given name and operations.
<S,R extends org.apache.hadoop.io.Writable> void	registerReducer(String name, ReduceOperation<S,R> reduceOp, R globalInitialValue) Register reducer to be reduced in the next worker computation, using given name and operations, starting globally from globalInitialValue.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

MasterGlobalCommHandler

public MasterGlobalCommHandler(MasterAggregatorHandler aggregatorHandler,
                               MasterInputSplitsHandler inputSplitsHandler)

Constructor

Parameters:

aggregatorHandler - Aggregator handler

inputSplitsHandler - Input splits handler

Method Detail

getAggregatorHandler

public MasterAggregatorHandler getAggregatorHandler()

getInputSplitsHandler

public MasterInputSplitsHandler getInputSplitsHandler()

registerReducer

public <S,R extends org.apache.hadoop.io.Writable> void registerReducer(String name,
                                                                        ReduceOperation<S,R> reduceOp)

Description copied from interface: MasterGlobalCommUsageAggregators

Register reducer to be reduced in the next worker computation, using given name and operations.

Specified by:

registerReducer in interface MasterGlobalCommUsageAggregators

Type Parameters:

S - Single value type

R - Reduced value type

Parameters:

name - Name of the reducer

reduceOp - Reduce operations

registerReducer

public <S,R extends org.apache.hadoop.io.Writable> void registerReducer(String name,
                                                                        ReduceOperation<S,R> reduceOp,
                                                                        R globalInitialValue)

Description copied from interface: MasterGlobalCommUsageAggregators

Register reducer to be reduced in the next worker computation, using given name and operations, starting globally from globalInitialValue. (globalInitialValue is reduced only once, each worker will still start from neutral initial value)

Specified by:

registerReducer in interface MasterGlobalCommUsageAggregators

Type Parameters:

S - Single value type

R - Reduced value type

Parameters:

name - Name of the reducer

reduceOp - Reduce operations

globalInitialValue - Global initial value

getReduced

public <R extends org.apache.hadoop.io.Writable> R getReduced(String name)

Description copied from interface: MasterGlobalCommUsageAggregators

Get reduced value from previous worker computation.

Specified by:

getReduced in interface MasterGlobalCommUsageAggregators

Type Parameters:

R - Reduced value type

Parameters:

name - Name of the reducer

Returns:

Reduced value

broadcast

public void broadcast(String name,
                      org.apache.hadoop.io.Writable value)

Description copied from interface: MasterGlobalCommUsageAggregators

Broadcast given value to all workers for next computation.

Specified by:

broadcast in interface MasterGlobalCommUsageAggregators

Parameters:

name - Name of the broadcast object

value - Value

receivedPartitionStats

public void receivedPartitionStats(List<PartitionStats> partitionStats)

Received partition stats from a worker

Parameters:

partitionStats - Partition stats

getAllPartitionStats

public Iterable<PartitionStats> getAllPartitionStats(int numWorkers,
                                                     org.apache.hadoop.util.Progressable progressable)

Get all partition stats. Blocks until all workers have sent their stats

Parameters:

numWorkers - Number of workers to wait for

progressable - Progressable to report progress to

Returns:

All partition stats