org.apache.giraph.worker

Class WorkerAggregatorHandler

java.lang.Object

org.apache.giraph.worker.WorkerAggregatorHandler

All Implemented Interfaces:

WorkerBroadcastUsage, WorkerGlobalCommUsage, WorkerReduceUsage, WorkerThreadGlobalCommUsage

public class WorkerAggregatorHandler
extends Object
implements WorkerThreadGlobalCommUsage

Handler for reduce/broadcast on the workers

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
class	WorkerAggregatorHandler.ThreadLocalWorkerGlobalCommUsage Not thread-safe implementation of WorkerThreadGlobalCommUsage.

Constructor Summary

Constructors

Constructor and Description
WorkerAggregatorHandler(CentralizedServiceWorker<?,?,?> serviceWorker, ImmutableClassesGiraphConfiguration conf, org.apache.hadoop.util.Progressable progressable) Constructor

Method Summary

Modifier and Type	Method and Description
void	finishSuperstep(WorkerAggregatorRequestProcessor requestProcessor) Send aggregators to their owners and in the end to the master
void	finishThreadComputation() Call this after thread's computation is finished, i.e.
<B extends org.apache.hadoop.io.Writable> B	getBroadcast(String name) Get value broadcasted from master
Set<Integer>	getOtherWorkerIdsSet() Get set of all worker task ids except the current one
WorkerThreadGlobalCommUsage	newThreadAggregatorUsage() Create new aggregator usage which will be used by one of the compute threads.
void	prepareSuperstep(WorkerAggregatorRequestProcessor requestProcessor) Prepare aggregators for current superstep
void	reduce(String name, Object value) Reduce given value.
void	reduceMerge(String name, org.apache.hadoop.io.Writable valueToReduce) Combine partially reduced value into currently reduced value.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

WorkerAggregatorHandler

public WorkerAggregatorHandler(CentralizedServiceWorker<?,?,?> serviceWorker,
                               ImmutableClassesGiraphConfiguration conf,
                               org.apache.hadoop.util.Progressable progressable)

Constructor

Parameters:

serviceWorker - Service worker

conf - Giraph configuration

progressable - Progressable for reporting progress

Method Detail

getBroadcast

public <B extends org.apache.hadoop.io.Writable> B getBroadcast(String name)

Description copied from interface: WorkerBroadcastUsage

Get value broadcasted from master

Specified by:

getBroadcast in interface WorkerBroadcastUsage

Type Parameters:

B - Broadcast value type

Parameters:

name - Name of the broadcasted value

Returns:

Broadcasted value

reduce

public void reduce(String name,
                   Object value)

Description copied from interface: WorkerReduceUsage

Reduce given value.

Specified by:

reduce in interface WorkerReduceUsage

Parameters:

name - Name of the reducer

value - Single value to reduce

reduceMerge

public void reduceMerge(String name,
                        org.apache.hadoop.io.Writable valueToReduce)

Combine partially reduced value into currently reduced value.

Specified by:

reduceMerge in interface WorkerReduceUsage

Parameters:

name - Name of the reducer

valueToReduce - Partial value to reduce

prepareSuperstep

public void prepareSuperstep(WorkerAggregatorRequestProcessor requestProcessor)

Prepare aggregators for current superstep

Parameters:

requestProcessor - Request processor for aggregators

finishSuperstep

public void finishSuperstep(WorkerAggregatorRequestProcessor requestProcessor)

Send aggregators to their owners and in the end to the master

Parameters:

requestProcessor - Request processor for aggregators

newThreadAggregatorUsage

public WorkerThreadGlobalCommUsage newThreadAggregatorUsage()

Create new aggregator usage which will be used by one of the compute threads.

Returns:

New aggregator usage

finishThreadComputation

public void finishThreadComputation()

Description copied from interface: WorkerThreadGlobalCommUsage

Call this after thread's computation is finished, i.e. when all vertices have provided their values to aggregators

Specified by:

finishThreadComputation in interface WorkerThreadGlobalCommUsage

getOtherWorkerIdsSet

public Set<Integer> getOtherWorkerIdsSet()

Get set of all worker task ids except the current one

Returns:

Set of all other worker task ids