org.apache.giraph.comm.netty

Class NettyWorkerAggregatorRequestProcessor

java.lang.Object

org.apache.giraph.comm.netty.NettyWorkerAggregatorRequestProcessor

All Implemented Interfaces:

WorkerAggregatorRequestProcessor

public class NettyWorkerAggregatorRequestProcessor
extends Object
implements WorkerAggregatorRequestProcessor

Netty implementation of WorkerAggregatorRequestProcessor

Constructor Summary

Constructors

Constructor and Description
NettyWorkerAggregatorRequestProcessor(org.apache.hadoop.util.Progressable progressable, ImmutableClassesGiraphConfiguration<?,?,?> configuration, CentralizedServiceWorker<?,?,?> serviceWorker) Constructor.

Method Summary

Modifier and Type	Method and Description
void	distributeReducedValues(Iterable<byte[]> aggregatorDataList) Sends reduced values to all other workers
void	flush() Flush aggregated values cache.
boolean	sendReducedValue(String name, org.apache.hadoop.io.Writable reducedValue) Sends worker reduced value to the owner of reducer
void	sendReducedValuesToMaster(byte[] data) Sends reduced values to the master.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

NettyWorkerAggregatorRequestProcessor

public NettyWorkerAggregatorRequestProcessor(org.apache.hadoop.util.Progressable progressable,
                                             ImmutableClassesGiraphConfiguration<?,?,?> configuration,
                                             CentralizedServiceWorker<?,?,?> serviceWorker)

Constructor.

Parameters:

progressable - Progressable used to report progress

configuration - Configuration

serviceWorker - Service worker

Method Detail

sendReducedValue

public boolean sendReducedValue(String name,
                                org.apache.hadoop.io.Writable reducedValue)
                         throws IOException

Description copied from interface: WorkerAggregatorRequestProcessor

Sends worker reduced value to the owner of reducer

Specified by:

sendReducedValue in interface WorkerAggregatorRequestProcessor

Parameters:

name - Name of the reducer

reducedValue - Reduced partial value

Returns:

True if reduced value will be sent, false if this worker is the owner of the reducer

Throws:

IOException

flush

public void flush()
           throws IOException

Description copied from interface: WorkerAggregatorRequestProcessor

Flush aggregated values cache.

Specified by:

flush in interface WorkerAggregatorRequestProcessor

Throws:

IOException

sendReducedValuesToMaster

public void sendReducedValuesToMaster(byte[] data)
                               throws IOException

Description copied from interface: WorkerAggregatorRequestProcessor

Sends reduced values to the master. This worker is the owner of these reducers.

Specified by:

sendReducedValuesToMaster in interface WorkerAggregatorRequestProcessor

Parameters:

data - Serialized reduced values data

Throws:

IOException

distributeReducedValues

public void distributeReducedValues(Iterable<byte[]> aggregatorDataList)
                             throws IOException

Description copied from interface: WorkerAggregatorRequestProcessor

Sends reduced values to all other workers

Specified by:

distributeReducedValues in interface WorkerAggregatorRequestProcessor

Parameters:

aggregatorDataList - Serialized reduced values data split into chunks

Throws:

IOException