org.apache.giraph.comm.aggregators

Class SendGlobalCommCache

java.lang.Object

org.apache.giraph.comm.aggregators.CountingCache

org.apache.giraph.comm.aggregators.SendGlobalCommCache

public class SendGlobalCommCache
extends CountingCache

Takes and serializes global communication values and keeps them grouped by owner partition id, to be sent in bulk. Includes broadcast messages, reducer registrations and special count.

Constructor Summary

Constructors

Constructor and Description
SendGlobalCommCache(boolean writeClass) Constructor

Method Summary

Modifier and Type	Method and Description
void	addSpecialCount(Integer taskId) Creates special value which will hold the total number of global communication requests for worker with selected task id.
int	addValue(Integer taskId, String name, GlobalCommType type, org.apache.hadoop.io.Writable value) Add global communication value to the cache
byte[]	removeSerialized(Integer taskId) Remove and get values for certain worker

Methods inherited from class org.apache.giraph.comm.aggregators.CountingCache

getCount, incrementCounter, reset

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SendGlobalCommCache

public SendGlobalCommCache(boolean writeClass)

Constructor

Parameters:

writeClass - boolean whether to write Class object for values

Method Detail

addValue

public int addValue(Integer taskId,
                    String name,
                    GlobalCommType type,
                    org.apache.hadoop.io.Writable value)
             throws IOException

Add global communication value to the cache

Parameters:

taskId - Task id of worker which owns the value

name - Name

type - Global communication type

value - Value

Returns:

Number of bytes in serialized data for this worker

Throws:

IOException

removeSerialized

public byte[] removeSerialized(Integer taskId)

Remove and get values for certain worker

Parameters:

taskId - Partition id of worker owner

Returns:

Serialized global communication data for this worker

addSpecialCount

public void addSpecialCount(Integer taskId)
                     throws IOException

Creates special value which will hold the total number of global communication requests for worker with selected task id. This should be called after all values for the worker have been added to the cache.

Parameters:

taskId - Destination worker's task id

Throws:

IOException