org.apache.giraph.comm

Class SendDataCache<D>

java.lang.Object

org.apache.giraph.comm.SendDataCache<D>

Type Parameters:

D - Data type of partition cache

Direct Known Subclasses:

SendPartitionCache, SendVertexIdDataCache

@NotThreadSafe
public abstract class SendDataCache<D>
extends Object

An abstract structure for caching data by partitions to be sent to workers in bulk. Not thread-safe.

Constructor Summary

Constructors

Constructor and Description
SendDataCache(ImmutableClassesGiraphConfiguration conf, CentralizedServiceWorker<?,?,?> serviceWorker, int maxRequestSize, float additionalRequestSize) Constructor.

Method Summary

Modifier and Type	Method and Description
ImmutableClassesGiraphConfiguration	getConf()
D	getData(int partitionId) Get the data cache for a partition id
int	getInitialBufferSize(int partitionId) Get initial buffer size of a partition.
protected int	getNumWorkers()
protected int	getSendWorkerInitialBufferSize(int taskId) Get the initial buffer size for the messages sent to a worker.
protected CentralizedServiceWorker	getServiceWorker() Get the service worker.
protected Map<WorkerInfo,List<Integer>>	getWorkerPartitions()
int	incrDataSize(int partitionId, int size) Increment the data size
PairList<WorkerInfo,PairList<Integer,D>>	removeAllData() Gets all the data and removes it from the cache.
PairList<Integer,D>	removeWorkerData(WorkerInfo workerInfo) Gets the data for a worker and removes it from the cache.
void	setData(int partitionId, D data) Set the data cache for a partition id

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SendDataCache

public SendDataCache(ImmutableClassesGiraphConfiguration conf,
                     CentralizedServiceWorker<?,?,?> serviceWorker,
                     int maxRequestSize,
                     float additionalRequestSize)

Constructor.

Parameters:

conf - Giraph configuration

serviceWorker - Service worker

maxRequestSize - Maximum request size (in bytes)

additionalRequestSize - Additional request size (expressed as a ratio of the average request size)

Method Detail

removeWorkerData

public PairList<Integer,D> removeWorkerData(WorkerInfo workerInfo)

Gets the data for a worker and removes it from the cache.

Parameters:

workerInfo - the address of the worker who owns the data partitions that are receiving the data

Returns:

List of pairs (partitionId, ByteArrayVertexIdData), where all partition ids belong to workerInfo

removeAllData

public PairList<WorkerInfo,PairList<Integer,D>> removeAllData()

Gets all the data and removes it from the cache.

Returns:

All data for all vertices for all partitions

getData

public D getData(int partitionId)

Get the data cache for a partition id

Parameters:

partitionId - Partition id

Returns:

Data cache for a partition

setData

public void setData(int partitionId,
                    D data)

Set the data cache for a partition id

Parameters:

partitionId - Partition id

data - Data to be set for a partition id

getInitialBufferSize

public int getInitialBufferSize(int partitionId)

Get initial buffer size of a partition.

Parameters:

partitionId - Partition id

Returns:

Initial buffer size of a partition

incrDataSize

public int incrDataSize(int partitionId,
                        int size)

Increment the data size

Parameters:

partitionId - Partition id

size - Size to increment by

Returns:

new data size

getConf

public ImmutableClassesGiraphConfiguration getConf()

getServiceWorker

protected CentralizedServiceWorker getServiceWorker()

Get the service worker.

Returns:

CentralizedServiceWorker

getSendWorkerInitialBufferSize

protected int getSendWorkerInitialBufferSize(int taskId)

Get the initial buffer size for the messages sent to a worker.

Parameters:

taskId - The task ID of a worker.

Returns:

The initial buffer size for a worker.

getNumWorkers

protected int getNumWorkers()

getWorkerPartitions

protected Map<WorkerInfo,List<Integer>> getWorkerPartitions()