org.apache.giraph.comm

Class SendEdgeCache<I extends org.apache.hadoop.io.WritableComparable,E extends org.apache.hadoop.io.Writable>

java.lang.Object

org.apache.giraph.comm.SendDataCache<B>

org.apache.giraph.comm.SendVertexIdDataCache<I,Edge<I,E>,VertexIdEdges<I,E>>

org.apache.giraph.comm.SendEdgeCache<I,E>

Type Parameters:

I - Vertex id

E - Edge value

public class SendEdgeCache<I extends org.apache.hadoop.io.WritableComparable,E extends org.apache.hadoop.io.Writable>
extends SendVertexIdDataCache<I,Edge<I,E>,VertexIdEdges<I,E>>

Aggregates the edges to be sent to workers so they can be sent in bulk. Not thread-safe.

Constructor Summary

Constructors

Constructor and Description
SendEdgeCache(ImmutableClassesGiraphConfiguration conf, CentralizedServiceWorker<?,?,?> serviceWorker) Constructor

Method Summary

Modifier and Type	Method and Description
int	addEdge(WorkerInfo workerInfo, int partitionId, I destVertexId, Edge<I,E> edge) Add an edge to the cache.
VertexIdEdges<I,E>	createVertexIdData() Create a new VertexIdData specialized for the use case.
PairList<WorkerInfo,PairList<Integer,VertexIdEdges<I,E>>>	removeAllEdges() Gets all the edges and removes them from the cache.
PairList<Integer,VertexIdEdges<I,E>>	removeWorkerEdges(WorkerInfo workerInfo) Gets the edges for a worker and removes it from the cache.

Methods inherited from class org.apache.giraph.comm.SendVertexIdDataCache

addData, addData

Methods inherited from class org.apache.giraph.comm.SendDataCache

getConf, getData, getInitialBufferSize, getNumWorkers, getSendWorkerInitialBufferSize, getServiceWorker, getWorkerPartitions, incrDataSize, removeAllData, removeWorkerData, setData

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SendEdgeCache

public SendEdgeCache(ImmutableClassesGiraphConfiguration conf,
                     CentralizedServiceWorker<?,?,?> serviceWorker)

Constructor

Parameters:

conf - Giraph configuration

serviceWorker - Service worker

Method Detail

createVertexIdData

public VertexIdEdges<I,E> createVertexIdData()

Description copied from class: SendVertexIdDataCache

Create a new VertexIdData specialized for the use case.

Specified by:

createVertexIdData in class SendVertexIdDataCache<I extends org.apache.hadoop.io.WritableComparable,Edge<I extends org.apache.hadoop.io.WritableComparable,E extends org.apache.hadoop.io.Writable>,VertexIdEdges<I extends org.apache.hadoop.io.WritableComparable,E extends org.apache.hadoop.io.Writable>>

Returns:

A new instance of VertexIdData

addEdge

public int addEdge(WorkerInfo workerInfo,
                   int partitionId,
                   I destVertexId,
                   Edge<I,E> edge)

Add an edge to the cache.

Parameters:

workerInfo - the remote worker destination

partitionId - the remote Partition this edge belongs to

destVertexId - vertex id that is ultimate destination

edge - Edge to send to remote worker

Returns:

Size of edges for the worker.

removeWorkerEdges

public PairList<Integer,VertexIdEdges<I,E>> removeWorkerEdges(WorkerInfo workerInfo)

Gets the edges for a worker and removes it from the cache.

Parameters:

workerInfo - the address of the worker who owns the data partitions that are receiving the edges

Returns:

List of pairs (partitionId, ByteArrayVertexIdEdges), where all partition ids belong to workerInfo

removeAllEdges

public PairList<WorkerInfo,PairList<Integer,VertexIdEdges<I,E>>> removeAllEdges()

Gets all the edges and removes them from the cache.

Returns:

All vertex edges for all partitions