org.apache.giraph.partition

Interface WorkerGraphPartitioner<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

Type Parameters:

I - Vertex id

V - Vertex value

E - Edge value

All Known Implementing Classes:

WorkerGraphPartitionerImpl

public interface WorkerGraphPartitioner<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

Stores the PartitionOwner objects from the master and provides the mapping of vertex to PartitionOwner. Also generates the partition owner implementation.

Method Summary

Modifier and Type	Method and Description
PartitionOwner	createPartitionOwner() Instantiate the PartitionOwner implementation used to read the master assignments.
Collection<PartitionStats>	finalizePartitionStats(Collection<PartitionStats> workerPartitionStats, PartitionStore<I,V,E> partitionStore) At the end of a superstep, workers have PartitionStats generated for each of their partitions.
PartitionOwner	getPartitionOwner(I vertexId) Figure out the owner of a vertex
Collection<? extends PartitionOwner>	getPartitionOwners() Get a collection of the PartitionOwner objects.
PartitionExchange	updatePartitionOwners(WorkerInfo myWorkerInfo, Collection<? extends PartitionOwner> masterSetPartitionOwners) Get the partitions owners and update locally.

Method Detail

createPartitionOwner

PartitionOwner createPartitionOwner()

Instantiate the PartitionOwner implementation used to read the master assignments.

Returns:

Instantiated PartitionOwner object

getPartitionOwner

PartitionOwner getPartitionOwner(I vertexId)

Figure out the owner of a vertex

Parameters:

vertexId - Vertex id to get the partition for

Returns:

Correct partition owner

finalizePartitionStats

Collection<PartitionStats> finalizePartitionStats(Collection<PartitionStats> workerPartitionStats,
                                                  PartitionStore<I,V,E> partitionStore)

At the end of a superstep, workers have PartitionStats generated for each of their partitions. This method will allow the user to modify or create their own PartitionStats interfaces to send to the master.

Parameters:

workerPartitionStats - Stats generated by the infrastructure during the superstep

partitionStore - Partition store for this worker (could be used to provide more useful stat information)

Returns:

Final partition stats

updatePartitionOwners

PartitionExchange updatePartitionOwners(WorkerInfo myWorkerInfo,
                                        Collection<? extends PartitionOwner> masterSetPartitionOwners)

Get the partitions owners and update locally. Returns the partitions to send to other workers and other dependencies.

Parameters:

myWorkerInfo - Worker info.

masterSetPartitionOwners - Master set partition owners, received prior to beginning the superstep

Returns:

Information for the partition exchange.

getPartitionOwners

Collection<? extends PartitionOwner> getPartitionOwners()

Get a collection of the PartitionOwner objects.

Returns:

Collection of owners for every partition.