org.apache.giraph.partition

Class LongMappingStorePartitionerFactory<V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

java.lang.Object

org.apache.giraph.conf.DefaultImmutableClassesGiraphConfigurable<I,V,E>

org.apache.giraph.partition.GraphPartitionerFactory<org.apache.hadoop.io.LongWritable,V,E>

org.apache.giraph.partition.LongMappingStorePartitionerFactory<V,E>

Type Parameters:

V - vertexValue type

E - edgeValue type

All Implemented Interfaces:

GiraphConfigurationSettable<org.apache.hadoop.io.LongWritable,V,E>, ImmutableClassesGiraphConfigurable<org.apache.hadoop.io.LongWritable,V,E>, GraphPartitionerFactoryInterface<org.apache.hadoop.io.LongWritable,V,E>

public class LongMappingStorePartitionerFactory<V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>
extends GraphPartitionerFactory<org.apache.hadoop.io.LongWritable,V,E>

Factory for long-byte mapping based partitioners.

Field Summary

Fields

Modifier and Type	Field and Description
protected LocalData<org.apache.hadoop.io.LongWritable,V,E,? extends org.apache.hadoop.io.Writable>	localData Local Data that supplies the mapping store

Constructor Summary

Constructors

Constructor and Description
LongMappingStorePartitionerFactory()

Method Summary

Modifier and Type	Method and Description
int	getPartition(org.apache.hadoop.io.LongWritable id, int partitionCount, int workerCount) Calculates in which partition current vertex belongs to, from interval [0, partitionCount).
int	getWorker(int partition, int partitionCount, int workerCount) Calculates worker that should be responsible for passed partition.
void	initialize(LocalData<org.apache.hadoop.io.LongWritable,V,E,? extends org.apache.hadoop.io.Writable> localData) Use some local data present in the worker

Methods inherited from class org.apache.giraph.partition.GraphPartitionerFactory

createMasterGraphPartitioner, createWorkerGraphPartitioner, getPartitionInRange, getPartitionInRange

Methods inherited from class org.apache.giraph.conf.DefaultImmutableClassesGiraphConfigurable

getConf, setConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.giraph.conf.ImmutableClassesGiraphConfigurable

getConf

Methods inherited from interface org.apache.giraph.conf.GiraphConfigurationSettable

setConf

Field Detail

localData

protected LocalData<org.apache.hadoop.io.LongWritable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable,? extends org.apache.hadoop.io.Writable> localData

Local Data that supplies the mapping store

Constructor Detail

LongMappingStorePartitionerFactory

public LongMappingStorePartitionerFactory()

Method Detail

initialize

public void initialize(LocalData<org.apache.hadoop.io.LongWritable,V,E,? extends org.apache.hadoop.io.Writable> localData)

Description copied from interface: GraphPartitionerFactoryInterface

Use some local data present in the worker

Specified by:

initialize in interface GraphPartitionerFactoryInterface<org.apache.hadoop.io.LongWritable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

Overrides:

initialize in class GraphPartitionerFactory<org.apache.hadoop.io.LongWritable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

Parameters:

localData - localData present in the worker

getPartition

public int getPartition(org.apache.hadoop.io.LongWritable id,
                        int partitionCount,
                        int workerCount)

Description copied from class: GraphPartitionerFactory

Calculates in which partition current vertex belongs to, from interval [0, partitionCount).

Specified by:

getPartition in class GraphPartitionerFactory<org.apache.hadoop.io.LongWritable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

Parameters:

id - Vertex id

partitionCount - Number of partitions

workerCount - Number of workers

Returns:

partition

getWorker

public int getWorker(int partition,
                     int partitionCount,
                     int workerCount)

Description copied from class: GraphPartitionerFactory

Calculates worker that should be responsible for passed partition.

Specified by:

getWorker in class GraphPartitionerFactory<org.apache.hadoop.io.LongWritable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

Parameters:

partition - Current partition

partitionCount - Number of partitions

workerCount - Number of workers

Returns:

index of worker responsible for current partition