org.apache.giraph.partition

Class PartitionBalancer

java.lang.Object

org.apache.giraph.partition.PartitionBalancer

public class PartitionBalancer
extends Object

Helper class for balancing partitions across a set of workers.

Field Summary

Fields

Modifier and Type	Field and Description
static String	EGDE_BALANCE_ALGORITHM Rebalance across supersteps by edges
static String	PARTITION_BALANCE_ALGORITHM Partition balancing algorithm
static String	STATIC_BALANCE_ALGORITHM No rebalancing during the supersteps
static String	VERTICES_BALANCE_ALGORITHM Rebalance across supersteps by vertices

Method Summary

Modifier and Type	Method and Description
static Collection<PartitionOwner>	balancePartitionsAcrossWorkers(org.apache.hadoop.conf.Configuration conf, Collection<PartitionOwner> partitionOwners, Collection<PartitionStats> allPartitionStats, Collection<WorkerInfo> availableWorkerInfos) Balance the partitions with an algorithm based on a value.
static PartitionExchange	updatePartitionOwners(List<PartitionOwner> partitionOwnerList, WorkerInfo myWorkerInfo, Collection<? extends PartitionOwner> masterSetPartitionOwners) Helper function to update partition owners and determine which partitions need to be sent from a specific worker.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

PARTITION_BALANCE_ALGORITHM

public static final String PARTITION_BALANCE_ALGORITHM

Partition balancing algorithm

See Also:

Constant Field Values

STATIC_BALANCE_ALGORITHM

public static final String STATIC_BALANCE_ALGORITHM

No rebalancing during the supersteps

See Also:

Constant Field Values

EGDE_BALANCE_ALGORITHM

public static final String EGDE_BALANCE_ALGORITHM

Rebalance across supersteps by edges

See Also:

Constant Field Values

VERTICES_BALANCE_ALGORITHM

public static final String VERTICES_BALANCE_ALGORITHM

Rebalance across supersteps by vertices

See Also:

Constant Field Values

Method Detail

balancePartitionsAcrossWorkers

public static Collection<PartitionOwner> balancePartitionsAcrossWorkers(org.apache.hadoop.conf.Configuration conf,
                                                                        Collection<PartitionOwner> partitionOwners,
                                                                        Collection<PartitionStats> allPartitionStats,
                                                                        Collection<WorkerInfo> availableWorkerInfos)

Balance the partitions with an algorithm based on a value.

Parameters:

conf - Configuration to find the algorithm

partitionOwners - All the owners of all partitions

allPartitionStats - All the partition stats

availableWorkerInfos - All the available workers

Returns:

Balanced partition owners

updatePartitionOwners

public static PartitionExchange updatePartitionOwners(List<PartitionOwner> partitionOwnerList,
                                                      WorkerInfo myWorkerInfo,
                                                      Collection<? extends PartitionOwner> masterSetPartitionOwners)

Helper function to update partition owners and determine which partitions need to be sent from a specific worker.

Parameters:

partitionOwnerList - Local PartitionOwner list for the given worker

myWorkerInfo - Worker info

masterSetPartitionOwners - Master set partition owners, received prior to beginning the superstep

Returns:

Information for the partition exchange.