org.apache.giraph.job

Class CombinedWorkerProgress

java.lang.Object

org.apache.giraph.worker.WorkerProgressStats

org.apache.giraph.job.CombinedWorkerProgress

@NotThreadSafe
public class CombinedWorkerProgress
extends WorkerProgressStats

Class which combines multiple workers' progresses to get overall application progress

Field Summary

Fields

Modifier and Type	Field and Description
static DecimalFormat	DECIMAL_FORMAT Decimal format which rounds numbers to two decimal places
static FloatConfOption	NORMAL_FREE_MEMORY_FRACTION If free memory fraction on some worker goes below this value, warning will be printed

Fields inherited from class org.apache.giraph.worker.WorkerProgressStats

computationDone, currentSuperstep, edgeInputSplitsLoaded, edgesLoaded, freeMemoryFraction, freeMemoryMB, loadingEdgesDone, loadingVerticesDone, lowestGraphPercentageInMemory, partitionsComputed, partitionsStored, partitionsToCompute, partitionsToStore, storingDone, taskId, vertexInputSplitsLoaded, verticesComputed, verticesLoaded, verticesStored, verticesToCompute, verticesToStore

Constructor Summary

Constructors

Constructor and Description
CombinedWorkerProgress(Iterable<WorkerProgress> workerProgresses, MasterProgress masterProgress, org.apache.hadoop.conf.Configuration conf) Constructor

Method Summary

Modifier and Type	Method and Description
long	getCurrentSuperstep() Get Current superstep
protected String	getProgressString() Get string describing total job progress
long	getVerticesComputed() Get vertices computed
long	getVerticesToCompute() Get vertices to compute
long	getWorkersInSuperstep() Get workers in superstep
boolean	isDone(int expectedWorkersDone) Is the application done
boolean	madeProgressFrom(CombinedWorkerProgress lastProgress) Check if this instance made progress from another instance
String	toString()

Methods inherited from class org.apache.giraph.worker.WorkerProgressStats

isComputeSuperstep, isInputSuperstep, isOutputSuperstep

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Detail

DECIMAL_FORMAT

public static final DecimalFormat DECIMAL_FORMAT

Decimal format which rounds numbers to two decimal places

NORMAL_FREE_MEMORY_FRACTION

public static final FloatConfOption NORMAL_FREE_MEMORY_FRACTION

If free memory fraction on some worker goes below this value, warning will be printed

Constructor Detail

CombinedWorkerProgress

public CombinedWorkerProgress(Iterable<WorkerProgress> workerProgresses,
                              MasterProgress masterProgress,
                              org.apache.hadoop.conf.Configuration conf)

Constructor

Parameters:

workerProgresses - Worker progresses to combine

masterProgress - Master progress

conf - Configuration

Method Detail

getCurrentSuperstep

public long getCurrentSuperstep()

Get Current superstep

Returns:

Current superstep

getWorkersInSuperstep

public long getWorkersInSuperstep()

Get workers in superstep

Returns:

Workers in superstep.

getVerticesComputed

public long getVerticesComputed()

Get vertices computed

Returns:

Vertices computed

getVerticesToCompute

public long getVerticesToCompute()

Get vertices to compute

Returns:

Vertices to compute

isDone

public boolean isDone(int expectedWorkersDone)

Is the application done

Parameters:

expectedWorkersDone - Number of workers which should be done in order for application to be done

Returns:

True if application is done

getProgressString

protected String getProgressString()

Get string describing total job progress

Returns:

String describing total job progress

toString

public String toString()

Overrides:

toString in class Object

madeProgressFrom

public boolean madeProgressFrom(CombinedWorkerProgress lastProgress)

Check if this instance made progress from another instance

Parameters:

lastProgress - Instance to compare with

Returns:

True iff progress was made