org.apache.giraph.worker

Class EdgeInputSplitsCallable<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

java.lang.Object

org.apache.giraph.worker.InputSplitsCallable<I,V,E>

org.apache.giraph.worker.EdgeInputSplitsCallable<I,V,E>

Type Parameters:

I - Vertex id

V - Vertex value

E - Edge value

All Implemented Interfaces:

Callable<VertexEdgeCount>

public class EdgeInputSplitsCallable<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>
extends InputSplitsCallable<I,V,E>

Load as many edge input splits as possible. Every thread will has its own instance of WorkerClientRequestProcessor to send requests.

Field Summary

Fields

Modifier and Type	Field and Description
static int	EDGES_FILTERED_UPDATE_PERIOD How often to update filtered metrics
static int	EDGES_UPDATE_PERIOD How often to update metrics and print info

Fields inherited from class org.apache.giraph.worker.InputSplitsCallable

configuration, context, workerClientRequestProcessor

Constructor Summary

Constructors

Constructor and Description
EdgeInputSplitsCallable(EdgeInputFormat<I,E> edgeInputFormat, org.apache.hadoop.mapreduce.Mapper.Context context, ImmutableClassesGiraphConfiguration<I,V,E> configuration, BspServiceWorker<I,V,E> bspServiceWorker, WorkerInputSplitsHandler splitsHandler) Constructor.

Method Summary

Modifier and Type	Method and Description
EdgeInputFormat<I,E>	getInputFormat() Get input format
InputType	getInputType() Get input type
protected VertexEdgeCount	readInputSplit(org.apache.hadoop.mapreduce.InputSplit inputSplit) Read edges from input split.

Methods inherited from class org.apache.giraph.worker.InputSplitsCallable

call, getInputSplit, getTotalEdgesFilteredCounter, getTotalEdgesLoadedMeter, getTotalVerticesFilteredCounter, getTotalVerticesLoadedMeter, initMetrics

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

EDGES_UPDATE_PERIOD

public static final int EDGES_UPDATE_PERIOD

How often to update metrics and print info

See Also:

Constant Field Values

EDGES_FILTERED_UPDATE_PERIOD

public static final int EDGES_FILTERED_UPDATE_PERIOD

How often to update filtered metrics

See Also:

Constant Field Values

Constructor Detail

EdgeInputSplitsCallable

public EdgeInputSplitsCallable(EdgeInputFormat<I,E> edgeInputFormat,
                               org.apache.hadoop.mapreduce.Mapper.Context context,
                               ImmutableClassesGiraphConfiguration<I,V,E> configuration,
                               BspServiceWorker<I,V,E> bspServiceWorker,
                               WorkerInputSplitsHandler splitsHandler)

Constructor.

Parameters:

edgeInputFormat - Edge input format

context - Context

configuration - Configuration

bspServiceWorker - service worker

splitsHandler - Handler for input splits

Method Detail

getInputFormat

public EdgeInputFormat<I,E> getInputFormat()

Description copied from class: InputSplitsCallable

Get input format

Specified by:

getInputFormat in class InputSplitsCallable<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

Returns:

Input format

getInputType

public InputType getInputType()

Description copied from class: InputSplitsCallable

Get input type

Specified by:

getInputType in class InputSplitsCallable<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

Returns:

Input type

readInputSplit

protected VertexEdgeCount readInputSplit(org.apache.hadoop.mapreduce.InputSplit inputSplit)
                                  throws IOException,
                                         InterruptedException

Read edges from input split. If testing, the user may request a maximum number of edges to be read from an input split.

Specified by:

readInputSplit in class InputSplitsCallable<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

Parameters:

inputSplit - Input split to process with edge reader

Returns:

Edges loaded from this input split

Throws:

IOException

InterruptedException