org.apache.giraph.worker

Class MappingInputSplitsCallable<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable,B extends org.apache.hadoop.io.Writable>

java.lang.Object

org.apache.giraph.worker.InputSplitsCallable<I,V,E>

org.apache.giraph.worker.MappingInputSplitsCallable<I,V,E,B>

Type Parameters:

I - vertexId type

V - vertexValue type

E - edgeValue type

B - mappingTarget type

All Implemented Interfaces:

Callable<VertexEdgeCount>

public class MappingInputSplitsCallable<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable,B extends org.apache.hadoop.io.Writable>
extends InputSplitsCallable<I,V,E>

Load as many mapping input splits as possible. Every thread will has its own instance of WorkerClientRequestProcessor to send requests.

Field Summary

Fields inherited from class org.apache.giraph.worker.InputSplitsCallable

configuration, context, workerClientRequestProcessor

Constructor Summary

Constructors

Constructor and Description
MappingInputSplitsCallable(MappingInputFormat<I,V,E,B> mappingInputFormat, org.apache.hadoop.mapreduce.Mapper.Context context, ImmutableClassesGiraphConfiguration<I,V,E> configuration, BspServiceWorker<I,V,E> bspServiceWorker, WorkerInputSplitsHandler splitsHandler) Constructor

Method Summary

Modifier and Type	Method and Description
GiraphInputFormat	getInputFormat() Get input format
InputType	getInputType() Get input type
protected VertexEdgeCount	readInputSplit(org.apache.hadoop.mapreduce.InputSplit inputSplit) Load vertices/edges from the given input split.

Methods inherited from class org.apache.giraph.worker.InputSplitsCallable

call, getInputSplit, getTotalEdgesFilteredCounter, getTotalEdgesLoadedMeter, getTotalVerticesFilteredCounter, getTotalVerticesLoadedMeter, initMetrics

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

MappingInputSplitsCallable

public MappingInputSplitsCallable(MappingInputFormat<I,V,E,B> mappingInputFormat,
                                  org.apache.hadoop.mapreduce.Mapper.Context context,
                                  ImmutableClassesGiraphConfiguration<I,V,E> configuration,
                                  BspServiceWorker<I,V,E> bspServiceWorker,
                                  WorkerInputSplitsHandler splitsHandler)

Constructor

Parameters:

mappingInputFormat - mappingInputFormat

context - Context

configuration - Configuration

bspServiceWorker - bsp service worker

splitsHandler - Splits handler

Method Detail

getInputFormat

public GiraphInputFormat getInputFormat()

Description copied from class: InputSplitsCallable

Get input format

Specified by:

getInputFormat in class InputSplitsCallable<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

Returns:

Input format

getInputType

public InputType getInputType()

Description copied from class: InputSplitsCallable

Get input type

Specified by:

getInputType in class InputSplitsCallable<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

Returns:

Input type

readInputSplit

protected VertexEdgeCount readInputSplit(org.apache.hadoop.mapreduce.InputSplit inputSplit)
                                  throws IOException,
                                         InterruptedException

Description copied from class: InputSplitsCallable

Load vertices/edges from the given input split.

Specified by:

readInputSplit in class InputSplitsCallable<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

Parameters:

inputSplit - Input split to load

Returns:

Count of vertices and edges loaded

Throws:

IOException

InterruptedException