org.apache.giraph.io

Class GiraphInputFormat<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

java.lang.Object

org.apache.giraph.conf.DefaultImmutableClassesGiraphConfigurable<I,V,E>

org.apache.giraph.io.GiraphInputFormat<I,V,E>

Type Parameters:

I - Vertex id

V - Vertex data

E - Edge data

All Implemented Interfaces:

GiraphConfigurationSettable<I,V,E>, ImmutableClassesGiraphConfigurable<I,V,E>

Direct Known Subclasses:

EdgeInputFormat, MappingInputFormat, VertexInputFormat

public abstract class GiraphInputFormat<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>
extends DefaultImmutableClassesGiraphConfigurable<I,V,E>

Common interface for VertexInputFormat and EdgeInputFormat.

Constructor Summary

Constructors

Constructor and Description
GiraphInputFormat()

Method Summary

Modifier and Type	Method and Description
abstract void	checkInputSpecs(org.apache.hadoop.conf.Configuration conf) Check that input is valid.
abstract List<org.apache.hadoop.mapreduce.InputSplit>	getSplits(org.apache.hadoop.mapreduce.JobContext context, int minSplitCountHint) Get the list of input splits for the format.
org.apache.hadoop.mapreduce.InputSplit	readInputSplit(DataInput dataInput) Read input split info from DataInput.
void	writeInputSplit(org.apache.hadoop.mapreduce.InputSplit inputSplit, DataOutput dataOutput) Write input split info to DataOutput.

Methods inherited from class org.apache.giraph.conf.DefaultImmutableClassesGiraphConfigurable

getConf, setConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

GiraphInputFormat

public GiraphInputFormat()

Method Detail

checkInputSpecs

public abstract void checkInputSpecs(org.apache.hadoop.conf.Configuration conf)

Check that input is valid.

Parameters:

conf - Configuration

getSplits

public abstract List<org.apache.hadoop.mapreduce.InputSplit> getSplits(org.apache.hadoop.mapreduce.JobContext context,
                                                                       int minSplitCountHint)
                                                                throws IOException,
                                                                       InterruptedException

Get the list of input splits for the format.

Parameters:

context - The job context

minSplitCountHint - Minimum number of splits to create (hint)

Returns:

The list of input splits

Throws:

IOException

InterruptedException

writeInputSplit

public void writeInputSplit(org.apache.hadoop.mapreduce.InputSplit inputSplit,
                            DataOutput dataOutput)
                     throws IOException

Write input split info to DataOutput.

Parameters:

inputSplit - InputSplit

dataOutput - DataOutput

Throws:

IOException

readInputSplit

public org.apache.hadoop.mapreduce.InputSplit readInputSplit(DataInput dataInput)
                                                      throws IOException,
                                                             ClassNotFoundException

Read input split info from DataInput.

Parameters:

dataInput - DataInput

Returns:

InputSplit

Throws:

IOException

ClassNotFoundException