org.apache.giraph.io.formats

Class TextEdgeInputFormat<I extends org.apache.hadoop.io.WritableComparable,E extends org.apache.hadoop.io.Writable>

java.lang.Object

org.apache.giraph.conf.DefaultImmutableClassesGiraphConfigurable<I,V,E>

org.apache.giraph.io.GiraphInputFormat<I,org.apache.hadoop.io.Writable,E>

org.apache.giraph.io.EdgeInputFormat<I,E>

org.apache.giraph.io.formats.TextEdgeInputFormat<I,E>

Type Parameters:

I - Vertex id

E - Edge data

All Implemented Interfaces:

GiraphConfigurationSettable<I,org.apache.hadoop.io.Writable,E>, ImmutableClassesGiraphConfigurable<I,org.apache.hadoop.io.Writable,E>

Direct Known Subclasses:

IntNullTextEdgeInputFormat

public abstract class TextEdgeInputFormat<I extends org.apache.hadoop.io.WritableComparable,E extends org.apache.hadoop.io.Writable>
extends EdgeInputFormat<I,E>

Abstract class that users should subclass to use their own text based edge output format.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
protected class	TextEdgeInputFormat.TextEdgeReader EdgeReader for TextEdgeInputFormat.
protected class	TextEdgeInputFormat.TextEdgeReaderFromEachLine Abstract class to be implemented by the user to read an edge from each text line.
protected class	TextEdgeInputFormat.TextEdgeReaderFromEachLineProcessed<T> Abstract class to be implemented by the user to read an edge from each text line after preprocessing it.

Field Summary

Fields

Modifier and Type	Field and Description
protected GiraphTextInputFormat	textInputFormat Underlying GiraphTextInputFormat.

Constructor Summary

Constructors

Constructor and Description
TextEdgeInputFormat()

Method Summary

Modifier and Type	Method and Description
void	checkInputSpecs(org.apache.hadoop.conf.Configuration conf) Check that input is valid.
List<org.apache.hadoop.mapreduce.InputSplit>	getSplits(org.apache.hadoop.mapreduce.JobContext context, int minSplitCountHint) Get the list of input splits for the format.

Methods inherited from class org.apache.giraph.io.EdgeInputFormat

createEdgeReader

Methods inherited from class org.apache.giraph.io.GiraphInputFormat

readInputSplit, writeInputSplit

Methods inherited from class org.apache.giraph.conf.DefaultImmutableClassesGiraphConfigurable

getConf, setConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

textInputFormat

protected GiraphTextInputFormat textInputFormat

Underlying GiraphTextInputFormat.

Constructor Detail

TextEdgeInputFormat

public TextEdgeInputFormat()

Method Detail

checkInputSpecs

public void checkInputSpecs(org.apache.hadoop.conf.Configuration conf)

Description copied from class: GiraphInputFormat

Check that input is valid.

Specified by:

checkInputSpecs in class GiraphInputFormat<I extends org.apache.hadoop.io.WritableComparable,org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

Parameters:

conf - Configuration

getSplits

public List<org.apache.hadoop.mapreduce.InputSplit> getSplits(org.apache.hadoop.mapreduce.JobContext context,
                                                              int minSplitCountHint)
                                                       throws IOException,
                                                              InterruptedException

Description copied from class: GiraphInputFormat

Get the list of input splits for the format.

Specified by:

getSplits in class GiraphInputFormat<I extends org.apache.hadoop.io.WritableComparable,org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

Parameters:

context - The job context

minSplitCountHint - Minimum number of splits to create (hint)

Returns:

The list of input splits

Throws:

IOException

InterruptedException