org.apache.giraph.io.formats

Class TextVertexValueInputFormat<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

java.lang.Object

org.apache.giraph.conf.DefaultImmutableClassesGiraphConfigurable<I,V,E>

org.apache.giraph.io.GiraphInputFormat<I,V,E>

org.apache.giraph.io.VertexInputFormat<I,V,org.apache.hadoop.io.Writable>

org.apache.giraph.io.VertexValueInputFormat<I,V>

org.apache.giraph.io.formats.TextVertexValueInputFormat<I,V,E>

Type Parameters:

I - Vertex index value

V - Vertex value

E - Edge value

All Implemented Interfaces:

GiraphConfigurationSettable<I,V,org.apache.hadoop.io.Writable>, ImmutableClassesGiraphConfigurable<I,V,org.apache.hadoop.io.Writable>

Direct Known Subclasses:

IntIntTextVertexValueInputFormat

public abstract class TextVertexValueInputFormat<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>
extends VertexValueInputFormat<I,V>

Abstract class that users should subclass to use their own text based vertex value input format.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
protected class	TextVertexValueInputFormat.TextVertexValueReader VertexValueReader for VertexValueInputFormat.
protected class	TextVertexValueInputFormat.TextVertexValueReaderFromEachLine Abstract class to be implemented by the user to read a vertex value from each text line.
protected class	TextVertexValueInputFormat.TextVertexValueReaderFromEachLineProcessed<T> Abstract class to be implemented by the user to read a vertex value from each text line after preprocessing it.

Field Summary

Fields

Modifier and Type	Field and Description
protected GiraphTextInputFormat	textInputFormat Uses the GiraphTextInputFormat to do everything

Constructor Summary

Constructors

Constructor and Description
TextVertexValueInputFormat()

Method Summary

Modifier and Type	Method and Description
void	checkInputSpecs(org.apache.hadoop.conf.Configuration conf) Check that input is valid.
abstract TextVertexValueInputFormat.TextVertexValueReader	createVertexValueReader(org.apache.hadoop.mapreduce.InputSplit split, org.apache.hadoop.mapreduce.TaskAttemptContext context) Create a VertexValueReader for a given split.
List<org.apache.hadoop.mapreduce.InputSplit>	getSplits(org.apache.hadoop.mapreduce.JobContext context, int minSplitCountHint) Get the list of input splits for the format.

Methods inherited from class org.apache.giraph.io.VertexValueInputFormat

createVertexReader

Methods inherited from class org.apache.giraph.io.GiraphInputFormat

readInputSplit, writeInputSplit

Methods inherited from class org.apache.giraph.conf.DefaultImmutableClassesGiraphConfigurable

getConf, setConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

textInputFormat

protected GiraphTextInputFormat textInputFormat

Uses the GiraphTextInputFormat to do everything

Constructor Detail

TextVertexValueInputFormat

public TextVertexValueInputFormat()

Method Detail

checkInputSpecs

public void checkInputSpecs(org.apache.hadoop.conf.Configuration conf)

Description copied from class: GiraphInputFormat

Check that input is valid.

Specified by:

checkInputSpecs in class GiraphInputFormat<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,org.apache.hadoop.io.Writable>

Parameters:

conf - Configuration

getSplits

public List<org.apache.hadoop.mapreduce.InputSplit> getSplits(org.apache.hadoop.mapreduce.JobContext context,
                                                              int minSplitCountHint)
                                                       throws IOException,
                                                              InterruptedException

Description copied from class: GiraphInputFormat

Get the list of input splits for the format.

Specified by:

getSplits in class GiraphInputFormat<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,org.apache.hadoop.io.Writable>

Parameters:

context - The job context

minSplitCountHint - Minimum number of splits to create (hint)

Returns:

The list of input splits

Throws:

IOException

InterruptedException

createVertexValueReader

public abstract TextVertexValueInputFormat.TextVertexValueReader createVertexValueReader(org.apache.hadoop.mapreduce.InputSplit split,
                                                                                         org.apache.hadoop.mapreduce.TaskAttemptContext context)
                                                                                  throws IOException

Description copied from class: VertexValueInputFormat

Create a VertexValueReader for a given split. The framework will call VertexValueReader.initialize(InputSplit, TaskAttemptContext) before the split is used.

Specified by:

createVertexValueReader in class VertexValueInputFormat<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable>

Parameters:

split - The split to be read

context - The information about the task

Returns:

A new vertex value reader

Throws:

IOException