org.apache.giraph.io.formats

Class SequenceFileVertexInputFormat<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable,X extends Vertex<I,V,E>>

java.lang.Object

org.apache.giraph.conf.DefaultImmutableClassesGiraphConfigurable<I,V,E>

org.apache.giraph.io.GiraphInputFormat<I,V,E>

org.apache.giraph.io.VertexInputFormat<I,V,E>

org.apache.giraph.io.formats.SequenceFileVertexInputFormat<I,V,E,X>

Type Parameters:

I - Vertex id

V - Vertex data

E - Edge data

X - Value type

All Implemented Interfaces:

GiraphConfigurationSettable<I,V,E>, ImmutableClassesGiraphConfigurable<I,V,E>

public class SequenceFileVertexInputFormat<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable,X extends Vertex<I,V,E>>
extends VertexInputFormat<I,V,E>

Sequence file vertex input format based on SequenceFileInputFormat.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	SequenceFileVertexInputFormat.SequenceFileVertexReader<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable,X extends Vertex<I,V,E>> Vertex reader used with SequenceFileVertexInputFormat.

Field Summary

Fields

Modifier and Type	Field and Description
protected org.apache.hadoop.mapreduce.lib.input.SequenceFileInputFormat<I,X>	sequenceFileInputFormat Internal input format

Constructor Summary

Constructors

Constructor and Description
SequenceFileVertexInputFormat()

Method Summary

Modifier and Type	Method and Description
void	checkInputSpecs(org.apache.hadoop.conf.Configuration conf) Check that input is valid.
VertexReader<I,V,E>	createVertexReader(org.apache.hadoop.mapreduce.InputSplit split, org.apache.hadoop.mapreduce.TaskAttemptContext context) Create a vertex reader for a given split.
List<org.apache.hadoop.mapreduce.InputSplit>	getSplits(org.apache.hadoop.mapreduce.JobContext context, int minSplitCountHint) Get the list of input splits for the format.

Methods inherited from class org.apache.giraph.io.GiraphInputFormat

readInputSplit, writeInputSplit

Methods inherited from class org.apache.giraph.conf.DefaultImmutableClassesGiraphConfigurable

getConf, setConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

sequenceFileInputFormat

protected org.apache.hadoop.mapreduce.lib.input.SequenceFileInputFormat<I extends org.apache.hadoop.io.WritableComparable,X extends Vertex<I,V,E>> sequenceFileInputFormat

Internal input format

Constructor Detail

SequenceFileVertexInputFormat

public SequenceFileVertexInputFormat()

Method Detail

checkInputSpecs

public void checkInputSpecs(org.apache.hadoop.conf.Configuration conf)

Description copied from class: GiraphInputFormat

Check that input is valid.

Specified by:

checkInputSpecs in class GiraphInputFormat<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

Parameters:

conf - Configuration

getSplits

public List<org.apache.hadoop.mapreduce.InputSplit> getSplits(org.apache.hadoop.mapreduce.JobContext context,
                                                              int minSplitCountHint)
                                                       throws IOException,
                                                              InterruptedException

Description copied from class: GiraphInputFormat

Get the list of input splits for the format.

Specified by:

getSplits in class GiraphInputFormat<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

Parameters:

context - The job context

minSplitCountHint - Minimum number of splits to create (hint)

Returns:

The list of input splits

Throws:

IOException

InterruptedException

createVertexReader

public VertexReader<I,V,E> createVertexReader(org.apache.hadoop.mapreduce.InputSplit split,
                                              org.apache.hadoop.mapreduce.TaskAttemptContext context)
                                       throws IOException

Description copied from class: VertexInputFormat

Create a vertex reader for a given split. Guaranteed to have been configured with setConf() prior to use. The framework will also call VertexReader.initialize(InputSplit, TaskAttemptContext) before the split is used.

Specified by:

createVertexReader in class VertexInputFormat<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

Parameters:

split - the split to be read

context - the information about the task

Returns:

a new record reader

Throws:

IOException