org.apache.giraph.io.formats

Class PseudoRandomEdgeInputFormat

java.lang.Object

org.apache.giraph.conf.DefaultImmutableClassesGiraphConfigurable<I,V,E>

org.apache.giraph.io.GiraphInputFormat<I,org.apache.hadoop.io.Writable,E>

org.apache.giraph.io.EdgeInputFormat<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.DoubleWritable>

org.apache.giraph.io.formats.PseudoRandomEdgeInputFormat

All Implemented Interfaces:

GiraphConfigurationSettable<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Writable,org.apache.hadoop.io.DoubleWritable>, ImmutableClassesGiraphConfigurable<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Writable,org.apache.hadoop.io.DoubleWritable>

public class PseudoRandomEdgeInputFormat
extends EdgeInputFormat<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.DoubleWritable>

This EdgeInputFormat generates pseudo-random edges on the fly. As with PseudoRandomVertexInputFormat, the user specifies the number of vertices and the number of edges per vertex.

Constructor Summary

Constructors

Constructor and Description
PseudoRandomEdgeInputFormat()

Method Summary

Modifier and Type	Method and Description
void	checkInputSpecs(org.apache.hadoop.conf.Configuration conf) Check that input is valid.
EdgeReader<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.DoubleWritable>	createEdgeReader(org.apache.hadoop.mapreduce.InputSplit split, org.apache.hadoop.mapreduce.TaskAttemptContext context) Create an edge reader for a given split.
List<org.apache.hadoop.mapreduce.InputSplit>	getSplits(org.apache.hadoop.mapreduce.JobContext context, int minSplitCountHint) Get the list of input splits for the format.

Methods inherited from class org.apache.giraph.io.GiraphInputFormat

readInputSplit, writeInputSplit

Methods inherited from class org.apache.giraph.conf.DefaultImmutableClassesGiraphConfigurable

getConf, setConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

PseudoRandomEdgeInputFormat

public PseudoRandomEdgeInputFormat()

Method Detail

checkInputSpecs

public void checkInputSpecs(org.apache.hadoop.conf.Configuration conf)

Description copied from class: GiraphInputFormat

Check that input is valid.

Specified by:

checkInputSpecs in class GiraphInputFormat<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Writable,org.apache.hadoop.io.DoubleWritable>

Parameters:

conf - Configuration

getSplits

public final List<org.apache.hadoop.mapreduce.InputSplit> getSplits(org.apache.hadoop.mapreduce.JobContext context,
                                                                    int minSplitCountHint)
                                                             throws IOException,
                                                                    InterruptedException

Description copied from class: GiraphInputFormat

Get the list of input splits for the format.

Specified by:

getSplits in class GiraphInputFormat<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Writable,org.apache.hadoop.io.DoubleWritable>

Parameters:

context - The job context

minSplitCountHint - Minimum number of splits to create (hint)

Returns:

The list of input splits

Throws:

IOException

InterruptedException

createEdgeReader

public EdgeReader<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.DoubleWritable> createEdgeReader(org.apache.hadoop.mapreduce.InputSplit split,
                                                                                                          org.apache.hadoop.mapreduce.TaskAttemptContext context)
                                                                                                   throws IOException

Description copied from class: EdgeInputFormat

Create an edge reader for a given split. The framework will call EdgeReader.initialize(InputSplit, TaskAttemptContext) before the split is used.

Specified by:

createEdgeReader in class EdgeInputFormat<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.DoubleWritable>

Parameters:

split - the split to be read

context - the information about the task

Returns:

a new record reader

Throws:

IOException