org.apache.giraph.examples

Class GeneratedVertexReader<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

java.lang.Object

org.apache.giraph.conf.DefaultImmutableClassesGiraphConfigurable<I,V,E>

org.apache.giraph.worker.WorkerAggregatorDelegator<I,V,E>

org.apache.giraph.io.VertexReader<I,V,E>

org.apache.giraph.examples.GeneratedVertexReader<I,V,E>

Type Parameters:

I - Vertex index value

V - Vertex value

E - Edge value

All Implemented Interfaces:

AggregatorUsage, GiraphConfigurationSettable<I,V,E>, ImmutableClassesGiraphConfigurable<I,V,E>, WorkerAggregatorUsage, WorkerBroadcastUsage, WorkerGlobalCommUsage, WorkerReduceUsage

Direct Known Subclasses:

AggregatorsTestComputation.SimpleVertexReader, PageRankWithKryoSimpleWritable.PageRankWithKryoVertexReader, SimplePageRankComputation.SimplePageRankVertexReader, SimpleSuperstepComputation.SimpleSuperstepVertexReader

public abstract class GeneratedVertexReader<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>
extends VertexReader<I,V,E>

Used by GeneratedVertexInputFormat to read some generated data

Field Summary

Fields

Modifier and Type	Field and Description
protected BspInputSplit	inputSplit The input split from initialize().
static LongConfOption	READER_VERTICES Vertices produced by this reader
protected long	recordsRead Records read so far
static BooleanConfOption	REVERSE_ID_ORDER Reverse the order of the vertices?
protected boolean	reverseIdOrder Reverse the id order?
protected long	totalRecords Total records to read (on this split alone)

Constructor Summary

Constructors

Constructor and Description
GeneratedVertexReader() Default constructor for reflection.

Method Summary

Modifier and Type	Method and Description
void	close() Close this VertexReader to future operations.
float	getProgress() How much of the input has the VertexReader consumed i.e.
void	initialize(org.apache.hadoop.mapreduce.InputSplit inputSplit, org.apache.hadoop.mapreduce.TaskAttemptContext context) Use the input split and context to setup reading the vertices.

Methods inherited from class org.apache.giraph.io.VertexReader

getCurrentVertex, nextVertex

Methods inherited from class org.apache.giraph.worker.WorkerAggregatorDelegator

aggregate, getAggregatedValue, getBroadcast, reduce, reduceMerge, setWorkerGlobalCommUsage

Methods inherited from class org.apache.giraph.conf.DefaultImmutableClassesGiraphConfigurable

getConf, setConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

READER_VERTICES

public static final LongConfOption READER_VERTICES

Vertices produced by this reader

REVERSE_ID_ORDER

public static final BooleanConfOption REVERSE_ID_ORDER

Reverse the order of the vertices?

recordsRead

protected long recordsRead

Records read so far

totalRecords

protected long totalRecords

Total records to read (on this split alone)

inputSplit

protected BspInputSplit inputSplit

The input split from initialize().

reverseIdOrder

protected boolean reverseIdOrder

Reverse the id order?

Constructor Detail

GeneratedVertexReader

public GeneratedVertexReader()

Default constructor for reflection.

Method Detail

initialize

public final void initialize(org.apache.hadoop.mapreduce.InputSplit inputSplit,
                             org.apache.hadoop.mapreduce.TaskAttemptContext context)
                      throws IOException

Description copied from class: VertexReader

Use the input split and context to setup reading the vertices. Guaranteed to be called prior to any other function.

Specified by:

initialize in class VertexReader<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

Parameters:

inputSplit - Input split to be used for reading vertices.

context - Context from the task.

Throws:

IOException

close

public void close()
           throws IOException

Description copied from class: VertexReader

Close this VertexReader to future operations.

Specified by:

close in class VertexReader<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

Throws:

IOException

getProgress

public final float getProgress()
                        throws IOException

Description copied from class: VertexReader

How much of the input has the VertexReader consumed i.e. has been processed by?

Specified by:

getProgress in class VertexReader<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

Returns:

Progress from 0.0 to 1.0.

Throws:

IOException