org.apache.giraph.examples

Class GeneratedEdgeReader<I extends org.apache.hadoop.io.WritableComparable,E extends org.apache.hadoop.io.Writable>

java.lang.Object

org.apache.giraph.conf.DefaultImmutableClassesGiraphConfigurable<I,V,E>

org.apache.giraph.worker.WorkerAggregatorDelegator<I,org.apache.hadoop.io.Writable,E>

org.apache.giraph.io.EdgeReader<I,E>

org.apache.giraph.examples.GeneratedEdgeReader<I,E>

Type Parameters:

I - Vertex index value

E - Edge value

All Implemented Interfaces:

AggregatorUsage, GiraphConfigurationSettable<I,org.apache.hadoop.io.Writable,E>, ImmutableClassesGiraphConfigurable<I,org.apache.hadoop.io.Writable,E>, WorkerAggregatorUsage, WorkerBroadcastUsage, WorkerGlobalCommUsage, WorkerReduceUsage

Direct Known Subclasses:

AggregatorsTestComputation.SimpleEdgeReader

public abstract class GeneratedEdgeReader<I extends org.apache.hadoop.io.WritableComparable,E extends org.apache.hadoop.io.Writable>
extends EdgeReader<I,E>

Used by GeneratedEdgeInputFormat to read some generated data

Field Summary

Fields

Modifier and Type	Field and Description
static LongConfOption	DEFAULT_READER_EDGES Default edges produced by this reader
protected BspInputSplit	inputSplit The input split from initialize().
protected long	recordsRead Records read so far
protected long	totalRecords Total records to read (on this split alone)

Constructor Summary

Constructors

Constructor and Description
GeneratedEdgeReader() Default constructor for reflection.

Method Summary

Modifier and Type	Method and Description
void	close() Close this EdgeReader to future operations.
float	getProgress() How much of the input has the EdgeReader consumed i.e.
void	initialize(org.apache.hadoop.mapreduce.InputSplit inputSplit, org.apache.hadoop.mapreduce.TaskAttemptContext context) Use the input split and context to setup reading the edges.

Methods inherited from class org.apache.giraph.io.EdgeReader

getCurrentEdge, getCurrentSourceId, nextEdge

Methods inherited from class org.apache.giraph.worker.WorkerAggregatorDelegator

aggregate, getAggregatedValue, getBroadcast, reduce, reduceMerge, setWorkerGlobalCommUsage

Methods inherited from class org.apache.giraph.conf.DefaultImmutableClassesGiraphConfigurable

getConf, setConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

DEFAULT_READER_EDGES

public static final LongConfOption DEFAULT_READER_EDGES

Default edges produced by this reader

recordsRead

protected long recordsRead

Records read so far

totalRecords

protected long totalRecords

Total records to read (on this split alone)

inputSplit

protected BspInputSplit inputSplit

The input split from initialize().

Constructor Detail

GeneratedEdgeReader

public GeneratedEdgeReader()

Default constructor for reflection.

Method Detail

initialize

public final void initialize(org.apache.hadoop.mapreduce.InputSplit inputSplit,
                             org.apache.hadoop.mapreduce.TaskAttemptContext context)
                      throws IOException

Description copied from class: EdgeReader

Use the input split and context to setup reading the edges. Guaranteed to be called prior to any other function.

Specified by:

initialize in class EdgeReader<I extends org.apache.hadoop.io.WritableComparable,E extends org.apache.hadoop.io.Writable>

Parameters:

inputSplit - Input split to be used for reading edges.

context - Context from the task.

Throws:

IOException

close

public void close()
           throws IOException

Description copied from class: EdgeReader

Close this EdgeReader to future operations.

Specified by:

close in class EdgeReader<I extends org.apache.hadoop.io.WritableComparable,E extends org.apache.hadoop.io.Writable>

Throws:

IOException

getProgress

public final float getProgress()
                        throws IOException

Description copied from class: EdgeReader

How much of the input has the EdgeReader consumed i.e. has been processed by?

Specified by:

getProgress in class EdgeReader<I extends org.apache.hadoop.io.WritableComparable,E extends org.apache.hadoop.io.Writable>

Returns:

Progress from 0.0 to 1.0.

Throws:

IOException