org.apache.giraph.io.formats

Class TextEdgeInputFormat.TextEdgeReader

java.lang.Object

org.apache.giraph.conf.DefaultImmutableClassesGiraphConfigurable<I,V,E>

org.apache.giraph.worker.WorkerAggregatorDelegator<I,org.apache.hadoop.io.Writable,E>

org.apache.giraph.io.EdgeReader<I,E>

org.apache.giraph.io.formats.TextEdgeInputFormat.TextEdgeReader

All Implemented Interfaces:

AggregatorUsage, GiraphConfigurationSettable<I,org.apache.hadoop.io.Writable,E>, ImmutableClassesGiraphConfigurable<I,org.apache.hadoop.io.Writable,E>, WorkerAggregatorUsage, WorkerBroadcastUsage, WorkerGlobalCommUsage, WorkerReduceUsage

Direct Known Subclasses:

TextEdgeInputFormat.TextEdgeReaderFromEachLine, TextEdgeInputFormat.TextEdgeReaderFromEachLineProcessed

Enclosing class:

TextEdgeInputFormat<I extends org.apache.hadoop.io.WritableComparable,E extends org.apache.hadoop.io.Writable>

protected abstract class TextEdgeInputFormat.TextEdgeReader
extends EdgeReader<I,E>

EdgeReader for TextEdgeInputFormat.

Constructor Summary

Constructors

Modifier	Constructor and Description
protected	TextEdgeReader()

Method Summary

Modifier and Type	Method and Description
void	close() Close this EdgeReader to future operations.
protected org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text>	createLineRecordReader(org.apache.hadoop.mapreduce.InputSplit inputSplit, org.apache.hadoop.mapreduce.TaskAttemptContext context) Create the line record reader.
protected org.apache.hadoop.mapreduce.TaskAttemptContext	getContext() Get the context.
float	getProgress() How much of the input has the EdgeReader consumed i.e.
protected org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text>	getRecordReader() Get the line record reader.
void	initialize(org.apache.hadoop.mapreduce.InputSplit inputSplit, org.apache.hadoop.mapreduce.TaskAttemptContext context) Use the input split and context to setup reading the edges.

Methods inherited from class org.apache.giraph.io.EdgeReader

getCurrentEdge, getCurrentSourceId, nextEdge

Methods inherited from class org.apache.giraph.worker.WorkerAggregatorDelegator

aggregate, getAggregatedValue, getBroadcast, reduce, reduceMerge, setWorkerGlobalCommUsage

Methods inherited from class org.apache.giraph.conf.DefaultImmutableClassesGiraphConfigurable

getConf, setConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

TextEdgeReader

protected TextEdgeReader()

Method Detail

initialize

public void initialize(org.apache.hadoop.mapreduce.InputSplit inputSplit,
                       org.apache.hadoop.mapreduce.TaskAttemptContext context)
                throws IOException,
                       InterruptedException

Description copied from class: EdgeReader

Use the input split and context to setup reading the edges. Guaranteed to be called prior to any other function.

Specified by:

initialize in class EdgeReader<I extends org.apache.hadoop.io.WritableComparable,E extends org.apache.hadoop.io.Writable>

Parameters:

inputSplit - Input split to be used for reading edges.

context - Context from the task.

Throws:

IOException

InterruptedException

createLineRecordReader

protected org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text> createLineRecordReader(org.apache.hadoop.mapreduce.InputSplit inputSplit,
                                                                                                                                       org.apache.hadoop.mapreduce.TaskAttemptContext context)
                                                                                                                                throws IOException,
                                                                                                                                       InterruptedException

Create the line record reader. Override this to use a different underlying record reader (useful for testing).

Parameters:

inputSplit - the split to read

context - the context passed to initialize

Returns:

the record reader to be used

Throws:

IOException - exception that can be thrown during creation

InterruptedException - exception that can be thrown during creation

close

public void close()
           throws IOException

Description copied from class: EdgeReader

Close this EdgeReader to future operations.

Specified by:

close in class EdgeReader<I extends org.apache.hadoop.io.WritableComparable,E extends org.apache.hadoop.io.Writable>

Throws:

IOException

getProgress

public float getProgress()
                  throws IOException,
                         InterruptedException

Description copied from class: EdgeReader

How much of the input has the EdgeReader consumed i.e. has been processed by?

Specified by:

getProgress in class EdgeReader<I extends org.apache.hadoop.io.WritableComparable,E extends org.apache.hadoop.io.Writable>

Returns:

Progress from 0.0 to 1.0.

Throws:

IOException

InterruptedException

getRecordReader

protected org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text> getRecordReader()

Get the line record reader.

Returns:

Record reader to be used for reading.

getContext

protected org.apache.hadoop.mapreduce.TaskAttemptContext getContext()

Get the context.

Returns:

Context passed to initialize.