org.apache.giraph.io.gora

Class GoraEdgeInputFormat.GoraEdgeReader

java.lang.Object

org.apache.giraph.conf.DefaultImmutableClassesGiraphConfigurable<I,V,E>

org.apache.giraph.worker.WorkerAggregatorDelegator<I,org.apache.hadoop.io.Writable,E>

org.apache.giraph.io.EdgeReader<I,E>

org.apache.giraph.io.gora.GoraEdgeInputFormat.GoraEdgeReader

All Implemented Interfaces:

AggregatorUsage, GiraphConfigurationSettable<I,org.apache.hadoop.io.Writable,E>, ImmutableClassesGiraphConfigurable<I,org.apache.hadoop.io.Writable,E>, WorkerAggregatorUsage, WorkerBroadcastUsage, WorkerGlobalCommUsage, WorkerReduceUsage

Direct Known Subclasses:

GoraGEdgeEdgeInputFormat.GoraGEdgeEdgeReader

Enclosing class:

GoraEdgeInputFormat<I extends org.apache.hadoop.io.WritableComparable,E extends org.apache.hadoop.io.Writable>

protected abstract class GoraEdgeInputFormat.GoraEdgeReader
extends EdgeReader<I,E>

Abstract class to be implemented by the user based on their specific vertex input. Easiest to ignore the key value separator and only use key instead.

Constructor Summary

Constructors

Modifier	Constructor and Description
protected	GoraEdgeReader()

Method Summary

Modifier and Type	Method and Description
void	close() Finishes the reading process.
Edge<I,E>	getCurrentEdge() Gets current edge.
float	getProgress() Gets the progress of reading results from Gora.
protected void	getResults() Performs a range query to a Gora data store.
void	initialize(org.apache.hadoop.mapreduce.InputSplit inputSplit, org.apache.hadoop.mapreduce.TaskAttemptContext context) Use the input split and context to setup reading the edges.
boolean	nextEdge() Gets the next edge from Gora data store.
protected abstract Edge<I,E>	transformEdge(Object goraObject) Parser for a single Gora object

Methods inherited from class org.apache.giraph.io.EdgeReader

getCurrentSourceId

Methods inherited from class org.apache.giraph.worker.WorkerAggregatorDelegator

aggregate, getAggregatedValue, getBroadcast, reduce, reduceMerge, setWorkerGlobalCommUsage

Methods inherited from class org.apache.giraph.conf.DefaultImmutableClassesGiraphConfigurable

getConf, setConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

GoraEdgeReader

protected GoraEdgeReader()

Method Detail

initialize

public void initialize(org.apache.hadoop.mapreduce.InputSplit inputSplit,
                       org.apache.hadoop.mapreduce.TaskAttemptContext context)
                throws IOException,
                       InterruptedException

Description copied from class: EdgeReader

Use the input split and context to setup reading the edges. Guaranteed to be called prior to any other function.

Specified by:

initialize in class EdgeReader<I extends org.apache.hadoop.io.WritableComparable,E extends org.apache.hadoop.io.Writable>

Parameters:

inputSplit - Input split to be used for reading edges.

context - Context from the task.

Throws:

IOException

InterruptedException

nextEdge

public boolean nextEdge()
                 throws IOException,
                        InterruptedException

Gets the next edge from Gora data store.

Specified by:

nextEdge in class EdgeReader<I extends org.apache.hadoop.io.WritableComparable,E extends org.apache.hadoop.io.Writable>

Returns:

true/false depending on the existence of vertices.

Throws:

IOException - exceptions passed along.

InterruptedException - exceptions passed along.

getProgress

public float getProgress()
                  throws IOException,
                         InterruptedException

Gets the progress of reading results from Gora.

Specified by:

getProgress in class EdgeReader<I extends org.apache.hadoop.io.WritableComparable,E extends org.apache.hadoop.io.Writable>

Returns:

the progress of reading results from Gora.

Throws:

IOException

InterruptedException

getCurrentEdge

public Edge<I,E> getCurrentEdge()
                         throws IOException,
                                InterruptedException

Gets current edge.

Specified by:

getCurrentEdge in class EdgeReader<I extends org.apache.hadoop.io.WritableComparable,E extends org.apache.hadoop.io.Writable>

Returns:

The edge object represented by a Gora object

Throws:

IOException

InterruptedException

transformEdge

protected abstract Edge<I,E> transformEdge(Object goraObject)

Parser for a single Gora object

Parameters:

goraObject - vertex represented as a GoraObject

Returns:

The edge object represented by a Gora object

getResults

protected void getResults()

Performs a range query to a Gora data store.

close

public void close()
           throws IOException

Finishes the reading process.

Specified by:

close in class EdgeReader<I extends org.apache.hadoop.io.WritableComparable,E extends org.apache.hadoop.io.Writable>

Throws:

IOException