org.apache.giraph.io.hcatalog

Class HCatalogEdgeInputFormat.HCatalogEdgeReader<I extends org.apache.hadoop.io.WritableComparable,E extends org.apache.hadoop.io.Writable>

java.lang.Object

org.apache.giraph.conf.DefaultImmutableClassesGiraphConfigurable<I,V,E>

org.apache.giraph.worker.WorkerAggregatorDelegator<I,org.apache.hadoop.io.Writable,E>

org.apache.giraph.io.EdgeReader<I,E>

org.apache.giraph.io.hcatalog.HCatalogEdgeInputFormat.HCatalogEdgeReader<I,E>

All Implemented Interfaces:

AggregatorUsage, GiraphConfigurationSettable<I,org.apache.hadoop.io.Writable,E>, ImmutableClassesGiraphConfigurable<I,org.apache.hadoop.io.Writable,E>, WorkerAggregatorUsage, WorkerBroadcastUsage, WorkerGlobalCommUsage, WorkerReduceUsage

Direct Known Subclasses:

HCatalogEdgeInputFormat.SingleRowHCatalogEdgeNoValueReader, HCatalogEdgeInputFormat.SingleRowHCatalogEdgeReader

Enclosing class:

HCatalogEdgeInputFormat<I extends org.apache.hadoop.io.WritableComparable,E extends org.apache.hadoop.io.Writable>

protected abstract static class HCatalogEdgeInputFormat.HCatalogEdgeReader<I extends org.apache.hadoop.io.WritableComparable,E extends org.apache.hadoop.io.Writable>
extends EdgeReader<I,E>

EdgeReader for HCatalogEdgeInputFormat.

Constructor Summary

Constructors

Constructor and Description
HCatalogEdgeReader(GiraphHCatInputFormat hCatInputFormat) Constructor taking hcat input format to use.

Method Summary

Modifier and Type	Method and Description
void	close() Close this EdgeReader to future operations.
protected org.apache.hadoop.mapreduce.TaskAttemptContext	getContext() Get the context.
float	getProgress() How much of the input has the EdgeReader consumed i.e.
protected org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.WritableComparable,org.apache.hcatalog.data.HCatRecord>	getRecordReader() Get the record reader.
void	initialize(org.apache.hadoop.mapreduce.InputSplit inputSplit, org.apache.hadoop.mapreduce.TaskAttemptContext context) Use the input split and context to setup reading the edges.
boolean	nextEdge() Read the next edge.

Methods inherited from class org.apache.giraph.io.EdgeReader

getCurrentEdge, getCurrentSourceId

Methods inherited from class org.apache.giraph.worker.WorkerAggregatorDelegator

aggregate, getAggregatedValue, getBroadcast, reduce, reduceMerge, setWorkerGlobalCommUsage

Methods inherited from class org.apache.giraph.conf.DefaultImmutableClassesGiraphConfigurable

getConf, setConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HCatalogEdgeReader

public HCatalogEdgeReader(GiraphHCatInputFormat hCatInputFormat)

Constructor taking hcat input format to use.

Parameters:

hCatInputFormat - HCatalog input format

Method Detail

initialize

public final void initialize(org.apache.hadoop.mapreduce.InputSplit inputSplit,
                             org.apache.hadoop.mapreduce.TaskAttemptContext context)
                      throws IOException,
                             InterruptedException

Description copied from class: EdgeReader

Use the input split and context to setup reading the edges. Guaranteed to be called prior to any other function.

Specified by:

initialize in class EdgeReader<I extends org.apache.hadoop.io.WritableComparable,E extends org.apache.hadoop.io.Writable>

Parameters:

inputSplit - Input split to be used for reading edges.

context - Context from the task.

Throws:

IOException

InterruptedException

nextEdge

public boolean nextEdge()
                 throws IOException,
                        InterruptedException

Description copied from class: EdgeReader

Read the next edge.

Specified by:

nextEdge in class EdgeReader<I extends org.apache.hadoop.io.WritableComparable,E extends org.apache.hadoop.io.Writable>

Returns:

false iff there are no more edges

Throws:

IOException

InterruptedException

close

public final void close()
                 throws IOException

Description copied from class: EdgeReader

Close this EdgeReader to future operations.

Specified by:

close in class EdgeReader<I extends org.apache.hadoop.io.WritableComparable,E extends org.apache.hadoop.io.Writable>

Throws:

IOException

getProgress

public final float getProgress()
                        throws IOException,
                               InterruptedException

Description copied from class: EdgeReader

How much of the input has the EdgeReader consumed i.e. has been processed by?

Specified by:

getProgress in class EdgeReader<I extends org.apache.hadoop.io.WritableComparable,E extends org.apache.hadoop.io.Writable>

Returns:

Progress from 0.0 to 1.0.

Throws:

IOException

InterruptedException

getRecordReader

protected final org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.WritableComparable,org.apache.hcatalog.data.HCatRecord> getRecordReader()

Get the record reader.

Returns:

Record reader to be used for reading.

getContext

protected final org.apache.hadoop.mapreduce.TaskAttemptContext getContext()

Get the context.

Returns:

Context passed to initialize.