org.apache.giraph.io.hcatalog

Class HCatalogVertexInputFormat.MultiRowHCatalogVertexReader

java.lang.Object

org.apache.giraph.conf.DefaultImmutableClassesGiraphConfigurable<I,V,E>

org.apache.giraph.worker.WorkerAggregatorDelegator<I,V,E>

org.apache.giraph.io.VertexReader<I,V,E>

org.apache.giraph.io.hcatalog.HCatalogVertexInputFormat.HCatalogVertexReader

org.apache.giraph.io.hcatalog.HCatalogVertexInputFormat.MultiRowHCatalogVertexReader

All Implemented Interfaces:

AggregatorUsage, GiraphConfigurationSettable<I,V,E>, ImmutableClassesGiraphConfigurable<I,V,E>, WorkerAggregatorUsage, WorkerBroadcastUsage, WorkerGlobalCommUsage, WorkerReduceUsage

Enclosing class:

HCatalogVertexInputFormat<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

protected abstract class HCatalogVertexInputFormat.MultiRowHCatalogVertexReader
extends HCatalogVertexInputFormat.HCatalogVertexReader

HCatalogVertexReader for tables holding vertex info across multiple rows sorted by vertex id column, so that they appear consecutively to the RecordReader.

Constructor Summary

Constructors

Modifier	Constructor and Description
protected	MultiRowHCatalogVertexReader()

Method Summary

Modifier and Type	Method and Description
Vertex<I,V,E>	getCurrentVertex() Get the current vertex.
protected abstract E	getEdgeValue(org.apache.hcatalog.data.HCatRecord record) get edge value from record.
protected abstract I	getTargetVertexId(org.apache.hcatalog.data.HCatRecord record) get target vertex id from record.
protected abstract I	getVertexId(org.apache.hcatalog.data.HCatRecord record) get vertex id from record.
protected abstract V	getVertexValue(Iterable<org.apache.hcatalog.data.HCatRecord> records) get vertex value from record.
boolean	nextVertex()

Methods inherited from class org.apache.giraph.io.hcatalog.HCatalogVertexInputFormat.HCatalogVertexReader

close, getContext, getProgress, getRecordReader, initialize

Methods inherited from class org.apache.giraph.worker.WorkerAggregatorDelegator

aggregate, getAggregatedValue, getBroadcast, reduce, reduceMerge, setWorkerGlobalCommUsage

Methods inherited from class org.apache.giraph.conf.DefaultImmutableClassesGiraphConfigurable

getConf, setConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

MultiRowHCatalogVertexReader

protected MultiRowHCatalogVertexReader()

Method Detail

getVertexId

protected abstract I getVertexId(org.apache.hcatalog.data.HCatRecord record)

get vertex id from record.

Parameters:

record - hcat

Returns:

I vertex id

getVertexValue

protected abstract V getVertexValue(Iterable<org.apache.hcatalog.data.HCatRecord> records)

get vertex value from record.

Parameters:

records - all vertex values

Returns:

V iterable of record values

getTargetVertexId

protected abstract I getTargetVertexId(org.apache.hcatalog.data.HCatRecord record)

get target vertex id from record.

Parameters:

record - hcat

Returns:

I vertex id of target.

getEdgeValue

protected abstract E getEdgeValue(org.apache.hcatalog.data.HCatRecord record)

get edge value from record.

Parameters:

record - hcat.

Returns:

E edge value.

getCurrentVertex

public final Vertex<I,V,E> getCurrentVertex()
                                     throws IOException,
                                            InterruptedException

Description copied from class: VertexReader

Get the current vertex.

Specified by:

getCurrentVertex in class VertexReader<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

Returns:

the current vertex which has been read. nextVertex() should be called first.

Throws:

IOException

InterruptedException

nextVertex

public boolean nextVertex()
                   throws IOException,
                          InterruptedException

Overrides:

nextVertex in class HCatalogVertexInputFormat.HCatalogVertexReader

Returns:

false iff there are no more vertices

Throws:

IOException

InterruptedException