org.apache.giraph.io.hcatalog

Class HCatalogVertexValueInputFormat<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable>

java.lang.Object

org.apache.giraph.conf.DefaultImmutableClassesGiraphConfigurable<I,V,E>

org.apache.giraph.io.GiraphInputFormat<I,V,E>

org.apache.giraph.io.VertexInputFormat<I,V,org.apache.hadoop.io.Writable>

org.apache.giraph.io.VertexValueInputFormat<I,V>

org.apache.giraph.io.hcatalog.HCatalogVertexValueInputFormat<I,V>

Type Parameters:

I - Vertex id

V - Vertex value

All Implemented Interfaces:

GiraphConfigurationSettable<I,V,org.apache.hadoop.io.Writable>, ImmutableClassesGiraphConfigurable<I,V,org.apache.hadoop.io.Writable>

public abstract class HCatalogVertexValueInputFormat<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable>
extends VertexValueInputFormat<I,V>

HCatalog VertexValueInputFormat for reading vertex values from Hive/Pig.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
protected class	HCatalogVertexValueInputFormat.HCatalogVertexValueReader VertexValueReader for HCatalogVertexValueInputFormat.
protected class	HCatalogVertexValueInputFormat.SingleRowHCatalogVertexValueReader HCatalogVertexValueInputFormat.HCatalogVertexValueReader for tables holding a complete vertex value in each row.

Constructor Summary

Constructors

Constructor and Description
HCatalogVertexValueInputFormat()

Method Summary

Modifier and Type	Method and Description
protected abstract HCatalogVertexValueInputFormat.HCatalogVertexValueReader	createVertexValueReader() Create VertexValueReader.
VertexValueReader<I,V>	createVertexValueReader(org.apache.hadoop.mapreduce.InputSplit split, org.apache.hadoop.mapreduce.TaskAttemptContext context) Create a VertexValueReader for a given split.
List<org.apache.hadoop.mapreduce.InputSplit>	getSplits(org.apache.hadoop.mapreduce.JobContext context, int minSplitCountHint) Get the list of input splits for the format.

Methods inherited from class org.apache.giraph.io.VertexValueInputFormat

createVertexReader

Methods inherited from class org.apache.giraph.io.GiraphInputFormat

checkInputSpecs, readInputSplit, writeInputSplit

Methods inherited from class org.apache.giraph.conf.DefaultImmutableClassesGiraphConfigurable

getConf, setConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HCatalogVertexValueInputFormat

public HCatalogVertexValueInputFormat()

Method Detail

getSplits

public List<org.apache.hadoop.mapreduce.InputSplit> getSplits(org.apache.hadoop.mapreduce.JobContext context,
                                                              int minSplitCountHint)
                                                       throws IOException,
                                                              InterruptedException

Description copied from class: GiraphInputFormat

Get the list of input splits for the format.

Specified by:

getSplits in class GiraphInputFormat<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,org.apache.hadoop.io.Writable>

Parameters:

context - The job context

minSplitCountHint - Minimum number of splits to create (hint)

Returns:

The list of input splits

Throws:

IOException

InterruptedException

createVertexValueReader

protected abstract HCatalogVertexValueInputFormat.HCatalogVertexValueReader createVertexValueReader()

Create VertexValueReader.

Returns:

HCatalogVertexValueInputFormat.HCatalogVertexValueReader instance.

createVertexValueReader

public final VertexValueReader<I,V> createVertexValueReader(org.apache.hadoop.mapreduce.InputSplit split,
                                                            org.apache.hadoop.mapreduce.TaskAttemptContext context)
                                                     throws IOException

Description copied from class: VertexValueInputFormat

Create a VertexValueReader for a given split. The framework will call VertexValueReader.initialize(InputSplit, TaskAttemptContext) before the split is used.

Specified by:

createVertexValueReader in class VertexValueInputFormat<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable>

Parameters:

split - The split to be read

context - The information about the task

Returns:

A new vertex value reader

Throws:

IOException