org.apache.giraph.io.hbase

Class HBaseVertexInputFormat<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

java.lang.Object

org.apache.giraph.conf.DefaultImmutableClassesGiraphConfigurable<I,V,E>

org.apache.giraph.io.GiraphInputFormat<I,V,E>

org.apache.giraph.io.VertexInputFormat<I,V,E>

org.apache.giraph.io.hbase.HBaseVertexInputFormat<I,V,E>

Type Parameters:

I - Vertex index value

V - Vertex value

E - Edge value

All Implemented Interfaces:

GiraphConfigurationSettable<I,V,E>, ImmutableClassesGiraphConfigurable<I,V,E>

public abstract class HBaseVertexInputFormat<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>
extends VertexInputFormat<I,V,E>

Base class that wraps an HBase TableInputFormat and underlying Scan object to help instantiate vertices from an HBase table. All the static TableInputFormat properties necessary to configure an HBase job are available. For example, setting conf.set(TableInputFormat.INPUT_TABLE, "in_table"); from the job setup routine will properly delegate to the TableInputFormat instance. The Configurable interface prevents specific wrapper methods from having to be called. Works with HBaseVertexOutputFormat

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	HBaseVertexInputFormat.HBaseVertexReader<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable> Takes an instance of RecordReader that supports HBase row-key, result records.

Field Summary

Fields

Modifier and Type	Field and Description
protected static org.apache.hadoop.hbase.mapreduce.TableInputFormat	BASE_FORMAT delegate HBase table input format

Constructor Summary

Constructors

Constructor and Description
HBaseVertexInputFormat()

Method Summary

Modifier and Type	Method and Description
List<org.apache.hadoop.mapreduce.InputSplit>	getSplits(org.apache.hadoop.mapreduce.JobContext context, int minSplitCountHint) Get the list of input splits for the format.

Methods inherited from class org.apache.giraph.io.VertexInputFormat

createVertexReader

Methods inherited from class org.apache.giraph.io.GiraphInputFormat

checkInputSpecs, readInputSplit, writeInputSplit

Methods inherited from class org.apache.giraph.conf.DefaultImmutableClassesGiraphConfigurable

getConf, setConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

BASE_FORMAT

protected static final org.apache.hadoop.hbase.mapreduce.TableInputFormat BASE_FORMAT

delegate HBase table input format

Constructor Detail

HBaseVertexInputFormat

public HBaseVertexInputFormat()

Method Detail

getSplits

public List<org.apache.hadoop.mapreduce.InputSplit> getSplits(org.apache.hadoop.mapreduce.JobContext context,
                                                              int minSplitCountHint)
                                                       throws IOException,
                                                              InterruptedException

Description copied from class: GiraphInputFormat

Get the list of input splits for the format.

Specified by:

getSplits in class GiraphInputFormat<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

Parameters:

context - The job context

minSplitCountHint - Minimum number of splits to create (hint)

Returns:

The list of input splits

Throws:

IOException

InterruptedException