org.apache.giraph.io.hcatalog

Class HCatalogVertexOutputFormat.HCatalogVertexWriter<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

java.lang.Object

org.apache.giraph.conf.DefaultImmutableClassesGiraphConfigurable<I,V,E>

org.apache.giraph.io.VertexWriter<I,V,E>

org.apache.giraph.io.hcatalog.HCatalogVertexOutputFormat.HCatalogVertexWriter<I,V,E>

Type Parameters:

I - Vertex id

V - Vertex value

E - Edge value

All Implemented Interfaces:

GiraphConfigurationSettable<I,V,E>, ImmutableClassesGiraphConfigurable<I,V,E>, SimpleVertexWriter<I,V,E>

Direct Known Subclasses:

HCatalogVertexOutputFormat.MultiRowHCatalogVertexWriter, HCatalogVertexOutputFormat.SingleRowHCatalogVertexWriter

Enclosing class:

HCatalogVertexOutputFormat<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

protected abstract static class HCatalogVertexOutputFormat.HCatalogVertexWriter<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>
extends VertexWriter<I,V,E>

Abstract class that users should subclass based on their specific vertex output. Users should implement writeVertex to create a HCatRecord that is valid to for writing by HCatalogRecordWriter.

Constructor Summary

Constructors

Modifier	Constructor and Description
protected	HCatalogVertexWriter()

Method Summary

Modifier and Type	Method and Description
void	close(org.apache.hadoop.mapreduce.TaskAttemptContext context) Close this VertexWriter to future operations.
protected org.apache.hadoop.mapreduce.TaskAttemptContext	getContext() Get the context.
protected org.apache.hadoop.mapreduce.RecordWriter<org.apache.hadoop.io.WritableComparable<?>,org.apache.hcatalog.data.HCatRecord>	getRecordWriter() Get the record reader.
protected void	initialize(org.apache.hadoop.mapreduce.RecordWriter<org.apache.hadoop.io.WritableComparable<?>,org.apache.hcatalog.data.HCatRecord> hCatRecordWriter) Initialize with the HCatRecordWriter
void	initialize(org.apache.hadoop.mapreduce.TaskAttemptContext context) Use the context to setup writing the vertices.

Methods inherited from class org.apache.giraph.conf.DefaultImmutableClassesGiraphConfigurable

getConf, setConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.giraph.io.SimpleVertexWriter

writeVertex

Constructor Detail

HCatalogVertexWriter

protected HCatalogVertexWriter()

Method Detail

initialize

protected void initialize(org.apache.hadoop.mapreduce.RecordWriter<org.apache.hadoop.io.WritableComparable<?>,org.apache.hcatalog.data.HCatRecord> hCatRecordWriter)

Initialize with the HCatRecordWriter

Parameters:

hCatRecordWriter - Internal writer

getRecordWriter

protected org.apache.hadoop.mapreduce.RecordWriter<org.apache.hadoop.io.WritableComparable<?>,org.apache.hcatalog.data.HCatRecord> getRecordWriter()

Get the record reader.

Returns:

Record reader to be used for reading.

getContext

protected org.apache.hadoop.mapreduce.TaskAttemptContext getContext()

Get the context.

Returns:

Context passed to initialize.

initialize

public void initialize(org.apache.hadoop.mapreduce.TaskAttemptContext context)
                throws IOException

Description copied from class: VertexWriter

Use the context to setup writing the vertices. Guaranteed to be called prior to any other function.

Specified by:

initialize in class VertexWriter<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

Parameters:

context - Context used to write the vertices.

Throws:

IOException

close

public void close(org.apache.hadoop.mapreduce.TaskAttemptContext context)
           throws IOException,
                  InterruptedException

Description copied from class: VertexWriter

Close this VertexWriter to future operations.

Specified by:

close in class VertexWriter<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

Parameters:

context - the context of the task

Throws:

IOException

InterruptedException