org.apache.giraph.io.gora

Class GoraEdgeOutputFormat<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

java.lang.Object

org.apache.giraph.conf.DefaultImmutableClassesGiraphConfigurable<I,V,E>

org.apache.giraph.io.EdgeOutputFormat<I,V,E>

org.apache.giraph.io.gora.GoraEdgeOutputFormat<I,V,E>

Type Parameters:

I - edge id type

V - vertex type

E - edge type

All Implemented Interfaces:

GiraphConfigurationSettable<I,V,E>, ImmutableClassesGiraphConfigurable<I,V,E>

Direct Known Subclasses:

GoraGEdgeEdgeOutputFormat

public abstract class GoraEdgeOutputFormat<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>
extends EdgeOutputFormat<I,V,E>

Class which wraps the GoraInputFormat. It's designed as an extension point to EdgeOutputFormat subclasses who wish to write to Gora data sources. Works with GoraEdgeInputFormat

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
protected class	GoraEdgeOutputFormat.GoraEdgeWriter Abstract class to be implemented by the user based on their specific vertex/edges output.

Constructor Summary

Constructors

Constructor and Description
GoraEdgeOutputFormat()

Method Summary

Modifier and Type	Method and Description
void	checkOutputSpecs(org.apache.hadoop.mapreduce.JobContext context) checkOutputSpecs
org.apache.gora.store.DataStore	createDataStore(org.apache.hadoop.conf.Configuration conf) Gets the data store object initialized.
abstract GoraEdgeOutputFormat.GoraEdgeWriter	createEdgeWriter(org.apache.hadoop.mapreduce.TaskAttemptContext context) Create an edge writer for a given split.
static org.apache.gora.store.DataStore	getDataStore() Gets the data store.
static Class<? extends org.apache.gora.store.DataStore>	getDatastoreClass()
static org.apache.log4j.Logger	getLogger() Gets the logger for the class.
org.apache.hadoop.mapreduce.OutputCommitter	getOutputCommitter(org.apache.hadoop.mapreduce.TaskAttemptContext context) getOutputCommitter
static void	setDataStore(org.apache.gora.store.DataStore dStore) Sets the data store
static void	setDatastoreClass(Class<? extends org.apache.gora.store.DataStore> dataStoreClass)

Methods inherited from class org.apache.giraph.conf.DefaultImmutableClassesGiraphConfigurable

getConf, setConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

GoraEdgeOutputFormat

public GoraEdgeOutputFormat()

Method Detail

checkOutputSpecs

public void checkOutputSpecs(org.apache.hadoop.mapreduce.JobContext context)
                      throws IOException,
                             InterruptedException

checkOutputSpecs

Specified by:

checkOutputSpecs in class EdgeOutputFormat<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

Parameters:

context - information about the job

Throws:

IOException

InterruptedException

createDataStore

public org.apache.gora.store.DataStore createDataStore(org.apache.hadoop.conf.Configuration conf)

Gets the data store object initialized.

Parameters:

conf - Configuration

Returns:

DataStore created

createEdgeWriter

public abstract GoraEdgeOutputFormat.GoraEdgeWriter createEdgeWriter(org.apache.hadoop.mapreduce.TaskAttemptContext context)
                                                              throws IOException,
                                                                     InterruptedException

Description copied from class: EdgeOutputFormat

Create an edge writer for a given split. The framework will call EdgeWriter.initialize(TaskAttemptContext) before the split is used.

Specified by:

createEdgeWriter in class EdgeOutputFormat<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

Parameters:

context - the information about the task

Returns:

a new vertex writer

Throws:

IOException

InterruptedException

getOutputCommitter

public org.apache.hadoop.mapreduce.OutputCommitter getOutputCommitter(org.apache.hadoop.mapreduce.TaskAttemptContext context)
                                                               throws IOException,
                                                                      InterruptedException

getOutputCommitter

Specified by:

getOutputCommitter in class EdgeOutputFormat<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

Parameters:

context - the task context

Returns:

OutputCommitter

Throws:

IOException

InterruptedException

getDataStore

public static org.apache.gora.store.DataStore getDataStore()

Gets the data store.

Returns:

DataStore

setDataStore

public static void setDataStore(org.apache.gora.store.DataStore dStore)

Sets the data store

Parameters:

dStore - the dATA_STORE to set

getDatastoreClass

public static Class<? extends org.apache.gora.store.DataStore> getDatastoreClass()

Returns:

Class the DATASTORE_CLASS

setDatastoreClass

public static void setDatastoreClass(Class<? extends org.apache.gora.store.DataStore> dataStoreClass)

Parameters:

dataStoreClass - the dataStore class to set

getLogger

public static org.apache.log4j.Logger getLogger()

Gets the logger for the class.

Returns:

the log of the class.