org.apache.giraph.io.formats

Class TextEdgeOutputFormat.TextEdgeWriter<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

java.lang.Object

org.apache.giraph.conf.DefaultImmutableClassesGiraphConfigurable<I,V,E>

org.apache.giraph.io.EdgeWriter<I,V,E>

org.apache.giraph.io.formats.TextEdgeOutputFormat.TextEdgeWriter<I,V,E>

All Implemented Interfaces:

GiraphConfigurationSettable<I,V,E>, ImmutableClassesGiraphConfigurable<I,V,E>

Direct Known Subclasses:

TextEdgeOutputFormat.TextEdgeWriterToEachLine

Enclosing class:

TextEdgeOutputFormat<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

protected abstract class TextEdgeOutputFormat.TextEdgeWriter<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>
extends EdgeWriter<I,V,E>

Abstract class to be implemented by the user based on their specific edge output. Easiest to ignore the key value separator and only use key instead.

Constructor Summary

Constructors

Modifier	Constructor and Description
protected	TextEdgeWriter()

Method Summary

Modifier and Type	Method and Description
void	close(org.apache.hadoop.mapreduce.TaskAttemptContext context) Close this EdgeWriter to future operations.
protected org.apache.hadoop.mapreduce.RecordWriter<org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>	createLineRecordWriter(org.apache.hadoop.mapreduce.TaskAttemptContext context) Create the line record writer.
org.apache.hadoop.mapreduce.TaskAttemptContext	getContext() Get the context.
org.apache.hadoop.mapreduce.RecordWriter<org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>	getRecordWriter() Get the line record writer.
void	initialize(org.apache.hadoop.mapreduce.TaskAttemptContext context) Use the context to setup writing the edges.

Methods inherited from class org.apache.giraph.io.EdgeWriter

writeEdge

Methods inherited from class org.apache.giraph.conf.DefaultImmutableClassesGiraphConfigurable

getConf, setConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

TextEdgeWriter

protected TextEdgeWriter()

Method Detail

initialize

public void initialize(org.apache.hadoop.mapreduce.TaskAttemptContext context)
                throws IOException,
                       InterruptedException

Description copied from class: EdgeWriter

Use the context to setup writing the edges. Guaranteed to be called prior to any other function.

Specified by:

initialize in class EdgeWriter<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

Parameters:

context - Context used to write the vertices.

Throws:

IOException

InterruptedException

createLineRecordWriter

protected org.apache.hadoop.mapreduce.RecordWriter<org.apache.hadoop.io.Text,org.apache.hadoop.io.Text> createLineRecordWriter(org.apache.hadoop.mapreduce.TaskAttemptContext context)
                                                                                                                        throws IOException,
                                                                                                                               InterruptedException

Create the line record writer. Override this to use a different underlying record writer (useful for testing).

Parameters:

context - the context passed to initialize

Returns:

the record writer to be used

Throws:

IOException - exception that can be thrown during creation

InterruptedException - exception that can be thrown during creation

close

public void close(org.apache.hadoop.mapreduce.TaskAttemptContext context)
           throws IOException,
                  InterruptedException

Description copied from class: EdgeWriter

Close this EdgeWriter to future operations.

Specified by:

close in class EdgeWriter<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

Parameters:

context - the context of the task

Throws:

IOException

InterruptedException

getRecordWriter

public org.apache.hadoop.mapreduce.RecordWriter<org.apache.hadoop.io.Text,org.apache.hadoop.io.Text> getRecordWriter()

Get the line record writer.

Returns:

Record writer to be used for writing.

getContext

public org.apache.hadoop.mapreduce.TaskAttemptContext getContext()

Get the context.

Returns:

Context passed to initialize.