org.apache.giraph.block_app.framework.output

Class BlockOutputFormat

java.lang.Object

org.apache.hadoop.mapreduce.OutputFormat<org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

org.apache.giraph.bsp.BspOutputFormat

org.apache.giraph.block_app.framework.output.BlockOutputFormat

public class BlockOutputFormat
extends BspOutputFormat

Hadoop output format to use with block output. It keeps track of all registered outputs, and knows how to create them.

Constructor Summary

Constructors

Constructor and Description
BlockOutputFormat()

Method Summary

Modifier and Type	Method and Description
static <OD> void	addOutputDesc(OD outputDesc, String confOption, GiraphConfiguration conf)
void	checkOutputSpecs(org.apache.hadoop.mapreduce.JobContext jobContext)
static <OW extends BlockOutputWriter,OD extends BlockOutputDesc<OW>> OD	createInitAndCheckOutputDesc(String confOption, org.apache.hadoop.conf.Configuration conf, String jobIdentifier)
static Map<String,BlockOutputDesc>	createInitAndCheckOutputDescsMap(org.apache.hadoop.conf.Configuration conf, String jobIdentifier)
static Map<String,BlockOutputDesc>	createInitAndCheckOutputDescsMap(org.apache.hadoop.mapreduce.JobContext jobContext)
org.apache.hadoop.mapreduce.OutputCommitter	getOutputCommitter(org.apache.hadoop.mapreduce.TaskAttemptContext context)
static String[]	getOutputConfOptions(org.apache.hadoop.conf.Configuration conf) Returns an array of output configuration options set in the input configuration.

Methods inherited from class org.apache.giraph.bsp.BspOutputFormat

getRecordWriter

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

BlockOutputFormat

public BlockOutputFormat()

Method Detail

addOutputDesc

public static <OD> void addOutputDesc(OD outputDesc,
                                      String confOption,
                                      GiraphConfiguration conf)

getOutputConfOptions

public static String[] getOutputConfOptions(org.apache.hadoop.conf.Configuration conf)

Returns an array of output configuration options set in the input configuration.

Parameters:

conf - Configuration

Returns:

Array of options

createInitAndCheckOutputDesc

public static <OW extends BlockOutputWriter,OD extends BlockOutputDesc<OW>> OD createInitAndCheckOutputDesc(String confOption,
                                                                                                            org.apache.hadoop.conf.Configuration conf,
                                                                                                            String jobIdentifier)

createInitAndCheckOutputDescsMap

public static Map<String,BlockOutputDesc> createInitAndCheckOutputDescsMap(org.apache.hadoop.conf.Configuration conf,
                                                                           String jobIdentifier)

createInitAndCheckOutputDescsMap

public static Map<String,BlockOutputDesc> createInitAndCheckOutputDescsMap(org.apache.hadoop.mapreduce.JobContext jobContext)

checkOutputSpecs

public void checkOutputSpecs(org.apache.hadoop.mapreduce.JobContext jobContext)
                      throws IOException,
                             InterruptedException

Overrides:

checkOutputSpecs in class BspOutputFormat

Throws:

IOException

InterruptedException

getOutputCommitter

public org.apache.hadoop.mapreduce.OutputCommitter getOutputCommitter(org.apache.hadoop.mapreduce.TaskAttemptContext context)
                                                               throws IOException,
                                                                      InterruptedException

Overrides:

getOutputCommitter in class BspOutputFormat

Throws:

IOException

InterruptedException