org.apache.giraph.io.formats

Class JsonBase64VertexInputFormat.JsonBase64VertexReader

java.lang.Object

org.apache.giraph.conf.DefaultImmutableClassesGiraphConfigurable<I,V,E>

org.apache.giraph.worker.WorkerAggregatorDelegator<I,V,E>

org.apache.giraph.io.VertexReader<I,V,E>

org.apache.giraph.io.formats.TextVertexInputFormat.TextVertexReader

org.apache.giraph.io.formats.TextVertexInputFormat.TextVertexReaderFromEachLineProcessed<org.json.JSONObject>

org.apache.giraph.io.formats.JsonBase64VertexInputFormat.JsonBase64VertexReader

All Implemented Interfaces:

AggregatorUsage, GiraphConfigurationSettable<I,V,E>, ImmutableClassesGiraphConfigurable<I,V,E>, WorkerAggregatorUsage, WorkerBroadcastUsage, WorkerGlobalCommUsage, WorkerReduceUsage

Enclosing class:

JsonBase64VertexInputFormat<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

protected class JsonBase64VertexInputFormat.JsonBase64VertexReader
extends TextVertexInputFormat.TextVertexReaderFromEachLineProcessed<org.json.JSONObject>

Simple reader that supports JsonBase64VertexInputFormat

Constructor Summary

Constructors

Modifier	Constructor and Description
protected	JsonBase64VertexReader()

Method Summary

Modifier and Type	Method and Description
protected Iterable<Edge<I,E>>	getEdges(org.json.JSONObject vertexObject) Reads edges from the preprocessed line.
protected I	getId(org.json.JSONObject vertexObject) Reads vertex id from the preprocessed line.
protected V	getValue(org.json.JSONObject vertexObject) Reads vertex value from the preprocessed line.
void	initialize(org.apache.hadoop.mapreduce.InputSplit inputSplit, org.apache.hadoop.mapreduce.TaskAttemptContext context) Use the input split and context to setup reading the vertices.
protected org.json.JSONObject	preprocessLine(org.apache.hadoop.io.Text line) Preprocess the line so other methods can easily read necessary information for creating vertex.

Methods inherited from class org.apache.giraph.io.formats.TextVertexInputFormat.TextVertexReaderFromEachLineProcessed

getCurrentVertex, nextVertex

Methods inherited from class org.apache.giraph.io.formats.TextVertexInputFormat.TextVertexReader

close, createLineRecordReader, getContext, getProgress, getRecordReader

Methods inherited from class org.apache.giraph.worker.WorkerAggregatorDelegator

aggregate, getAggregatedValue, getBroadcast, reduce, reduceMerge, setWorkerGlobalCommUsage

Methods inherited from class org.apache.giraph.conf.DefaultImmutableClassesGiraphConfigurable

getConf, setConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

JsonBase64VertexReader

protected JsonBase64VertexReader()

Method Detail

initialize

public void initialize(org.apache.hadoop.mapreduce.InputSplit inputSplit,
                       org.apache.hadoop.mapreduce.TaskAttemptContext context)
                throws IOException,
                       InterruptedException

Description copied from class: VertexReader

Use the input split and context to setup reading the vertices. Guaranteed to be called prior to any other function.

Overrides:

initialize in class TextVertexInputFormat.TextVertexReader

Parameters:

inputSplit - Input split to be used for reading vertices.

context - Context from the task.

Throws:

IOException

InterruptedException

preprocessLine

protected org.json.JSONObject preprocessLine(org.apache.hadoop.io.Text line)

Description copied from class: TextVertexInputFormat.TextVertexReaderFromEachLineProcessed

Preprocess the line so other methods can easily read necessary information for creating vertex.

Specified by:

preprocessLine in class TextVertexInputFormat.TextVertexReaderFromEachLineProcessed<org.json.JSONObject>

Parameters:

line - the current line to be read

Returns:

the preprocessed object

getId

protected I getId(org.json.JSONObject vertexObject)
           throws IOException

Description copied from class: TextVertexInputFormat.TextVertexReaderFromEachLineProcessed

Reads vertex id from the preprocessed line.

Specified by:

getId in class TextVertexInputFormat.TextVertexReaderFromEachLineProcessed<org.json.JSONObject>

Parameters:

vertexObject - the object obtained by preprocessing the line

Returns:

the vertex id

Throws:

IOException - exception that can be thrown while reading

getValue

protected V getValue(org.json.JSONObject vertexObject)
              throws IOException

Description copied from class: TextVertexInputFormat.TextVertexReaderFromEachLineProcessed

Reads vertex value from the preprocessed line.

Specified by:

getValue in class TextVertexInputFormat.TextVertexReaderFromEachLineProcessed<org.json.JSONObject>

Parameters:

vertexObject - the object obtained by preprocessing the line

Returns:

the vertex value

Throws:

IOException - exception that can be thrown while reading

getEdges

protected Iterable<Edge<I,E>> getEdges(org.json.JSONObject vertexObject)
                                throws IOException

Description copied from class: TextVertexInputFormat.TextVertexReaderFromEachLineProcessed

Reads edges from the preprocessed line.

Specified by:

getEdges in class TextVertexInputFormat.TextVertexReaderFromEachLineProcessed<org.json.JSONObject>

Parameters:

vertexObject - the object obtained by preprocessing the line

Returns:

the edges

Throws:

IOException - exception that can be thrown while reading