org.apache.giraph.io.formats

Class AdjacencyListTextVertexInputFormat.AdjacencyListTextVertexReader

java.lang.Object

org.apache.giraph.conf.DefaultImmutableClassesGiraphConfigurable<I,V,E>

org.apache.giraph.worker.WorkerAggregatorDelegator<I,V,E>

org.apache.giraph.io.VertexReader<I,V,E>

org.apache.giraph.io.formats.TextVertexInputFormat.TextVertexReader

org.apache.giraph.io.formats.TextVertexInputFormat.TextVertexReaderFromEachLineProcessed<String[]>

org.apache.giraph.io.formats.AdjacencyListTextVertexInputFormat.AdjacencyListTextVertexReader

All Implemented Interfaces:

AggregatorUsage, GiraphConfigurationSettable<I,V,E>, ImmutableClassesGiraphConfigurable<I,V,E>, WorkerAggregatorUsage, WorkerBroadcastUsage, WorkerGlobalCommUsage, WorkerReduceUsage

Direct Known Subclasses:

LongDoubleDoubleAdjacencyListVertexInputFormat.LongDoubleDoubleAdjacencyListVertexReader, TextDoubleDoubleAdjacencyListVertexInputFormat.TextDoubleDoubleAdjacencyListVertexReader

Enclosing class:

AdjacencyListTextVertexInputFormat<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

protected abstract class AdjacencyListTextVertexInputFormat.AdjacencyListTextVertexReader
extends TextVertexInputFormat.TextVertexReaderFromEachLineProcessed<String[]>

Vertex reader associated with AdjacencyListTextVertexInputFormat.

Constructor Summary

Constructors

Constructor and Description
AdjacencyListTextVertexReader() Constructor without line sanitizer.
AdjacencyListTextVertexReader(AdjacencyListTextVertexInputFormat.LineSanitizer sanitizer) Constructor with line sanitizer.

Method Summary

Modifier and Type	Method and Description
abstract Edge<I,E>	decodeEdge(String id, String value) Decode an edge from the line into an instance of a correctly typed Edge
abstract I	decodeId(String s) Decode the id for this line into an instance of its correct type.
abstract V	decodeValue(String s) Decode the value for this line into an instance of its correct type.
protected Iterable<Edge<I,E>>	getEdges(String[] values) Reads edges from the preprocessed line.
protected I	getId(String[] values) Reads vertex id from the preprocessed line.
protected V	getValue(String[] values) Reads vertex value from the preprocessed line.
void	initialize(org.apache.hadoop.mapreduce.InputSplit inputSplit, org.apache.hadoop.mapreduce.TaskAttemptContext context) Use the input split and context to setup reading the vertices.
protected String[]	preprocessLine(org.apache.hadoop.io.Text line) Preprocess the line so other methods can easily read necessary information for creating vertex.

Methods inherited from class org.apache.giraph.io.formats.TextVertexInputFormat.TextVertexReaderFromEachLineProcessed

getCurrentVertex, nextVertex

Methods inherited from class org.apache.giraph.io.formats.TextVertexInputFormat.TextVertexReader

close, createLineRecordReader, getContext, getProgress, getRecordReader

Methods inherited from class org.apache.giraph.worker.WorkerAggregatorDelegator

aggregate, getAggregatedValue, getBroadcast, reduce, reduceMerge, setWorkerGlobalCommUsage

Methods inherited from class org.apache.giraph.conf.DefaultImmutableClassesGiraphConfigurable

getConf, setConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

AdjacencyListTextVertexReader

public AdjacencyListTextVertexReader()

Constructor without line sanitizer.

AdjacencyListTextVertexReader

public AdjacencyListTextVertexReader(AdjacencyListTextVertexInputFormat.LineSanitizer sanitizer)

Constructor with line sanitizer.

Parameters:

sanitizer - Sanitizer to be used.

Method Detail

initialize

public void initialize(org.apache.hadoop.mapreduce.InputSplit inputSplit,
                       org.apache.hadoop.mapreduce.TaskAttemptContext context)
                throws IOException,
                       InterruptedException

Description copied from class: VertexReader

Use the input split and context to setup reading the vertices. Guaranteed to be called prior to any other function.

Overrides:

initialize in class TextVertexInputFormat.TextVertexReader

Parameters:

inputSplit - Input split to be used for reading vertices.

context - Context from the task.

Throws:

IOException

InterruptedException

preprocessLine

protected String[] preprocessLine(org.apache.hadoop.io.Text line)
                           throws IOException

Description copied from class: TextVertexInputFormat.TextVertexReaderFromEachLineProcessed

Preprocess the line so other methods can easily read necessary information for creating vertex.

Specified by:

preprocessLine in class TextVertexInputFormat.TextVertexReaderFromEachLineProcessed<String[]>

Parameters:

line - the current line to be read

Returns:

the preprocessed object

Throws:

IOException - exception that can be thrown while reading

getId

protected I getId(String[] values)
           throws IOException

Description copied from class: TextVertexInputFormat.TextVertexReaderFromEachLineProcessed

Reads vertex id from the preprocessed line.

Specified by:

getId in class TextVertexInputFormat.TextVertexReaderFromEachLineProcessed<String[]>

Parameters:

values - the object obtained by preprocessing the line

Returns:

the vertex id

Throws:

IOException - exception that can be thrown while reading

decodeId

public abstract I decodeId(String s)

Decode the id for this line into an instance of its correct type.

Parameters:

s - Id of vertex from line

Returns:

Vertex id

getValue

protected V getValue(String[] values)
              throws IOException

Description copied from class: TextVertexInputFormat.TextVertexReaderFromEachLineProcessed

Reads vertex value from the preprocessed line.

Specified by:

getValue in class TextVertexInputFormat.TextVertexReaderFromEachLineProcessed<String[]>

Parameters:

values - the object obtained by preprocessing the line

Returns:

the vertex value

Throws:

IOException - exception that can be thrown while reading

decodeValue

public abstract V decodeValue(String s)

Decode the value for this line into an instance of its correct type.

Parameters:

s - Value from line

Returns:

Vertex value

getEdges

protected Iterable<Edge<I,E>> getEdges(String[] values)
                                throws IOException

Description copied from class: TextVertexInputFormat.TextVertexReaderFromEachLineProcessed

Reads edges from the preprocessed line.

Specified by:

getEdges in class TextVertexInputFormat.TextVertexReaderFromEachLineProcessed<String[]>

Parameters:

values - the object obtained by preprocessing the line

Returns:

the edges

Throws:

IOException - exception that can be thrown while reading

decodeEdge

public abstract Edge<I,E> decodeEdge(String id,
                                     String value)

Decode an edge from the line into an instance of a correctly typed Edge

Parameters:

id - The edge's id from the line

value - The edge's value from the line

Returns:

Edge with given target id and value