org.apache.giraph.io.formats

Class TextVertexValueInputFormat.TextVertexValueReaderFromEachLineProcessed<T>

java.lang.Object

org.apache.giraph.conf.DefaultImmutableClassesGiraphConfigurable<I,V,E>

org.apache.giraph.worker.WorkerAggregatorDelegator<I,V,E>

org.apache.giraph.io.VertexReader<I,V,org.apache.hadoop.io.Writable>

org.apache.giraph.io.BasicVertexValueReader<I,V>

org.apache.giraph.io.VertexValueReader<I,V>

org.apache.giraph.io.formats.TextVertexValueInputFormat.TextVertexValueReader

org.apache.giraph.io.formats.TextVertexValueInputFormat.TextVertexValueReaderFromEachLineProcessed<T>

Type Parameters:

T - The resulting type of preprocessing.

All Implemented Interfaces:

AggregatorUsage, GiraphConfigurationSettable<I,V,org.apache.hadoop.io.Writable>, ImmutableClassesGiraphConfigurable<I,V,org.apache.hadoop.io.Writable>, WorkerAggregatorUsage, WorkerBroadcastUsage, WorkerGlobalCommUsage, WorkerReduceUsage

Direct Known Subclasses:

IntIntTextVertexValueInputFormat.IntIntTextVertexValueReader

Enclosing class:

TextVertexValueInputFormat<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

protected abstract class TextVertexValueInputFormat.TextVertexValueReaderFromEachLineProcessed<T>
extends TextVertexValueInputFormat.TextVertexValueReader

Abstract class to be implemented by the user to read a vertex value from each text line after preprocessing it.

Constructor Summary

Constructors

Modifier	Constructor and Description
protected	TextVertexValueReaderFromEachLineProcessed()

Method Summary

Modifier and Type	Method and Description
I	getCurrentVertexId() User-defined method to extract the vertex id.
V	getCurrentVertexValue() User-defined method to extract the vertex value.
protected abstract I	getId(T line) Reads vertex id from the preprocessed line.
protected abstract V	getValue(T line) Reads vertex value from the preprocessed line.
boolean	nextVertex()
protected abstract T	preprocessLine(org.apache.hadoop.io.Text line) Preprocess the line so other methods can easily read necessary information for creating vertex.

Methods inherited from class org.apache.giraph.io.formats.TextVertexValueInputFormat.TextVertexValueReader

close, createLineRecordReader, getContext, getProgress, getRecordReader, initialize

Methods inherited from class org.apache.giraph.io.VertexValueReader

getCurrentVertex

Methods inherited from class org.apache.giraph.worker.WorkerAggregatorDelegator

aggregate, getAggregatedValue, getBroadcast, reduce, reduceMerge, setWorkerGlobalCommUsage

Methods inherited from class org.apache.giraph.conf.DefaultImmutableClassesGiraphConfigurable

getConf, setConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

TextVertexValueReaderFromEachLineProcessed

protected TextVertexValueReaderFromEachLineProcessed()

Method Detail

getCurrentVertexId

public I getCurrentVertexId()
                     throws IOException,
                            InterruptedException

Description copied from class: BasicVertexValueReader

User-defined method to extract the vertex id.

Specified by:

getCurrentVertexId in class BasicVertexValueReader<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable>

Returns:

The vertex id

Throws:

IOException

InterruptedException

getCurrentVertexValue

public V getCurrentVertexValue()
                        throws IOException,
                               InterruptedException

Description copied from class: BasicVertexValueReader

User-defined method to extract the vertex value.

Specified by:

getCurrentVertexValue in class BasicVertexValueReader<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable>

Returns:

The vertex value

Throws:

IOException

InterruptedException

nextVertex

public final boolean nextVertex()
                         throws IOException,
                                InterruptedException

Specified by:

nextVertex in class VertexReader<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,org.apache.hadoop.io.Writable>

Returns:

false iff there are no more vertices

Throws:

IOException

InterruptedException

preprocessLine

protected abstract T preprocessLine(org.apache.hadoop.io.Text line)
                             throws IOException

Preprocess the line so other methods can easily read necessary information for creating vertex.

Parameters:

line - the current line to be read

Returns:

the preprocessed object

Throws:

IOException - exception that can be thrown while reading

getId

protected abstract I getId(T line)
                    throws IOException

Reads vertex id from the preprocessed line.

Parameters:

line - the object obtained by preprocessing the line

Returns:

the vertex id

Throws:

IOException - exception that can be thrown while reading

getValue

protected abstract V getValue(T line)
                       throws IOException

Reads vertex value from the preprocessed line.

Parameters:

line - the object obtained by preprocessing the line

Returns:

the vertex value

Throws:

IOException - exception that can be thrown while reading