org.apache.giraph.io.formats

Class TextVertexInputFormat.TextVertexReaderFromEachLineProcessed<T>

java.lang.Object

org.apache.giraph.conf.DefaultImmutableClassesGiraphConfigurable<I,V,E>

org.apache.giraph.worker.WorkerAggregatorDelegator<I,V,E>

org.apache.giraph.io.VertexReader<I,V,E>

org.apache.giraph.io.formats.TextVertexInputFormat.TextVertexReader

org.apache.giraph.io.formats.TextVertexInputFormat.TextVertexReaderFromEachLineProcessed<T>

Type Parameters:

T - The resulting type of preprocessing.

All Implemented Interfaces:

AggregatorUsage, GiraphConfigurationSettable<I,V,E>, ImmutableClassesGiraphConfigurable<I,V,E>, WorkerAggregatorUsage, WorkerBroadcastUsage, WorkerGlobalCommUsage, WorkerReduceUsage

Direct Known Subclasses:

AdjacencyListTextVertexInputFormat.AdjacencyListTextVertexReader, IntIntNullTextInputFormat.IntIntNullVertexReader, IntIntNullTextVertexInputFormat.IntIntNullVertexReader, IntNullNullTextInputFormat.IntNullNullNullVertexReader, JsonBase64VertexInputFormat.JsonBase64VertexReader, LongLongNullTextInputFormat.LongLongNullVertexReader, SccLongLongNullTextInputFormat.LongLongNullVertexReader

Enclosing class:

TextVertexInputFormat<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

protected abstract class TextVertexInputFormat.TextVertexReaderFromEachLineProcessed<T>
extends TextVertexInputFormat.TextVertexReader

Abstract class to be implemented by the user to read a vertex from each text line after preprocessing it.

Constructor Summary

Constructors

Modifier	Constructor and Description
protected	TextVertexReaderFromEachLineProcessed()

Method Summary

Modifier and Type	Method and Description
Vertex<I,V,E>	getCurrentVertex() Get the current vertex.
protected abstract Iterable<Edge<I,E>>	getEdges(T line) Reads edges from the preprocessed line.
protected abstract I	getId(T line) Reads vertex id from the preprocessed line.
protected abstract V	getValue(T line) Reads vertex value from the preprocessed line.
boolean	nextVertex()
protected abstract T	preprocessLine(org.apache.hadoop.io.Text line) Preprocess the line so other methods can easily read necessary information for creating vertex.

Methods inherited from class org.apache.giraph.io.formats.TextVertexInputFormat.TextVertexReader

close, createLineRecordReader, getContext, getProgress, getRecordReader, initialize

Methods inherited from class org.apache.giraph.worker.WorkerAggregatorDelegator

aggregate, getAggregatedValue, getBroadcast, reduce, reduceMerge, setWorkerGlobalCommUsage

Methods inherited from class org.apache.giraph.conf.DefaultImmutableClassesGiraphConfigurable

getConf, setConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

TextVertexReaderFromEachLineProcessed

protected TextVertexReaderFromEachLineProcessed()

Method Detail

nextVertex

public final boolean nextVertex()
                         throws IOException,
                                InterruptedException

Specified by:

nextVertex in class VertexReader<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

Returns:

false iff there are no more vertices

Throws:

IOException

InterruptedException

getCurrentVertex

public final Vertex<I,V,E> getCurrentVertex()
                                     throws IOException,
                                            InterruptedException

Description copied from class: VertexReader

Get the current vertex.

Specified by:

getCurrentVertex in class VertexReader<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

Returns:

the current vertex which has been read. nextVertex() should be called first.

Throws:

IOException

InterruptedException

preprocessLine

protected abstract T preprocessLine(org.apache.hadoop.io.Text line)
                             throws IOException

Preprocess the line so other methods can easily read necessary information for creating vertex.

Parameters:

line - the current line to be read

Returns:

the preprocessed object

Throws:

IOException - exception that can be thrown while reading

getId

protected abstract I getId(T line)
                    throws IOException

Reads vertex id from the preprocessed line.

Parameters:

line - the object obtained by preprocessing the line

Returns:

the vertex id

Throws:

IOException - exception that can be thrown while reading

getValue

protected abstract V getValue(T line)
                       throws IOException

Reads vertex value from the preprocessed line.

Parameters:

line - the object obtained by preprocessing the line

Returns:

the vertex value

Throws:

IOException - exception that can be thrown while reading

getEdges

protected abstract Iterable<Edge<I,E>> getEdges(T line)
                                         throws IOException

Reads edges from the preprocessed line.

Parameters:

line - the object obtained by preprocessing the line

Returns:

the edges

Throws:

IOException - exception that can be thrown while reading