org.apache.giraph.io.formats

Class TextEdgeInputFormat.TextEdgeReaderFromEachLineProcessed<T>

java.lang.Object

org.apache.giraph.conf.DefaultImmutableClassesGiraphConfigurable<I,V,E>

org.apache.giraph.worker.WorkerAggregatorDelegator<I,org.apache.hadoop.io.Writable,E>

org.apache.giraph.io.EdgeReader<I,E>

org.apache.giraph.io.formats.TextEdgeInputFormat.TextEdgeReader

org.apache.giraph.io.formats.TextEdgeInputFormat.TextEdgeReaderFromEachLineProcessed<T>

Type Parameters:

T - The resulting type of preprocessing.

All Implemented Interfaces:

AggregatorUsage, GiraphConfigurationSettable<I,org.apache.hadoop.io.Writable,E>, ImmutableClassesGiraphConfigurable<I,org.apache.hadoop.io.Writable,E>, WorkerAggregatorUsage, WorkerBroadcastUsage, WorkerGlobalCommUsage, WorkerReduceUsage

Direct Known Subclasses:

IntNullTextEdgeInputFormat.IntNullTextEdgeReader

Enclosing class:

TextEdgeInputFormat<I extends org.apache.hadoop.io.WritableComparable,E extends org.apache.hadoop.io.Writable>

protected abstract class TextEdgeInputFormat.TextEdgeReaderFromEachLineProcessed<T>
extends TextEdgeInputFormat.TextEdgeReader

Abstract class to be implemented by the user to read an edge from each text line after preprocessing it.

Constructor Summary

Constructors

Modifier	Constructor and Description
protected	TextEdgeReaderFromEachLineProcessed()

Method Summary

Modifier and Type	Method and Description
Edge<I,E>	getCurrentEdge() Get the current edge.
I	getCurrentSourceId() Get the current edge source id.
protected abstract I	getSourceVertexId(T line) Reads source vertex id from the preprocessed line.
protected abstract I	getTargetVertexId(T line) Reads target vertex id from the preprocessed line.
protected abstract E	getValue(T line) Reads edge value from the preprocessed line.
boolean	nextEdge() Read the next edge.
protected abstract T	preprocessLine(org.apache.hadoop.io.Text line) Preprocess the line so other methods can easily read necessary information for creating edge

Methods inherited from class org.apache.giraph.io.formats.TextEdgeInputFormat.TextEdgeReader

close, createLineRecordReader, getContext, getProgress, getRecordReader, initialize

Methods inherited from class org.apache.giraph.worker.WorkerAggregatorDelegator

aggregate, getAggregatedValue, getBroadcast, reduce, reduceMerge, setWorkerGlobalCommUsage

Methods inherited from class org.apache.giraph.conf.DefaultImmutableClassesGiraphConfigurable

getConf, setConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

TextEdgeReaderFromEachLineProcessed

protected TextEdgeReaderFromEachLineProcessed()

Method Detail

getCurrentSourceId

public I getCurrentSourceId()
                     throws IOException,
                            InterruptedException

Description copied from class: EdgeReader

Get the current edge source id.

Specified by:

getCurrentSourceId in class EdgeReader<I extends org.apache.hadoop.io.WritableComparable,E extends org.apache.hadoop.io.Writable>

Returns:

Current edge source id which has been read. nextEdge() should be called first.

Throws:

IOException

InterruptedException

getCurrentEdge

public final Edge<I,E> getCurrentEdge()
                               throws IOException,
                                      InterruptedException

Description copied from class: EdgeReader

Get the current edge.

Specified by:

getCurrentEdge in class EdgeReader<I extends org.apache.hadoop.io.WritableComparable,E extends org.apache.hadoop.io.Writable>

Returns:

the current edge which has been read. nextEdge() should be called first.

Throws:

IOException

InterruptedException

nextEdge

public final boolean nextEdge()
                       throws IOException,
                              InterruptedException

Description copied from class: EdgeReader

Read the next edge.

Specified by:

nextEdge in class EdgeReader<I extends org.apache.hadoop.io.WritableComparable,E extends org.apache.hadoop.io.Writable>

Returns:

false iff there are no more edges

Throws:

IOException

InterruptedException

preprocessLine

protected abstract T preprocessLine(org.apache.hadoop.io.Text line)
                             throws IOException

Preprocess the line so other methods can easily read necessary information for creating edge

Parameters:

line - the current line to be read

Returns:

the preprocessed object

Throws:

IOException - exception that can be thrown while reading

getTargetVertexId

protected abstract I getTargetVertexId(T line)
                                throws IOException

Reads target vertex id from the preprocessed line.

Parameters:

line - the object obtained by preprocessing the line

Returns:

the target vertex id

Throws:

IOException - exception that can be thrown while reading

getSourceVertexId

protected abstract I getSourceVertexId(T line)
                                throws IOException

Reads source vertex id from the preprocessed line.

Parameters:

line - the object obtained by preprocessing the line

Returns:

the source vertex id

Throws:

IOException - exception that can be thrown while reading

getValue

protected abstract E getValue(T line)
                       throws IOException

Reads edge value from the preprocessed line.

Parameters:

line - the object obtained by preprocessing the line

Returns:

the edge value

Throws:

IOException - exception that can be thrown while reading