org.apache.giraph.io.formats

Class AdjacencyListTextVertexInputFormat<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

java.lang.Object

org.apache.giraph.conf.DefaultImmutableClassesGiraphConfigurable<I,V,E>

org.apache.giraph.io.GiraphInputFormat<I,V,E>

org.apache.giraph.io.VertexInputFormat<I,V,E>

org.apache.giraph.io.formats.TextVertexInputFormat<I,V,E>

org.apache.giraph.io.formats.AdjacencyListTextVertexInputFormat<I,V,E>

Type Parameters:

I - Vertex index value

V - Vertex value

E - Edge value

All Implemented Interfaces:

GiraphConfigurationSettable<I,V,E>, ImmutableClassesGiraphConfigurable<I,V,E>

Direct Known Subclasses:

LongDoubleDoubleAdjacencyListVertexInputFormat, TextDoubleDoubleAdjacencyListVertexInputFormat

public abstract class AdjacencyListTextVertexInputFormat<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>
extends TextVertexInputFormat<I,V,E>

VertexReader that readers lines of text with vertices encoded as adjacency lists and converts each token to the correct type. For example, a graph with vertices as integers and values as doubles could be encoded as: 1 0.1 2 0.2 3 0.3 to represent a vertex named 1, with 0.1 as its value and two edges, to vertices 2 and 3, with edge values of 0.2 and 0.3, respectively.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
protected class	AdjacencyListTextVertexInputFormat.AdjacencyListTextVertexReader Vertex reader associated with AdjacencyListTextVertexInputFormat.
static interface	AdjacencyListTextVertexInputFormat.LineSanitizer Utility for doing any cleaning of each line before it is tokenized.

Nested classes/interfaces inherited from class org.apache.giraph.io.formats.TextVertexInputFormat

TextVertexInputFormat.TextVertexReader, TextVertexInputFormat.TextVertexReaderFromEachLine, TextVertexInputFormat.TextVertexReaderFromEachLineProcessed<T>, TextVertexInputFormat.TextVertexReaderFromEachLineProcessedHandlingExceptions<T,X extends Throwable>

Field Summary

Fields

Modifier and Type	Field and Description
static String	LINE_TOKENIZE_VALUE Delimiter for split
static String	LINE_TOKENIZE_VALUE_DEFAULT Default delimiter for split

Fields inherited from class org.apache.giraph.io.formats.TextVertexInputFormat

textInputFormat

Constructor Summary

Constructors

Constructor and Description
AdjacencyListTextVertexInputFormat()

Method Summary

Modifier and Type	Method and Description
abstract AdjacencyListTextVertexInputFormat.AdjacencyListTextVertexReader	createVertexReader(org.apache.hadoop.mapreduce.InputSplit split, org.apache.hadoop.mapreduce.TaskAttemptContext context) The factory method which produces the TextVertexInputFormat.TextVertexReader used by this input format.

Methods inherited from class org.apache.giraph.io.formats.TextVertexInputFormat

checkInputSpecs, getSplits

Methods inherited from class org.apache.giraph.io.GiraphInputFormat

readInputSplit, writeInputSplit

Methods inherited from class org.apache.giraph.conf.DefaultImmutableClassesGiraphConfigurable

getConf, setConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

LINE_TOKENIZE_VALUE

public static final String LINE_TOKENIZE_VALUE

Delimiter for split

See Also:

Constant Field Values

LINE_TOKENIZE_VALUE_DEFAULT

public static final String LINE_TOKENIZE_VALUE_DEFAULT

Default delimiter for split

See Also:

Constant Field Values

Constructor Detail

AdjacencyListTextVertexInputFormat

public AdjacencyListTextVertexInputFormat()

Method Detail

createVertexReader

public abstract AdjacencyListTextVertexInputFormat.AdjacencyListTextVertexReader createVertexReader(org.apache.hadoop.mapreduce.InputSplit split,
                                                                                                    org.apache.hadoop.mapreduce.TaskAttemptContext context)

Description copied from class: TextVertexInputFormat

The factory method which produces the TextVertexInputFormat.TextVertexReader used by this input format.

Specified by:

createVertexReader in class TextVertexInputFormat<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

Parameters:

split - the split to be read

context - the information about the task

Returns:

the text vertex reader to be used