org.apache.giraph.edge

Class SimpleEdgeStore<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

java.lang.Object

org.apache.giraph.conf.DefaultImmutableClassesGiraphConfigurable<I,V,E>

org.apache.giraph.edge.AbstractEdgeStore<I,V,E,I,Map.Entry<I,OutEdges<I,E>>>

org.apache.giraph.edge.SimpleEdgeStore<I,V,E>

Type Parameters:

I - Vertex id

V - Vertex value

E - Edge value

All Implemented Interfaces:

GiraphConfigurationSettable<I,V,E>, ImmutableClassesGiraphConfigurable<I,V,E>, EdgeStore<I,V,E>

public class SimpleEdgeStore<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>
extends AbstractEdgeStore<I,V,E,I,Map.Entry<I,OutEdges<I,E>>>

Simple in memory edge store which supports any type of ids.

Field Summary

Fields inherited from class org.apache.giraph.edge.AbstractEdgeStore

configuration, PROGRESS_COUNTER, progressable, reuseEdgeObjects, service, transientEdges, useInputOutEdges

Constructor Summary

Constructors

Constructor and Description
SimpleEdgeStore(CentralizedServiceWorker<I,V,E> service, ImmutableClassesGiraphConfiguration<I,V,E> configuration, org.apache.hadoop.util.Progressable progressable) Constructor.

Method Summary

Modifier and Type	Method and Description
protected I	createVertexId(Map.Entry<I,OutEdges<I,E>> entry) Create vertexId from a given key
protected ConcurrentMap<I,OutEdges<I,E>>	getPartitionEdges(int partitionId) Get OutEdges for a given partition
protected OutEdges<I,E>	getPartitionEdges(Map.Entry<I,OutEdges<I,E>> entry) Return the OutEdges for a given partition
protected Iterator<Map.Entry<I,OutEdges<I,E>>>	getPartitionEdgesIterator(Map<I,OutEdges<I,E>> partitionEdges) Get iterator for partition edges
protected I	getVertexId(Map.Entry<I,OutEdges<I,E>> entry, I representativeVertexId) Get vertexId for a given key
protected OutEdges<I,E>	getVertexOutEdges(VertexIdEdgeIterator<I,E> vertexIdEdgeIterator, Map<I,OutEdges<I,E>> partitionEdgesIn) Get out-edges for a given vertex
protected I	readVertexKey(DataInput input) Reads the given key from the input
protected void	writeVertexKey(I key, DataOutput output) Writes the given key to the output

Methods inherited from class org.apache.giraph.edge.AbstractEdgeStore

addPartitionEdges, hasEdgesForPartition, moveEdgesToVertices, readPartitionEdgeStore, writePartitionEdgeStore

Methods inherited from class org.apache.giraph.conf.DefaultImmutableClassesGiraphConfigurable

getConf, setConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SimpleEdgeStore

public SimpleEdgeStore(CentralizedServiceWorker<I,V,E> service,
                       ImmutableClassesGiraphConfiguration<I,V,E> configuration,
                       org.apache.hadoop.util.Progressable progressable)

Constructor.

Parameters:

service - Service worker

configuration - Configuration

progressable - Progressable

Method Detail

getVertexId

protected I getVertexId(Map.Entry<I,OutEdges<I,E>> entry,
                        I representativeVertexId)

Description copied from class: AbstractEdgeStore

Get vertexId for a given key

Specified by:

getVertexId in class AbstractEdgeStore<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable,I extends org.apache.hadoop.io.WritableComparable,Map.Entry<I extends org.apache.hadoop.io.WritableComparable,OutEdges<I extends org.apache.hadoop.io.WritableComparable,E extends org.apache.hadoop.io.Writable>>>

Parameters:

entry - for vertexId key

representativeVertexId - representativeVertexId

Returns:

vertex Id

createVertexId

protected I createVertexId(Map.Entry<I,OutEdges<I,E>> entry)

Description copied from class: AbstractEdgeStore

Create vertexId from a given key

Specified by:

createVertexId in class AbstractEdgeStore<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable,I extends org.apache.hadoop.io.WritableComparable,Map.Entry<I extends org.apache.hadoop.io.WritableComparable,OutEdges<I extends org.apache.hadoop.io.WritableComparable,E extends org.apache.hadoop.io.Writable>>>

Parameters:

entry - for vertexId key

Returns:

new vertexId

getPartitionEdges

protected ConcurrentMap<I,OutEdges<I,E>> getPartitionEdges(int partitionId)

Description copied from class: AbstractEdgeStore

Get OutEdges for a given partition

Specified by:

getPartitionEdges in class AbstractEdgeStore<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable,I extends org.apache.hadoop.io.WritableComparable,Map.Entry<I extends org.apache.hadoop.io.WritableComparable,OutEdges<I extends org.apache.hadoop.io.WritableComparable,E extends org.apache.hadoop.io.Writable>>>

Parameters:

partitionId - id of partition

Returns:

OutEdges for the partition

getPartitionEdges

protected OutEdges<I,E> getPartitionEdges(Map.Entry<I,OutEdges<I,E>> entry)

Description copied from class: AbstractEdgeStore

Return the OutEdges for a given partition

Specified by:

getPartitionEdges in class AbstractEdgeStore<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable,I extends org.apache.hadoop.io.WritableComparable,Map.Entry<I extends org.apache.hadoop.io.WritableComparable,OutEdges<I extends org.apache.hadoop.io.WritableComparable,E extends org.apache.hadoop.io.Writable>>>

Parameters:

entry - for vertexId key

Returns:

out edges

writeVertexKey

protected void writeVertexKey(I key,
                              DataOutput output)
                       throws IOException

Description copied from class: AbstractEdgeStore

Writes the given key to the output

Specified by:

writeVertexKey in class AbstractEdgeStore<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable,I extends org.apache.hadoop.io.WritableComparable,Map.Entry<I extends org.apache.hadoop.io.WritableComparable,OutEdges<I extends org.apache.hadoop.io.WritableComparable,E extends org.apache.hadoop.io.Writable>>>

Parameters:

key - input key to be written

output - output to write the key to

Throws:

IOException

readVertexKey

protected I readVertexKey(DataInput input)
                   throws IOException

Description copied from class: AbstractEdgeStore

Reads the given key from the input

Specified by:

readVertexKey in class AbstractEdgeStore<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable,I extends org.apache.hadoop.io.WritableComparable,Map.Entry<I extends org.apache.hadoop.io.WritableComparable,OutEdges<I extends org.apache.hadoop.io.WritableComparable,E extends org.apache.hadoop.io.Writable>>>

Parameters:

input - input to read the key from

Returns:

Key read from the input

Throws:

IOException

getPartitionEdgesIterator

protected Iterator<Map.Entry<I,OutEdges<I,E>>> getPartitionEdgesIterator(Map<I,OutEdges<I,E>> partitionEdges)

Description copied from class: AbstractEdgeStore

Get iterator for partition edges

Specified by:

getPartitionEdgesIterator in class AbstractEdgeStore<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable,I extends org.apache.hadoop.io.WritableComparable,Map.Entry<I extends org.apache.hadoop.io.WritableComparable,OutEdges<I extends org.apache.hadoop.io.WritableComparable,E extends org.apache.hadoop.io.Writable>>>

Parameters:

partitionEdges - map of out-edges for vertices in a partition

Returns:

iterator

getVertexOutEdges

protected OutEdges<I,E> getVertexOutEdges(VertexIdEdgeIterator<I,E> vertexIdEdgeIterator,
                                          Map<I,OutEdges<I,E>> partitionEdgesIn)

Description copied from class: AbstractEdgeStore

Get out-edges for a given vertex

Specified by:

getVertexOutEdges in class AbstractEdgeStore<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable,I extends org.apache.hadoop.io.WritableComparable,Map.Entry<I extends org.apache.hadoop.io.WritableComparable,OutEdges<I extends org.apache.hadoop.io.WritableComparable,E extends org.apache.hadoop.io.Writable>>>

Parameters:

vertexIdEdgeIterator - vertex Id Edge iterator

partitionEdgesIn - map of out-edges for vertices in a partition

Returns:

out-edges for the vertex