org.apache.giraph.edge.primitives

Class IntEdgeStore<V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

java.lang.Object

org.apache.giraph.conf.DefaultImmutableClassesGiraphConfigurable<I,V,E>

org.apache.giraph.edge.AbstractEdgeStore<org.apache.hadoop.io.IntWritable,V,E,Integer,it.unimi.dsi.fastutil.ints.Int2ObjectMap.Entry<OutEdges<org.apache.hadoop.io.IntWritable,E>>>

org.apache.giraph.edge.primitives.IntEdgeStore<V,E>

Type Parameters:

V - Vertex value

E - Edge value

All Implemented Interfaces:

GiraphConfigurationSettable<org.apache.hadoop.io.IntWritable,V,E>, ImmutableClassesGiraphConfigurable<org.apache.hadoop.io.IntWritable,V,E>, EdgeStore<org.apache.hadoop.io.IntWritable,V,E>

public class IntEdgeStore<V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>
extends AbstractEdgeStore<org.apache.hadoop.io.IntWritable,V,E,Integer,it.unimi.dsi.fastutil.ints.Int2ObjectMap.Entry<OutEdges<org.apache.hadoop.io.IntWritable,E>>>

Special edge store to be used when ids are IntWritable. Uses fastutil primitive maps in order to decrease number of objects and get better performance.

Field Summary

Fields inherited from class org.apache.giraph.edge.AbstractEdgeStore

configuration, PROGRESS_COUNTER, progressable, reuseEdgeObjects, service, transientEdges, useInputOutEdges

Constructor Summary

Constructors

Constructor and Description
IntEdgeStore(CentralizedServiceWorker<org.apache.hadoop.io.IntWritable,V,E> service, ImmutableClassesGiraphConfiguration<org.apache.hadoop.io.IntWritable,V,E> configuration, org.apache.hadoop.util.Progressable progressable) Constructor.

Method Summary

Modifier and Type	Method and Description
protected org.apache.hadoop.io.IntWritable	createVertexId(it.unimi.dsi.fastutil.ints.Int2ObjectMap.Entry<OutEdges<org.apache.hadoop.io.IntWritable,E>> entry) Create vertexId from a given key
protected it.unimi.dsi.fastutil.ints.Int2ObjectMap<OutEdges<org.apache.hadoop.io.IntWritable,E>>	getPartitionEdges(int partitionId) Get OutEdges for a given partition
protected OutEdges<org.apache.hadoop.io.IntWritable,E>	getPartitionEdges(it.unimi.dsi.fastutil.ints.Int2ObjectMap.Entry<OutEdges<org.apache.hadoop.io.IntWritable,E>> entry) Return the OutEdges for a given partition
protected Iterator<it.unimi.dsi.fastutil.ints.Int2ObjectMap.Entry<OutEdges<org.apache.hadoop.io.IntWritable,E>>>	getPartitionEdgesIterator(Map<Integer,OutEdges<org.apache.hadoop.io.IntWritable,E>> partitionEdges) Get iterator for partition edges
protected org.apache.hadoop.io.IntWritable	getVertexId(it.unimi.dsi.fastutil.ints.Int2ObjectMap.Entry<OutEdges<org.apache.hadoop.io.IntWritable,E>> entry, org.apache.hadoop.io.IntWritable representativeVertexId) Get vertexId for a given key
protected OutEdges<org.apache.hadoop.io.IntWritable,E>	getVertexOutEdges(VertexIdEdgeIterator<org.apache.hadoop.io.IntWritable,E> vertexIdEdgeIterator, Map<Integer,OutEdges<org.apache.hadoop.io.IntWritable,E>> partitionEdgesIn) Get out-edges for a given vertex
protected Integer	readVertexKey(DataInput input) Reads the given key from the input
protected void	writeVertexKey(Integer key, DataOutput output) Writes the given key to the output

Methods inherited from class org.apache.giraph.edge.AbstractEdgeStore

addPartitionEdges, hasEdgesForPartition, moveEdgesToVertices, readPartitionEdgeStore, writePartitionEdgeStore

Methods inherited from class org.apache.giraph.conf.DefaultImmutableClassesGiraphConfigurable

getConf, setConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

IntEdgeStore

public IntEdgeStore(CentralizedServiceWorker<org.apache.hadoop.io.IntWritable,V,E> service,
                    ImmutableClassesGiraphConfiguration<org.apache.hadoop.io.IntWritable,V,E> configuration,
                    org.apache.hadoop.util.Progressable progressable)

Constructor.

Parameters:

service - Service worker

configuration - Configuration

progressable - Progressable

Method Detail

getVertexId

protected org.apache.hadoop.io.IntWritable getVertexId(it.unimi.dsi.fastutil.ints.Int2ObjectMap.Entry<OutEdges<org.apache.hadoop.io.IntWritable,E>> entry,
                                                       org.apache.hadoop.io.IntWritable representativeVertexId)

Description copied from class: AbstractEdgeStore

Get vertexId for a given key

Specified by:

getVertexId in class AbstractEdgeStore<org.apache.hadoop.io.IntWritable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable,Integer,it.unimi.dsi.fastutil.ints.Int2ObjectMap.Entry<OutEdges<org.apache.hadoop.io.IntWritable,E extends org.apache.hadoop.io.Writable>>>

Parameters:

entry - for vertexId key

representativeVertexId - representativeVertexId

Returns:

vertex Id

createVertexId

protected org.apache.hadoop.io.IntWritable createVertexId(it.unimi.dsi.fastutil.ints.Int2ObjectMap.Entry<OutEdges<org.apache.hadoop.io.IntWritable,E>> entry)

Description copied from class: AbstractEdgeStore

Create vertexId from a given key

Specified by:

createVertexId in class AbstractEdgeStore<org.apache.hadoop.io.IntWritable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable,Integer,it.unimi.dsi.fastutil.ints.Int2ObjectMap.Entry<OutEdges<org.apache.hadoop.io.IntWritable,E extends org.apache.hadoop.io.Writable>>>

Parameters:

entry - for vertexId key

Returns:

new vertexId

getPartitionEdges

protected OutEdges<org.apache.hadoop.io.IntWritable,E> getPartitionEdges(it.unimi.dsi.fastutil.ints.Int2ObjectMap.Entry<OutEdges<org.apache.hadoop.io.IntWritable,E>> entry)

Description copied from class: AbstractEdgeStore

Return the OutEdges for a given partition

Specified by:

getPartitionEdges in class AbstractEdgeStore<org.apache.hadoop.io.IntWritable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable,Integer,it.unimi.dsi.fastutil.ints.Int2ObjectMap.Entry<OutEdges<org.apache.hadoop.io.IntWritable,E extends org.apache.hadoop.io.Writable>>>

Parameters:

entry - for vertexId key

Returns:

out edges

writeVertexKey

protected void writeVertexKey(Integer key,
                              DataOutput output)
                       throws IOException

Description copied from class: AbstractEdgeStore

Writes the given key to the output

Specified by:

writeVertexKey in class AbstractEdgeStore<org.apache.hadoop.io.IntWritable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable,Integer,it.unimi.dsi.fastutil.ints.Int2ObjectMap.Entry<OutEdges<org.apache.hadoop.io.IntWritable,E extends org.apache.hadoop.io.Writable>>>

Parameters:

key - input key to be written

output - output to write the key to

Throws:

IOException

readVertexKey

protected Integer readVertexKey(DataInput input)
                         throws IOException

Description copied from class: AbstractEdgeStore

Reads the given key from the input

Specified by:

readVertexKey in class AbstractEdgeStore<org.apache.hadoop.io.IntWritable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable,Integer,it.unimi.dsi.fastutil.ints.Int2ObjectMap.Entry<OutEdges<org.apache.hadoop.io.IntWritable,E extends org.apache.hadoop.io.Writable>>>

Parameters:

input - input to read the key from

Returns:

Key read from the input

Throws:

IOException

getPartitionEdgesIterator

protected Iterator<it.unimi.dsi.fastutil.ints.Int2ObjectMap.Entry<OutEdges<org.apache.hadoop.io.IntWritable,E>>> getPartitionEdgesIterator(Map<Integer,OutEdges<org.apache.hadoop.io.IntWritable,E>> partitionEdges)

Description copied from class: AbstractEdgeStore

Get iterator for partition edges

Specified by:

getPartitionEdgesIterator in class AbstractEdgeStore<org.apache.hadoop.io.IntWritable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable,Integer,it.unimi.dsi.fastutil.ints.Int2ObjectMap.Entry<OutEdges<org.apache.hadoop.io.IntWritable,E extends org.apache.hadoop.io.Writable>>>

Parameters:

partitionEdges - map of out-edges for vertices in a partition

Returns:

iterator

getPartitionEdges

protected it.unimi.dsi.fastutil.ints.Int2ObjectMap<OutEdges<org.apache.hadoop.io.IntWritable,E>> getPartitionEdges(int partitionId)

Description copied from class: AbstractEdgeStore

Get OutEdges for a given partition

Specified by:

getPartitionEdges in class AbstractEdgeStore<org.apache.hadoop.io.IntWritable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable,Integer,it.unimi.dsi.fastutil.ints.Int2ObjectMap.Entry<OutEdges<org.apache.hadoop.io.IntWritable,E extends org.apache.hadoop.io.Writable>>>

Parameters:

partitionId - id of partition

Returns:

OutEdges for the partition

getVertexOutEdges

protected OutEdges<org.apache.hadoop.io.IntWritable,E> getVertexOutEdges(VertexIdEdgeIterator<org.apache.hadoop.io.IntWritable,E> vertexIdEdgeIterator,
                                                                         Map<Integer,OutEdges<org.apache.hadoop.io.IntWritable,E>> partitionEdgesIn)

Description copied from class: AbstractEdgeStore

Get out-edges for a given vertex

Specified by:

getVertexOutEdges in class AbstractEdgeStore<org.apache.hadoop.io.IntWritable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable,Integer,it.unimi.dsi.fastutil.ints.Int2ObjectMap.Entry<OutEdges<org.apache.hadoop.io.IntWritable,E extends org.apache.hadoop.io.Writable>>>

Parameters:

vertexIdEdgeIterator - vertex Id Edge iterator

partitionEdgesIn - map of out-edges for vertices in a partition

Returns:

out-edges for the vertex