org.apache.giraph.comm.messages.primitives.long_id

Class LongAbstractStore<M extends org.apache.hadoop.io.Writable,T>

java.lang.Object

org.apache.giraph.comm.messages.primitives.long_id.LongAbstractStore<M,T>

Type Parameters:

M - message type

T - datastructure used to hold messages

All Implemented Interfaces:

MessageStore<org.apache.hadoop.io.LongWritable,M>

Direct Known Subclasses:

LongAbstractListStore

public abstract class LongAbstractStore<M extends org.apache.hadoop.io.Writable,T>
extends Object
implements MessageStore<org.apache.hadoop.io.LongWritable,M>

Special message store to be used when ids are LongWritable and no combiner is used. Uses fastutil primitive maps in order to decrease number of objects and get better performance.

Field Summary

Fields

Modifier and Type	Field and Description
protected ImmutableClassesGiraphConfiguration<org.apache.hadoop.io.LongWritable,?,?>	config Giraph configuration
protected it.unimi.dsi.fastutil.ints.Int2ObjectOpenHashMap<it.unimi.dsi.fastutil.longs.Long2ObjectOpenHashMap<T>>	map Map from partition id to map from vertex id to message
protected MessageValueFactory<M>	messageValueFactory Message value factory
protected PartitionSplitInfo<org.apache.hadoop.io.LongWritable>	partitionInfo Service worker

Constructor Summary

Constructors

Constructor and Description
LongAbstractStore(MessageValueFactory<M> messageValueFactory, PartitionSplitInfo<org.apache.hadoop.io.LongWritable> partitionInfo, ImmutableClassesGiraphConfiguration<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Writable,org.apache.hadoop.io.Writable> config) Constructor

Method Summary

Modifier and Type	Method and Description
void	clearAll() Clears all resources used by this store.
void	clearPartition(int partitionId) Clears messages for a partition.
void	clearVertexMessages(org.apache.hadoop.io.LongWritable vertexId) Clears messages for a vertex.
Iterable<org.apache.hadoop.io.LongWritable>	getPartitionDestinationVertices(int partitionId) Gets vertex ids from selected partition which we have messages for
protected it.unimi.dsi.fastutil.longs.Long2ObjectOpenHashMap<T>	getPartitionMap(org.apache.hadoop.io.LongWritable vertexId) Get map which holds messages for partition which vertex belongs to.
boolean	hasMessagesForPartition(int partitionId) Check if we have messages for some partition
boolean	hasMessagesForVertex(org.apache.hadoop.io.LongWritable vertexId) Check if we have messages for some vertex

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.giraph.comm.messages.MessageStore

addMessage, addPartitionMessages, finalizeStore, getVertexMessages, isPointerListEncoding, readFieldsForPartition, writePartition

Field Detail

messageValueFactory

protected final MessageValueFactory<M extends org.apache.hadoop.io.Writable> messageValueFactory

Message value factory

map

protected final it.unimi.dsi.fastutil.ints.Int2ObjectOpenHashMap<it.unimi.dsi.fastutil.longs.Long2ObjectOpenHashMap<T>> map

Map from partition id to map from vertex id to message

partitionInfo

protected final PartitionSplitInfo<org.apache.hadoop.io.LongWritable> partitionInfo

Service worker

config

protected final ImmutableClassesGiraphConfiguration<org.apache.hadoop.io.LongWritable,?,?> config

Giraph configuration

Constructor Detail

LongAbstractStore

public LongAbstractStore(MessageValueFactory<M> messageValueFactory,
                         PartitionSplitInfo<org.apache.hadoop.io.LongWritable> partitionInfo,
                         ImmutableClassesGiraphConfiguration<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Writable,org.apache.hadoop.io.Writable> config)

Constructor

Parameters:

messageValueFactory - Factory for creating message values

partitionInfo - Partition split info

config - Hadoop configuration

Method Detail

getPartitionMap

protected it.unimi.dsi.fastutil.longs.Long2ObjectOpenHashMap<T> getPartitionMap(org.apache.hadoop.io.LongWritable vertexId)

Get map which holds messages for partition which vertex belongs to.

Parameters:

vertexId - Id of the vertex

Returns:

Map which holds messages for partition which vertex belongs to.

clearPartition

public void clearPartition(int partitionId)

Description copied from interface: MessageStore

Clears messages for a partition.

Specified by:

clearPartition in interface MessageStore<org.apache.hadoop.io.LongWritable,M extends org.apache.hadoop.io.Writable>

Parameters:

partitionId - Partition id for which we want to clear messages

hasMessagesForVertex

public boolean hasMessagesForVertex(org.apache.hadoop.io.LongWritable vertexId)

Description copied from interface: MessageStore

Check if we have messages for some vertex

Specified by:

hasMessagesForVertex in interface MessageStore<org.apache.hadoop.io.LongWritable,M extends org.apache.hadoop.io.Writable>

Parameters:

vertexId - Id of vertex which we want to check

Returns:

True iff we have messages for vertex with required id

hasMessagesForPartition

public boolean hasMessagesForPartition(int partitionId)

Description copied from interface: MessageStore

Check if we have messages for some partition

Specified by:

hasMessagesForPartition in interface MessageStore<org.apache.hadoop.io.LongWritable,M extends org.apache.hadoop.io.Writable>

Parameters:

partitionId - Id of partition which we want to check

Returns:

True iff we have messages for the given partition

clearVertexMessages

public void clearVertexMessages(org.apache.hadoop.io.LongWritable vertexId)

Description copied from interface: MessageStore

Clears messages for a vertex.

Specified by:

clearVertexMessages in interface MessageStore<org.apache.hadoop.io.LongWritable,M extends org.apache.hadoop.io.Writable>

Parameters:

vertexId - Vertex id for which we want to clear messages

clearAll

public void clearAll()

Description copied from interface: MessageStore

Clears all resources used by this store.

Specified by:

clearAll in interface MessageStore<org.apache.hadoop.io.LongWritable,M extends org.apache.hadoop.io.Writable>

getPartitionDestinationVertices

public Iterable<org.apache.hadoop.io.LongWritable> getPartitionDestinationVertices(int partitionId)

Description copied from interface: MessageStore

Gets vertex ids from selected partition which we have messages for

Specified by:

getPartitionDestinationVertices in interface MessageStore<org.apache.hadoop.io.LongWritable,M extends org.apache.hadoop.io.Writable>

Parameters:

partitionId - Id of partition

Returns:

Iterable over vertex ids which we have messages for