org.apache.giraph.comm.messages.primitives.long_id

Class LongPointerListPerVertexStore<M extends org.apache.hadoop.io.Writable>

java.lang.Object

org.apache.giraph.comm.messages.primitives.long_id.LongAbstractStore<M,L>

org.apache.giraph.comm.messages.primitives.long_id.LongAbstractListStore<M,it.unimi.dsi.fastutil.longs.LongArrayList>

org.apache.giraph.comm.messages.primitives.long_id.LongPointerListPerVertexStore<M>

Type Parameters:

M - message type

All Implemented Interfaces:

MessageStore<org.apache.hadoop.io.LongWritable,M>

public class LongPointerListPerVertexStore<M extends org.apache.hadoop.io.Writable>
extends LongAbstractListStore<M,it.unimi.dsi.fastutil.longs.LongArrayList>
implements MessageStore<org.apache.hadoop.io.LongWritable,M>

This stores messages in ExtendedByteArrayOutputBuffer and stores long pointers that point to serialized messages

Field Summary

Fields inherited from class org.apache.giraph.comm.messages.primitives.long_id.LongAbstractStore

config, map, messageValueFactory, partitionInfo

Constructor Summary

Constructors

Constructor and Description
LongPointerListPerVertexStore(MessageValueFactory<M> messageValueFactory, PartitionSplitInfo<org.apache.hadoop.io.LongWritable> partitionInfo, ImmutableClassesGiraphConfiguration<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Writable,org.apache.hadoop.io.Writable> config) Constructor

Method Summary

Modifier and Type	Method and Description
void	addMessage(org.apache.hadoop.io.LongWritable vertexId, M message) Adds a message for a particular vertex The method is used by InternalMessageStore to send local messages; for the general case, use a more efficient addPartitionMessages
void	addPartitionMessages(int partitionId, VertexIdMessages<org.apache.hadoop.io.LongWritable,M> messages) Adds messages for partition
protected it.unimi.dsi.fastutil.longs.LongArrayList	createList() Create an instance of L
Iterable<M>	getVertexMessages(org.apache.hadoop.io.LongWritable vertexId) Gets messages for a vertex.
boolean	isPointerListEncoding() True if this message-store encodes messages as a list of long pointers to compact serialized messages
void	readFieldsForPartition(DataInput in, int partitionId) Deserialize messages for one partition
void	writePartition(DataOutput out, int partitionId) Serialize messages for one partition.

Methods inherited from class org.apache.giraph.comm.messages.primitives.long_id.LongAbstractListStore

finalizeStore, getList, hasMessagesForVertex

Methods inherited from class org.apache.giraph.comm.messages.primitives.long_id.LongAbstractStore

clearAll, clearPartition, clearVertexMessages, getPartitionDestinationVertices, getPartitionMap, hasMessagesForPartition

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.giraph.comm.messages.MessageStore

clearAll, clearPartition, clearVertexMessages, finalizeStore, getPartitionDestinationVertices, hasMessagesForPartition, hasMessagesForVertex

Constructor Detail

LongPointerListPerVertexStore

public LongPointerListPerVertexStore(MessageValueFactory<M> messageValueFactory,
                                     PartitionSplitInfo<org.apache.hadoop.io.LongWritable> partitionInfo,
                                     ImmutableClassesGiraphConfiguration<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Writable,org.apache.hadoop.io.Writable> config)

Constructor

Parameters:

messageValueFactory - Factory for creating message values

partitionInfo - Partition split info

config - Hadoop configuration

Method Detail

isPointerListEncoding

public boolean isPointerListEncoding()

Description copied from interface: MessageStore

True if this message-store encodes messages as a list of long pointers to compact serialized messages

Specified by:

isPointerListEncoding in interface MessageStore<org.apache.hadoop.io.LongWritable,M extends org.apache.hadoop.io.Writable>

Returns:

true if we encode messages as a list of pointers

createList

protected it.unimi.dsi.fastutil.longs.LongArrayList createList()

Description copied from class: LongAbstractListStore

Create an instance of L

Specified by:

createList in class LongAbstractListStore<M extends org.apache.hadoop.io.Writable,it.unimi.dsi.fastutil.longs.LongArrayList>

Returns:

instance of L

addPartitionMessages

public void addPartitionMessages(int partitionId,
                                 VertexIdMessages<org.apache.hadoop.io.LongWritable,M> messages)

Description copied from interface: MessageStore

Adds messages for partition

Specified by:

addPartitionMessages in interface MessageStore<org.apache.hadoop.io.LongWritable,M extends org.apache.hadoop.io.Writable>

Parameters:

partitionId - Id of partition

messages - Collection of vertex ids and messages we want to add

addMessage

public void addMessage(org.apache.hadoop.io.LongWritable vertexId,
                       M message)
                throws IOException

Description copied from interface: MessageStore

Adds a message for a particular vertex The method is used by InternalMessageStore to send local messages; for the general case, use a more efficient addPartitionMessages

Specified by:

addMessage in interface MessageStore<org.apache.hadoop.io.LongWritable,M extends org.apache.hadoop.io.Writable>

Parameters:

vertexId - Id of target vertex

message - A message to send

Throws:

IOException

getVertexMessages

public Iterable<M> getVertexMessages(org.apache.hadoop.io.LongWritable vertexId)

Description copied from interface: MessageStore

Gets messages for a vertex. The lifetime of every message is only guaranteed until the iterator's next() method is called. Do not hold references to objects returned by this iterator.

Specified by:

getVertexMessages in interface MessageStore<org.apache.hadoop.io.LongWritable,M extends org.apache.hadoop.io.Writable>

Parameters:

vertexId - Vertex id for which we want to get messages

Returns:

Iterable of messages for a vertex id

writePartition

public void writePartition(DataOutput out,
                           int partitionId)
                    throws IOException

Description copied from interface: MessageStore

Serialize messages for one partition.

Specified by:

writePartition in interface MessageStore<org.apache.hadoop.io.LongWritable,M extends org.apache.hadoop.io.Writable>

Parameters:

out - DataOutput to serialize this object into

partitionId - Id of partition

Throws:

IOException

readFieldsForPartition

public void readFieldsForPartition(DataInput in,
                                   int partitionId)
                            throws IOException

Description copied from interface: MessageStore

Deserialize messages for one partition

Specified by:

readFieldsForPartition in interface MessageStore<org.apache.hadoop.io.LongWritable,M extends org.apache.hadoop.io.Writable>

Parameters:

in - DataInput to deserialize this object from.

partitionId - Id of partition

Throws:

IOException