org.apache.giraph.comm.messages

Class PointerListPerVertexStore<I extends org.apache.hadoop.io.WritableComparable,M extends org.apache.hadoop.io.Writable>

java.lang.Object

org.apache.giraph.comm.messages.SimpleMessageStore<I,M,L>

org.apache.giraph.comm.messages.AbstractListPerVertexStore<I,M,it.unimi.dsi.fastutil.longs.LongArrayList>

org.apache.giraph.comm.messages.PointerListPerVertexStore<I,M>

Type Parameters:

I - vertexId type

M - message type

All Implemented Interfaces:

MessageStore<I,M>

public class PointerListPerVertexStore<I extends org.apache.hadoop.io.WritableComparable,M extends org.apache.hadoop.io.Writable>
extends AbstractListPerVertexStore<I,M,it.unimi.dsi.fastutil.longs.LongArrayList>

Implementation of SimpleMessageStore where multiple messages are stored as a list of long pointers to extended data output objects Used when there is no combiner provided.

Field Summary

Fields inherited from class org.apache.giraph.comm.messages.SimpleMessageStore

config, map, messageValueFactory, partitionInfo

Constructor Summary

Constructors

Constructor and Description
PointerListPerVertexStore(MessageValueFactory<M> messageValueFactory, PartitionSplitInfo<I> partitionInfo, ImmutableClassesGiraphConfiguration<I,?,?> config) Constructor

Method Summary

Modifier and Type	Method and Description
void	addMessage(I vertexId, M message) Adds a message for a particular vertex The method is used by InternalMessageStore to send local messages; for the general case, use a more efficient addPartitionMessages
void	addPartitionMessages(int partitionId, VertexIdMessages<I,M> messages) Adds messages for partition
protected it.unimi.dsi.fastutil.longs.LongArrayList	createList() Create an instance of L
Iterable<M>	getMessagesAsIterable(it.unimi.dsi.fastutil.longs.LongArrayList pointers) Get messages as an iterable from message storage
protected int	getNumberOfMessagesIn(ConcurrentMap<I,it.unimi.dsi.fastutil.longs.LongArrayList> partitionMap) Get number of messages in partition map
boolean	isPointerListEncoding() True if this message-store encodes messages as a list of long pointers to compact serialized messages
protected it.unimi.dsi.fastutil.longs.LongArrayList	readFieldsForMessages(DataInput in) Read message storage from DataInput
protected void	writeMessages(it.unimi.dsi.fastutil.longs.LongArrayList messages, DataOutput out) Write message storage to DataOutput

Methods inherited from class org.apache.giraph.comm.messages.AbstractListPerVertexStore

getOrCreateList, getOrCreateList, getVertexMessages

Methods inherited from class org.apache.giraph.comm.messages.SimpleMessageStore

clearAll, clearPartition, clearVertexMessages, finalizeStore, getOrCreatePartitionMap, getPartitionDestinationVertices, getPartitionId, hasMessagesForPartition, hasMessagesForVertex, readFieldsForPartition, writePartition

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

PointerListPerVertexStore

public PointerListPerVertexStore(MessageValueFactory<M> messageValueFactory,
                                 PartitionSplitInfo<I> partitionInfo,
                                 ImmutableClassesGiraphConfiguration<I,?,?> config)

Constructor

Parameters:

messageValueFactory - Message class held in the store

partitionInfo - Partition split info

config - Hadoop configuration

Method Detail

isPointerListEncoding

public boolean isPointerListEncoding()

Description copied from interface: MessageStore

True if this message-store encodes messages as a list of long pointers to compact serialized messages

Returns:

true if we encode messages as a list of pointers

createList

protected it.unimi.dsi.fastutil.longs.LongArrayList createList()

Description copied from class: AbstractListPerVertexStore

Create an instance of L

Specified by:

createList in class AbstractListPerVertexStore<I extends org.apache.hadoop.io.WritableComparable,M extends org.apache.hadoop.io.Writable,it.unimi.dsi.fastutil.longs.LongArrayList>

Returns:

instance of L

addPartitionMessages

public void addPartitionMessages(int partitionId,
                                 VertexIdMessages<I,M> messages)

Description copied from interface: MessageStore

Adds messages for partition

Parameters:

partitionId - Id of partition

messages - Collection of vertex ids and messages we want to add

addMessage

public void addMessage(I vertexId,
                       M message)
                throws IOException

Description copied from interface: MessageStore

Adds a message for a particular vertex The method is used by InternalMessageStore to send local messages; for the general case, use a more efficient addPartitionMessages

Parameters:

vertexId - Id of target vertex

message - A message to send

Throws:

IOException

getMessagesAsIterable

public Iterable<M> getMessagesAsIterable(it.unimi.dsi.fastutil.longs.LongArrayList pointers)

Get messages as an iterable from message storage

Specified by:

getMessagesAsIterable in class SimpleMessageStore<I extends org.apache.hadoop.io.WritableComparable,M extends org.apache.hadoop.io.Writable,it.unimi.dsi.fastutil.longs.LongArrayList>

Parameters:

pointers - list of pointers to messages

Returns:

Messages as an iterable

getNumberOfMessagesIn

protected int getNumberOfMessagesIn(ConcurrentMap<I,it.unimi.dsi.fastutil.longs.LongArrayList> partitionMap)

Description copied from class: SimpleMessageStore

Get number of messages in partition map

Specified by:

getNumberOfMessagesIn in class SimpleMessageStore<I extends org.apache.hadoop.io.WritableComparable,M extends org.apache.hadoop.io.Writable,it.unimi.dsi.fastutil.longs.LongArrayList>

Parameters:

partitionMap - Partition map in which to count messages

Returns:

Number of messages in partition map

writeMessages

protected void writeMessages(it.unimi.dsi.fastutil.longs.LongArrayList messages,
                             DataOutput out)
                      throws IOException

Description copied from class: SimpleMessageStore

Write message storage to DataOutput

Specified by:

writeMessages in class SimpleMessageStore<I extends org.apache.hadoop.io.WritableComparable,M extends org.apache.hadoop.io.Writable,it.unimi.dsi.fastutil.longs.LongArrayList>

Parameters:

messages - Message storage

out - Data output

Throws:

IOException

readFieldsForMessages

protected it.unimi.dsi.fastutil.longs.LongArrayList readFieldsForMessages(DataInput in)
                                                                   throws IOException

Description copied from class: SimpleMessageStore

Read message storage from DataInput

Specified by:

readFieldsForMessages in class SimpleMessageStore<I extends org.apache.hadoop.io.WritableComparable,M extends org.apache.hadoop.io.Writable,it.unimi.dsi.fastutil.longs.LongArrayList>

Parameters:

in - Data input

Returns:

Message storage

Throws:

IOException