org.apache.giraph.block_app.library.internal

Class SendMessageWithCombinerPiece<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable,M extends org.apache.hadoop.io.Writable>

java.lang.Object

org.apache.giraph.block_app.framework.piece.AbstractPiece<I,V,E,M,WV,WM,S>

org.apache.giraph.block_app.framework.piece.DefaultParentPiece<I,V,E,M,Object,NoMessage,S>

org.apache.giraph.block_app.framework.piece.Piece<I,V,E,M,Object>

org.apache.giraph.block_app.library.internal.SendMessageWithCombinerPiece<I,V,E,M>

Type Parameters:

I - Vertex id type

V - Vertex value type

E - Edge value type

M - Message type

All Implemented Interfaces:

Iterable<AbstractPiece>, Block

public class SendMessageWithCombinerPiece<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable,M extends org.apache.hadoop.io.Writable>
extends Piece<I,V,E,M,Object>

Piece that sends a message provided through messageProducer to given set of neighbors, uses a message combiner and passes them to messagesConsumer.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.giraph.block_app.framework.piece.AbstractPiece

AbstractPiece.InnerVertexReceiver, AbstractPiece.InnerVertexSender

Field Summary

Fields inherited from class org.apache.giraph.block_app.framework.piece.DefaultParentPiece

MESSAGE_ENCODE_AND_STORE_TYPE_MIN_FORCE

Constructor Summary

Constructors

Constructor and Description
SendMessageWithCombinerPiece(String name, MessageCombiner<? super I,M> messageCombiner, SupplierFromVertex<I,V,E,M> messageSupplier, SupplierFromVertex<I,V,E,Iterator<I>> targetsSupplier, ConsumerWithVertex<I,V,E,M> messagesConsumer)

Method Summary

Modifier and Type	Method and Description
MessageCombiner<? super I,M>	getMessageCombiner(ImmutableClassesGiraphConfiguration conf) Override to specify message combiner to be used, if any.
VertexReceiver<I,V,E,M>	getVertexReceiver(BlockWorkerReceiveApi<I> workerApi, Object executionStage) Override to do vertex receive processing.
VertexSender<I,V,E>	getVertexSender(BlockWorkerSendApi<I,V,E,M> workerApi, Object executionStage) Override to do vertex send processing.
Block	stripeByReceiver(int stripes, Int2ObjFunction<Int2ObjFunction<Predicate<I>>> stripeSupplier) Stripe message sending computation across multiple stripes, in each stripe only part of the vertices will receive messages.
String	toString()

Methods inherited from class org.apache.giraph.block_app.framework.piece.Piece

workerContextReceive, workerContextSend

Methods inherited from class org.apache.giraph.block_app.framework.piece.DefaultParentPiece

allowOneMessageToManyIdsEncoding, getMessageClass, getMessageClasses, getMessageFactory, getWrappedVertexSender, receiveIgnoreExistingVertices, reduceDouble, reduceFloat, reduceInt, reduceLong, registerReducers, wrappedRegisterReducers

Methods inherited from class org.apache.giraph.block_app.framework.piece.AbstractPiece

equals, forAllPossiblePieces, getPieceCount, hashCode, iterator, masterCompute, nextExecutionStage, registerAggregators

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Methods inherited from interface java.lang.Iterable

forEach, spliterator

Constructor Detail

SendMessageWithCombinerPiece

public SendMessageWithCombinerPiece(String name,
                                    MessageCombiner<? super I,M> messageCombiner,
                                    SupplierFromVertex<I,V,E,M> messageSupplier,
                                    SupplierFromVertex<I,V,E,Iterator<I>> targetsSupplier,
                                    ConsumerWithVertex<I,V,E,M> messagesConsumer)

Method Detail

stripeByReceiver

public Block stripeByReceiver(int stripes,
                              Int2ObjFunction<Int2ObjFunction<Predicate<I>>> stripeSupplier)

Stripe message sending computation across multiple stripes, in each stripe only part of the vertices will receive messages.

Parameters:

stripes - Number of stripes

stripeSupplier - Stripe supplier function, if IDs are Longs, you can use StripingUtils::fastHashStripingPredicate

Returns:

Resulting block

getVertexSender

public VertexSender<I,V,E> getVertexSender(BlockWorkerSendApi<I,V,E,M> workerApi,
                                           Object executionStage)

Description copied from class: DefaultParentPiece

Override to do vertex send processing. Creates handler that defines what should be executed on worker during send phase. This logic gets executed first. This function is called once on each worker on each thread, in parallel, on their copy of Piece object to create functions handler. If returned object implements Postprocessor interface, then corresponding postprocess() function is going to be called once, after all vertices corresponding thread needed to process are done.

Overrides:

getVertexSender in class DefaultParentPiece<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable,M extends org.apache.hadoop.io.Writable,Object,NoMessage,Object>

getVertexReceiver

public VertexReceiver<I,V,E,M> getVertexReceiver(BlockWorkerReceiveApi<I> workerApi,
                                                 Object executionStage)

Description copied from class: AbstractPiece

Override to do vertex receive processing. Creates handler that defines what should be executed on worker for each vertex during receive phase. This logic executed last. This function is called once on each worker on each thread, in parallel, on their copy of Piece object to create functions handler. If returned object implements Postprocessor interface, then corresponding postprocess() function is going to be called once, after all vertices corresponding thread needed to process are done.

Overrides:

getVertexReceiver in class AbstractPiece<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable,M extends org.apache.hadoop.io.Writable,Object,NoMessage,Object>

getMessageCombiner

public MessageCombiner<? super I,M> getMessageCombiner(ImmutableClassesGiraphConfiguration conf)

Description copied from class: DefaultParentPiece

Override to specify message combiner to be used, if any. Message combiner itself should be immutable (i.e. it will be call simultanously from multiple threads)

Overrides:

getMessageCombiner in class DefaultParentPiece<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable,M extends org.apache.hadoop.io.Writable,Object,NoMessage,Object>

toString

public String toString()

Overrides:

toString in class AbstractPiece<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable,M extends org.apache.hadoop.io.Writable,Object,NoMessage,Object>