Package | Description |
---|---|
org.apache.giraph.block_app.library |
Core library of Pieces and Suppliers, providing most common usages.
|
org.apache.giraph.block_app.library.internal |
Internal implementation of Pieces needed for Pieces utility class.
|
org.apache.giraph.function |
Package for interfaces representing different functions,
that all extends Serializable in order for Kryo to be able
to serialize them.
|
Modifier and Type | Method and Description |
---|---|
Block |
SendMessageChain.endConsume(ConsumerWithVertex<I,V,E,P> messagesConsumer)
End chain by processing messages received within the last link
in the chain.
|
static <S,R extends org.apache.hadoop.io.Writable,I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable> |
Pieces.reduceAndBroadcast(String name,
ReduceOperation<S,R> reduceOp,
SupplierFromVertex<I,V,E,S> valueSupplier,
ConsumerWithVertex<I,V,E,R> reducedValueConsumer)
Creates single reducer and broadcast piece - given reduce class, supplier
of values on worker, reduces and broadcasts the value, passing it to the
consumer on worker for each vertex.
|
static <S,R extends org.apache.hadoop.io.Writable,I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable> |
Pieces.reduceAndBroadcastWithArrayOfHandles(String name,
int numHandles,
Supplier<ReduceOperation<S,R>> reduceOp,
SupplierFromVertex<I,V,E,Long> handleHashSupplier,
SupplierFromVertex<I,V,E,S> valueSupplier,
ConsumerWithVertex<I,V,E,R> reducedValueConsumer)
Like reduceAndBroadcast, but uses array of handles for reducers and
broadcasts, to make it feasible and performant when values are large.
|
static <I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable,M extends org.apache.hadoop.io.Writable> |
Pieces.sendMessage(String name,
Class<M> messageClass,
SupplierFromVertex<I,V,E,M> messageSupplier,
SupplierFromVertex<I,V,E,Iterator<I>> targetsSupplier,
ConsumerWithVertex<I,V,E,Iterable<M>> messagesConsumer)
Creates Piece that for each vertex, sends message provided by
messageSupplier to all targets provided by targetsSupplier.
|
static <I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable,M extends org.apache.hadoop.io.Writable> |
Pieces.sendMessage(String name,
MessageCombiner<? super I,M> messageCombiner,
SupplierFromVertex<I,V,E,M> messageSupplier,
SupplierFromVertex<I,V,E,Iterator<I>> targetsSupplier,
ConsumerWithVertex<I,V,E,M> messagesConsumer)
Creates Piece that for each vertex, sends message provided by
messageSupplier to all targets provided by targetsSupplier,
and uses given messageCombiner to combine messages together.
|
static <I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable,M extends org.apache.hadoop.io.Writable> |
Pieces.sendMessageToNeighbors(String name,
Class<M> messageClass,
SupplierFromVertex<I,V,E,M> messageSupplier,
ConsumerWithVertex<I,V,E,Iterable<M>> messagesConsumer)
Creates Piece that for each vertex, sends message provided by
messageSupplier to all neighbors of current vertex.
|
static <I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable,M extends org.apache.hadoop.io.Writable> |
Pieces.sendMessageToNeighbors(String name,
MessageCombiner<? super I,M> messageCombiner,
SupplierFromVertex<I,V,E,M> messageSupplier,
ConsumerWithVertex<I,V,E,M> messagesConsumer)
Creates Piece that for each vertex, sends message provided by
messageSupplier to all neighbors of current vertex,
and uses given messageCombiner to combine messages together.
|
Modifier and Type | Method and Description |
---|---|
static <I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable,P extends org.apache.hadoop.io.Writable> |
SendMessageChain.startCustom(Function<ConsumerWithVertex<I,V,E,P>,Block> createStartingBlock)
Start chain by providing a function that will produce Block representing
beginning of the chain, given a consumer of messages send
by the last link in the created block.
|
Constructor and Description |
---|
SendMessagePiece(String name,
Class<M> messageClass,
SupplierFromVertex<I,V,E,M> messageSupplier,
SupplierFromVertex<I,V,E,Iterator<I>> targetsSupplier,
ConsumerWithVertex<I,V,E,Iterable<M>> messagesConsumer) |
SendMessageWithCombinerPiece(String name,
MessageCombiner<? super I,M> messageCombiner,
SupplierFromVertex<I,V,E,M> messageSupplier,
SupplierFromVertex<I,V,E,Iterator<I>> targetsSupplier,
ConsumerWithVertex<I,V,E,M> messagesConsumer) |
Modifier and Type | Method and Description |
---|---|
<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable> |
ObjectTransfer.castToConsumer()
To be called when needing to pass it as a Consumer - making it
obvious that K, V and E on consumer side can be any types,
and to make code work without compile errors/warnings.
|
Copyright © 2011-2020 The Apache Software Foundation. All Rights Reserved.