Package | Description |
---|---|
org.apache.giraph.block_app.framework.block |
Block interface as a composable unit of execution, and its common
implementations.
|
org.apache.giraph.block_app.framework.piece |
Single execution object - Piece, and related classes.
|
org.apache.giraph.block_app.framework.piece.delegate |
Pieces that delegate their work to a set of one or multiple other Pieces.
|
org.apache.giraph.block_app.library |
Core library of Pieces and Suppliers, providing most common usages.
|
org.apache.giraph.block_app.migration |
Migration utility for transforming standard Giraph applications, into
Block Applications.
|
org.apache.giraph.block_app.test_setup.graphs |
Common Graphs for unit tests.
|
org.apache.giraph.function |
Package for interfaces representing different functions,
that all extends Serializable in order for Kryo to be able
to serialize them.
|
org.apache.giraph.object |
Object handling related utilities.
|
org.apache.giraph.types.ops.collections |
Collection interfaces and implementations provided by TypeOps classes.
|
org.apache.giraph.types.ops.collections.array |
WArrayList interfaces and implementations that extend fastutil
classes, and are provided by TypeOps classes.
|
Modifier and Type | Method and Description |
---|---|
void |
RepeatUntilBlock.forAllPossiblePieces(Consumer<AbstractPiece> consumer) |
void |
FilteringBlock.forAllPossiblePieces(Consumer<AbstractPiece> consumer) |
void |
SequenceBlock.forAllPossiblePieces(Consumer<AbstractPiece> consumer) |
void |
EmptyBlock.forAllPossiblePieces(Consumer<AbstractPiece> consumer) |
void |
IfBlock.forAllPossiblePieces(Consumer<AbstractPiece> consumer) |
void |
Block.forAllPossiblePieces(Consumer<AbstractPiece> consumer)
Calls consumer for each Piece:
- in no particular order
- potentially calling multiple times on same Piece
- even if Piece might never be returned in the iterator
- it will be called at least once for every piece that is
going to be returned by iterator
Can be used for static analysis/introspection of the block,
without actually executing them.
|
void |
RepeatBlock.forAllPossiblePieces(Consumer<AbstractPiece> consumer) |
Modifier and Type | Method and Description |
---|---|
void |
AbstractPiece.forAllPossiblePieces(Consumer<AbstractPiece> consumer) |
Modifier and Type | Method and Description |
---|---|
void |
DelegatePiece.forAllPossiblePieces(Consumer<AbstractPiece> consumer) |
Modifier and Type | Method and Description |
---|---|
<S,R extends org.apache.hadoop.io.Writable> |
SendMessageChain.endReduce(String name,
ReduceOperation<S,R> reduceOp,
FunctionWithVertex<I,V,E,P,S> valueSupplier,
Consumer<R> reducedValueConsumer)
End chain by giving received messages to valueSupplier,
to produce value that should be reduced, and consumed on master
by reducedValueConsumer.
|
static <I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable> |
Pieces.forAllVertices(String pieceName,
Consumer<Vertex<I,V,E>> process)
For each vertex execute given process function.
|
static <I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable> |
Pieces.forAllVerticesOnReceive(String pieceName,
Consumer<Vertex<I,V,E>> process)
For each vertex execute given process function.
|
static Piece<org.apache.hadoop.io.WritableComparable,org.apache.hadoop.io.Writable,org.apache.hadoop.io.Writable,NoMessage,Object> |
Pieces.masterCompute(String pieceName,
Consumer<BlockMasterApi> process)
Execute given function on master.
|
static <S,R extends org.apache.hadoop.io.Writable,I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable> |
Pieces.reduce(String name,
ReduceOperation<S,R> reduceOp,
SupplierFromVertex<I,V,E,S> valueSupplier,
Consumer<R> reducedValueConsumer)
Creates single reducer piece - given reduce class, supplier of values on
worker, reduces and passes the result to given consumer on master.
|
Modifier and Type | Method and Description |
---|---|
static <I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable,MR extends org.apache.hadoop.io.Writable,MS extends org.apache.hadoop.io.Writable> |
MigrationPiece.createMigrationPiece(Class<? extends MigrationAbstractComputation<I,V,E,MR,MS>> computationClass,
MigrationMasterCompute masterCompute,
Supplier<Iterable<MR>> previousMessagesSupplier,
Consumer<Iterable<MS>> currentMessagesConsumer,
Class<MS> messageClass,
Class<? extends MessageCombiner<? super I,MS>> messageCombinerClass) |
Constructor and Description |
---|
EachVertexInit(Consumer<Vertex<I,V,E>> vertexConsumer) |
Modifier and Type | Class and Description |
---|---|
class |
ObjectHolder<T>
Default object holder, intermediary between producers and consumers.
|
class |
ObjectNotifier<T>
Allows multiple Consumers to be combined into a single Consumer, by having
them all subscribe to this object, and then using this object as a group
Consumer.
|
class |
ObjectTransfer<T>
Default object transfer, intermediary between producers and consumers.
|
Modifier and Type | Method and Description |
---|---|
void |
ObjectNotifier.subscribe(Consumer<T> consumer) |
void |
Notifier.subscribe(Consumer<T> consumer)
Subscribe consumer to notifications on the given object.
|
Constructor and Description |
---|
MultiSizedReusable(Int2ObjFunction<T> createSized,
Consumer<T> init) |
Modifier and Type | Method and Description |
---|---|
void |
WCollection.fastForEachW(Consumer<T> f)
Traverse all elements of the collection, calling given function on each
element.
|
Modifier and Type | Method and Description |
---|---|
void |
WBooleanArrayList.fastForEachW(Consumer<org.apache.hadoop.io.BooleanWritable> f) |
void |
WByteArrayList.fastForEachW(Consumer<org.apache.hadoop.io.ByteWritable> f) |
void |
WDoubleArrayList.fastForEachW(Consumer<org.apache.hadoop.io.DoubleWritable> f) |
void |
WFloatArrayList.fastForEachW(Consumer<org.apache.hadoop.io.FloatWritable> f) |
void |
WIntArrayList.fastForEachW(Consumer<org.apache.hadoop.io.IntWritable> f) |
void |
WLongArrayList.fastForEachW(Consumer<org.apache.hadoop.io.LongWritable> f) |
Copyright © 2011-2020 The Apache Software Foundation. All Rights Reserved.