Package | Description |
---|---|
org.apache.giraph.block_app.framework.api |
Interfaces representing full API to the underlying graph processing system.
|
org.apache.giraph.block_app.framework.internal |
Implementation of execution logic, guiding internal execution of
Block Application.
|
org.apache.giraph.block_app.framework.piece |
Single execution object - Piece, and related classes.
|
org.apache.giraph.block_app.framework.piece.delegate |
Pieces that delegate their work to a set of one or multiple other Pieces.
|
org.apache.giraph.block_app.framework.piece.global_comm |
Interfaces for Reducer and Broadcast Handles for automatic handling
of global communication within Pieces, hiding a lot of it's complexities.
|
org.apache.giraph.block_app.framework.piece.global_comm.array |
Interfaces representing arrays of individual handles.
|
org.apache.giraph.block_app.framework.piece.global_comm.internal |
Reducer and Broadcast Handles internal implementation for automatic handling
of global communication within Pieces, hiding a lot of it's complexities.
|
org.apache.giraph.block_app.framework.piece.global_comm.map |
Interfaces representing map of individual handles
|
org.apache.giraph.block_app.library |
Core library of Pieces and Suppliers, providing most common usages.
|
org.apache.giraph.block_app.migration |
Migration utility for transforming standard Giraph applications, into
Block Applications.
|
org.apache.giraph.block_app.reducers.array |
Reducers for collecting arrays of objects.
|
org.apache.giraph.block_app.reducers.collect |
Reducers for distributed collection of objects.
|
Modifier and Type | Method and Description |
---|---|
BlockMasterApi |
BlockApiHandle.getMasterApi() |
Modifier and Type | Method and Description |
---|---|
void |
BlockApiHandle.setMasterApi(BlockMasterApi api) |
Modifier and Type | Method and Description |
---|---|
void |
BlockMasterLogic.initialize(Block executionBlock,
S executionStage,
BlockMasterApi masterApi)
Initialize Master Logic to execute given block, starting
with given executionStage.
|
void |
BlockMasterLogic.initialize(GiraphConfiguration conf,
BlockMasterApi masterApi)
Initialize master logic to execute BlockFactory defined in
the configuration.
|
void |
BlockMasterLogic.initializeAfterRead(BlockMasterApi masterApi)
Initialize object after deserializing it.
|
void |
PairedPieceAndStage.masterCompute(BlockMasterApi masterApi) |
void |
PairedPieceAndStage.registerReducers(BlockMasterApi masterApi) |
Modifier and Type | Method and Description |
---|---|
void |
AbstractPiece.masterCompute(BlockMasterApi masterApi,
S executionStage)
Function that is called on master, after send phase, before receive phase.
|
void |
AbstractPiece.registerAggregators(BlockMasterApi masterApi)
Deprecated.
Use registerReducers instead.
|
void |
DefaultParentPiece.wrappedRegisterReducers(BlockMasterApi masterApi,
S executionStage) |
abstract void |
AbstractPiece.wrappedRegisterReducers(BlockMasterApi masterApi,
S executionStage)
Add automatic handling of reducers to registerReducers.
|
Modifier and Type | Method and Description |
---|---|
void |
DelegatePiece.masterCompute(BlockMasterApi api,
S executionStage) |
void |
DelegatePiece.registerAggregators(BlockMasterApi master) |
void |
DelegatePiece.wrappedRegisterReducers(BlockMasterApi masterApi,
S executionStage) |
Modifier and Type | Method and Description |
---|---|
void |
ReducerAndBroadcastWrapperHandle.broadcastValue(BlockMasterApi master)
Broadcast reduced value from master
|
BroadcastHandle<R> |
ReducerHandle.broadcastValue(BlockMasterApi master)
Broadcast reduced value from master
|
Modifier and Type | Method and Description |
---|---|
BroadcastArrayHandle<R> |
ReducerArrayHandle.broadcastValue(BlockMasterApi master)
Broadcast whole array of reducers to master
|
int |
ReducerArrayHandle.getReducedSize(BlockMasterApi master)
Number of elements that were reduced.
|
Modifier and Type | Method and Description |
---|---|
BroadcastHandle<R> |
ReducersForPieceHandler.ReduceHandleImpl.broadcastValue(BlockMasterApi master) |
Constructor and Description |
---|
CreateReducersApiWrapper(BlockMasterApi masterApi,
ReducersForPieceHandler reducersApi) |
Modifier and Type | Method and Description |
---|---|
BroadcastMapHandle<I,R> |
ReducerMapHandle.broadcastValue(BlockMasterApi master)
Broadcast whole map of reducers to master
|
int |
ReducerMapHandle.getReducedSize(BlockMasterApi master)
Number of elements that were reduced.
|
Modifier and Type | Method and Description |
---|---|
<S,R extends org.apache.hadoop.io.Writable> |
SendMessageChain.endReduceWithMaster(String name,
ReduceOperation<S,R> reduceOp,
FunctionWithVertex<I,V,E,P,S> valueSupplier,
PairConsumer<R,BlockMasterApi> reducedValueConsumer)
End chain by giving received messages to valueSupplier,
to produce value that should be reduced, and consumed on master
by reducedValueConsumer.
|
static Piece<org.apache.hadoop.io.WritableComparable,org.apache.hadoop.io.Writable,org.apache.hadoop.io.Writable,NoMessage,Object> |
Pieces.masterCompute(String pieceName,
Consumer<BlockMasterApi> process)
Execute given function on master.
|
static <S,R extends org.apache.hadoop.io.Writable,I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable> |
Pieces.reduceWithMaster(String name,
ReduceOperation<S,R> reduceOp,
SupplierFromVertex<I,V,E,S> valueSupplier,
PairConsumer<R,BlockMasterApi> reducedValueConsumer)
Creates single reducer piece - given reduce class, supplier of values on
worker, reduces and passes the result to given consumer on master.
|
Modifier and Type | Method and Description |
---|---|
void |
MigrationPiece.masterCompute(BlockMasterApi masterApi,
MigrationSuperstepStage executionStage) |
void |
MigrationPiece.registerAggregators(BlockMasterApi masterApi) |
Modifier and Type | Method and Description |
---|---|
static <V extends org.apache.hadoop.io.Writable> |
HugeArrayUtils.broadcast(int count,
Int2ObjFunction<V> valueSupplier,
BlockMasterApi master)
Broadcast a huge array, by splitting into NUM_STRIPES number of parts.
|
static <V extends org.apache.hadoop.io.Writable> |
HugeArrayUtils.broadcast(int count,
Int2ObjFunction<V> valueSupplier,
PrimitiveTypeOps<V> typeOps,
BlockMasterApi master)
Broadcast a huge array, by splitting into NUM_STRIPES number of parts.
|
BroadcastArrayHandle<R> |
ArrayOfHandles.ArrayOfReducers.broadcastValue(BlockMasterApi master) |
int |
ArrayOfHandles.ArrayOfReducers.getReducedSize(BlockMasterApi master) |
Modifier and Type | Method and Description |
---|---|
void |
CollectShardedTuplesOfPrimitivesReducerHandle.CollectShardedTuplesOfPrimitivesReduceBroadcast.broadcastValue(BlockMasterApi master)
Broadcast reduced value from master
|
BroadcastHandle<R> |
ShardedReducerHandle.broadcastValue(BlockMasterApi masterApi) |
Copyright © 2011-2020 The Apache Software Foundation. All Rights Reserved.