Package | Description |
---|---|
org.apache.giraph.block_app.framework.piece |
Single execution object - Piece, and related classes.
|
org.apache.giraph.block_app.framework.piece.global_comm.internal |
Reducer and Broadcast Handles internal implementation for automatic handling
of global communication within Pieces, hiding a lot of it's complexities.
|
org.apache.giraph.block_app.reducers.array |
Reducers for collecting arrays of objects.
|
org.apache.giraph.block_app.reducers.collect |
Reducers for distributed collection of objects.
|
org.apache.giraph.block_app.reducers.map |
Reducers for collecting map of objects.
|
Modifier and Type | Method and Description |
---|---|
void |
DefaultParentPiece.registerReducers(CreateReducersApi reduceApi,
S executionStage)
Override to register any potential reducers used by this piece,
through calls to
reduceApi , which will return reducer handles
for simple. |
Modifier and Type | Class and Description |
---|---|
class |
CreateReducersApiWrapper
Wrapping masterApi and reducers handler into API for creating reducer
handles.
|
Modifier and Type | Method and Description |
---|---|
static <S,R extends org.apache.hadoop.io.Writable> |
HugeArrayUtils.createGlobalReducerArrayHandle(int fixedSize,
ReduceOperation<S,R> elementReduceOp,
CreateReducersApi reduceApi)
Create global array of reducers, by splitting the huge array
into NUM_STRIPES number of parts.
|
static <S,R extends org.apache.hadoop.io.Writable> |
HugeArrayUtils.createGlobalReducerArrayHandle(int fixedSize,
ReduceOperation<S,R> elementReduceOp,
CreateReducersApi reduceApi,
int maxNumStripes)
Create global array of reducers, by splitting the huge array
into
maxNumStripes number of parts. |
static <S,R extends org.apache.hadoop.io.Writable> |
BasicArrayReduce.createLocalArrayHandles(int fixedSize,
PrimitiveTypeOps<R> typeOps,
ReduceOperation<S,R> elementReduceOp,
CreateReducersApi reduceApi)
Registers one new local reducer, that will reduce BasicArray,
by reducing individual elements using
elementReduceOp ,
with predefined size. |
static <S,R extends org.apache.hadoop.io.Writable> |
BasicArrayReduce.createLocalArrayHandles(PrimitiveTypeOps<R> typeOps,
ReduceOperation<S,R> elementReduceOp,
CreateReducersApi reduceApi)
Registers one new local reducer, that will reduce BasicArray,
by reducing individual elements using
elementReduceOp ,
with unbounded size. |
Modifier and Type | Method and Description |
---|---|
void |
ShardedReducerHandle.register(CreateReducersApi reduceApi) |
void |
CollectShardedTuplesOfPrimitivesReducerHandle.CollectShardedTuplesOfPrimitivesReduceBroadcast.registeredReducer(CreateReducersApi reduceApi,
Class<?>... valueClasses)
Set reducer handle to just registered handle
|
Constructor and Description |
---|
CollectShardedPrimitiveReducerHandle(CreateReducersApi reduceApi,
Class<S> valueClass) |
CollectShardedReducerHandle(CreateReducersApi reduceApi) |
CollectShardedTuplesOfPrimitivesReducerHandle(CreateReducersApi reduceApi,
Class<?>... valueClasses) |
Modifier and Type | Method and Description |
---|---|
static <K extends org.apache.hadoop.io.WritableComparable,S,R extends org.apache.hadoop.io.Writable> |
BasicMapReduce.createLocalMapHandles(PrimitiveIdTypeOps<K> keyTypeOps,
PrimitiveTypeOps<R> typeOps,
ReduceOperation<S,R> elementReduceOp,
CreateReducersApi reduceApi)
Registers one new local reducer, that will reduce BasicMap,
by reducing individual elements corresponding to the same key
using
elementReduceOp . |
Copyright © 2011-2020 The Apache Software Foundation. All Rights Reserved.