Package | Description |
---|---|
org.apache.giraph.block_app.library.internal |
Internal implementation of Pieces needed for Pieces utility class.
|
org.apache.giraph.block_app.library.striping |
Utilities for striping.
|
org.apache.giraph.block_app.reducers.array |
Reducers for collecting arrays of objects.
|
org.apache.giraph.object |
Object handling related utilities.
|
Modifier and Type | Method and Description |
---|---|
Block |
SendMessageWithCombinerPiece.stripeByReceiver(int stripes,
Int2ObjFunction<Int2ObjFunction<Predicate<I>>> stripeSupplier)
Stripe message sending computation across multiple stripes, in
each stripe only part of the vertices will receive messages.
|
Block |
SendMessagePiece.stripeByReceiver(int stripes,
Int2ObjFunction<Int2ObjFunction<Predicate<I>>> stripeSupplier)
Stripe message sending computation across multiple stripes, in
each stripe only part of the vertices will receive messages.
|
Modifier and Type | Method and Description |
---|---|
Block |
SendMessageWithCombinerPiece.stripeByReceiver(int stripes,
Int2ObjFunction<Int2ObjFunction<Predicate<I>>> stripeSupplier)
Stripe message sending computation across multiple stripes, in
each stripe only part of the vertices will receive messages.
|
Block |
SendMessagePiece.stripeByReceiver(int stripes,
Int2ObjFunction<Int2ObjFunction<Predicate<I>>> stripeSupplier)
Stripe message sending computation across multiple stripes, in
each stripe only part of the vertices will receive messages.
|
Modifier and Type | Method and Description |
---|---|
static Int2ObjFunction<Predicate<org.apache.hadoop.io.LongWritable>> |
StripingUtils.fastHashStripingPredicate(int stripes)
Fast hash-based striping for LongWritable IDs, returns a function
that for a given stripe index returns a predicate checking whether ID is
in that stripe.
|
Modifier and Type | Method and Description |
---|---|
static <I extends org.apache.hadoop.io.WritableComparable> |
StripingUtils.generateStripedBlock(int stripes,
Function<Predicate<I>,Block> blockGenerator,
Int2ObjFunction<Int2ObjFunction<Predicate<I>>> stripeSupplier)
Generate striped block, with given number of
stripes ,
using given blockGenerator to generate block for each stripe,
and using striping based on given stripeSupplier . |
Modifier and Type | Method and Description |
---|---|
static <I extends org.apache.hadoop.io.WritableComparable> |
StripingUtils.generateStripedBlock(int stripes,
Function<Predicate<I>,Block> blockGenerator,
Int2ObjFunction<Int2ObjFunction<Predicate<I>>> stripeSupplier)
Generate striped block, with given number of
stripes ,
using given blockGenerator to generate block for each stripe,
and using striping based on given stripeSupplier . |
Modifier and Type | Method and Description |
---|---|
static <V extends org.apache.hadoop.io.Writable> |
HugeArrayUtils.broadcast(int count,
Int2ObjFunction<V> valueSupplier,
BlockMasterApi master)
Broadcast a huge array, by splitting into NUM_STRIPES number of parts.
|
static <V extends org.apache.hadoop.io.Writable> |
HugeArrayUtils.broadcast(int count,
Int2ObjFunction<V> valueSupplier,
PrimitiveTypeOps<V> typeOps,
BlockMasterApi master)
Broadcast a huge array, by splitting into NUM_STRIPES number of parts.
|
Constructor and Description |
---|
ArrayOfBroadcasts(int count,
Int2ObjFunction<BroadcastHandle<T>> broadcastHandleFactory) |
ArrayOfHandles(int count,
Int2ObjFunction<H> reduceHandleFactory) |
ArrayOfReducers(int count,
Int2ObjFunction<ReducerHandle<S,R>> reduceHandleFactory) |
Modifier and Type | Class and Description |
---|---|
class |
MultiSizedReusable<T>
Holds reusable objects of multiple sizes.
|
Constructor and Description |
---|
MultiSizedReusable(Int2ObjFunction<T> createSized,
Consumer<T> init) |
Copyright © 2011-2020 The Apache Software Foundation. All Rights Reserved.