Aggregates worker aggregator requests and sends them off
Class for aggregator constants and utility methods
Accepts aggregators and their values from previous superstep from master and workers which own aggregators.
Cache which counts the number of flushes per task id (destination worker id), so we know how many requests were sent to the worker
Wrapper for output stream which keeps the place in the beginning for the count of objects which were written to it
CountingOutputStream which allows writing of
reduced values in the form of pair (name, type, value)
There are two modes:
- when class of the value is written into the stream.
Class for holding aggregators which current worker owns, and aggregating partial aggregator values from workers.
Takes and serializes global communication values and keeps them grouped by owner partition id, to be sent in bulk.
Copyright © 2011-2020 The Apache Software Foundation. All Rights Reserved.