org.apache.giraph.utils

Class ReactiveJMapHistoDumper

java.lang.Object

org.apache.giraph.conf.DefaultImmutableClassesGiraphConfigurable

org.apache.giraph.utils.ReactiveJMapHistoDumper

All Implemented Interfaces:

GiraphConfigurationSettable, ImmutableClassesGiraphConfigurable, MasterObserver, WorkerObserver

public class ReactiveJMapHistoDumper
extends DefaultImmutableClassesGiraphConfigurable
implements MasterObserver, WorkerObserver

An observer for both worker and master that periodically checks if available memory on heap is below certain threshold, and if found to be the case dumps jmap -histo for the process

Constructor Summary

Constructors

Constructor and Description
ReactiveJMapHistoDumper()

Method Summary

Modifier and Type	Method and Description
void	applicationFailed(Exception e) If there is an error during the application.
void	postApplication() After application ends.
void	postSave() Finalize the observer.
void	postSuperstep(long superstep) After each superstep ends.
void	preApplication() Before application begins.
void	preLoad() Initialize the observer.
void	preSuperstep(long superstep) Before each superstep starts.
void	setConf(ImmutableClassesGiraphConfiguration configuration) Set the configuration to be used by this object.
void	startSupervisorThread() Start the supervisor thread
void	superstepMetricsUpdate(long superstep, AggregatedMetrics aggregatedMetrics, List<PartitionStats> partitionStatsList) Called after each superstep with aggregated metrics from workers

Methods inherited from class org.apache.giraph.conf.DefaultImmutableClassesGiraphConfigurable

getConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.giraph.conf.ImmutableClassesGiraphConfigurable

getConf

Constructor Detail

ReactiveJMapHistoDumper

public ReactiveJMapHistoDumper()

Method Detail

preLoad

public void preLoad()

Description copied from interface: WorkerObserver

Initialize the observer. This method is executed once on each worker before loading.

Specified by:

preLoad in interface WorkerObserver

postSave

public void postSave()

Description copied from interface: WorkerObserver

Finalize the observer. This method is executed once on each worker after saving.

Specified by:

postSave in interface WorkerObserver

preApplication

public void preApplication()

Description copied from interface: MasterObserver

Before application begins.

Specified by:

preApplication in interface MasterObserver

Specified by:

preApplication in interface WorkerObserver

postApplication

public void postApplication()

Description copied from interface: MasterObserver

After application ends.

Specified by:

postApplication in interface MasterObserver

Specified by:

postApplication in interface WorkerObserver

startSupervisorThread

public void startSupervisorThread()

Start the supervisor thread

preSuperstep

public void preSuperstep(long superstep)

Description copied from interface: MasterObserver

Before each superstep starts.

Specified by:

preSuperstep in interface MasterObserver

Specified by:

preSuperstep in interface WorkerObserver

Parameters:

superstep - The superstep number

postSuperstep

public void postSuperstep(long superstep)

Description copied from interface: MasterObserver

After each superstep ends.

Specified by:

postSuperstep in interface MasterObserver

Specified by:

postSuperstep in interface WorkerObserver

Parameters:

superstep - The superstep number

superstepMetricsUpdate

public void superstepMetricsUpdate(long superstep,
                                   AggregatedMetrics aggregatedMetrics,
                                   List<PartitionStats> partitionStatsList)

Description copied from interface: MasterObserver

Called after each superstep with aggregated metrics from workers

Specified by:

superstepMetricsUpdate in interface MasterObserver

Parameters:

superstep - Supsertep number

aggregatedMetrics - Metrics

partitionStatsList - List of partition stats

applicationFailed

public void applicationFailed(Exception e)

Description copied from interface: MasterObserver

If there is an error during the application.

Specified by:

applicationFailed in interface MasterObserver

Parameters:

e - Exception that caused failure. May be null.

setConf

public void setConf(ImmutableClassesGiraphConfiguration configuration)

Description copied from interface: GiraphConfigurationSettable

Set the configuration to be used by this object.

Specified by:

setConf in interface GiraphConfigurationSettable

Overrides:

setConf in class DefaultImmutableClassesGiraphConfigurable

Parameters:

configuration - Set configuration