org.apache.giraph.graph

Class RetryableJobProgressTrackerClient

java.lang.Object

org.apache.giraph.graph.RetryableJobProgressTrackerClient

All Implemented Interfaces:

JobProgressTrackerClient, JobProgressTracker

public class RetryableJobProgressTrackerClient
extends Object
implements JobProgressTrackerClient

Wrapper around JobProgressTracker which retries to connect and swallows exceptions so app wouldn't crash if something goes wrong with progress reports.

Field Summary

Fields

Modifier and Type	Field and Description
static IntConfOption	RETRYABLE_JOB_PROGRESS_CLIENT_NUM_RETRIES Conf option for number of retries
static IntConfOption	RETRYABLE_JOB_PROGRESS_CLIENT_RETRY_WAIT_MS Conf option for wait time between retries

Constructor Summary

Constructors

Constructor and Description
RetryableJobProgressTrackerClient() Default constructor.
RetryableJobProgressTrackerClient(GiraphConfiguration conf) Constructor

Method Summary

Modifier and Type	Method and Description
void	cleanup() Close the connections if any
void	init(GiraphConfiguration conf) Initialize the client.
void	logError(String logLine, byte[] exByteArray) Call this when you want to log an error line and exception object from any mapper to command line KryoWritableWrapper.convertFromByteArray can be used to get exception object back
void	logFailure(String reason) Notify that job is failing
void	logInfo(String logLine) Call this when you want to log an info line from any mapper to command line
void	mapperStarted() Notify JobProgressTracker that mapper started
void	sendMasterCounters(GiraphCountersThriftStruct giraphCounters) Master should call this method after all supersteps are finished, and send the aggregated counters to the job client
void	updateMasterProgress(MasterProgress masterProgress) Master should call this method to update its progress
void	updateProgress(WorkerProgress workerProgress) Workers should call this method to update their progress

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

RETRYABLE_JOB_PROGRESS_CLIENT_NUM_RETRIES

public static final IntConfOption RETRYABLE_JOB_PROGRESS_CLIENT_NUM_RETRIES

Conf option for number of retries

RETRYABLE_JOB_PROGRESS_CLIENT_RETRY_WAIT_MS

public static final IntConfOption RETRYABLE_JOB_PROGRESS_CLIENT_RETRY_WAIT_MS

Conf option for wait time between retries

Constructor Detail

RetryableJobProgressTrackerClient

public RetryableJobProgressTrackerClient()

Default constructor. Typically once an instance is created it should be initialized by calling init(GiraphConfiguration).

RetryableJobProgressTrackerClient

public RetryableJobProgressTrackerClient(GiraphConfiguration conf)
                                  throws ExecutionException,
                                         InterruptedException

Constructor

Parameters:

conf - Giraph configuration

Throws:

ExecutionException

InterruptedException

Method Detail

init

public void init(GiraphConfiguration conf)
          throws Exception

Description copied from interface: JobProgressTrackerClient

Initialize the client.

Specified by:

init in interface JobProgressTrackerClient

Parameters:

conf - Job configuration

Throws:

Exception

cleanup

public void cleanup()
             throws IOException

Description copied from interface: JobProgressTrackerClient

Close the connections if any

Specified by:

cleanup in interface JobProgressTrackerClient

Throws:

IOException

mapperStarted

public void mapperStarted()

Description copied from interface: JobProgressTracker

Notify JobProgressTracker that mapper started

Specified by:

mapperStarted in interface JobProgressTracker

logInfo

public void logInfo(String logLine)

Description copied from interface: JobProgressTracker

Call this when you want to log an info line from any mapper to command line

Specified by:

logInfo in interface JobProgressTracker

Parameters:

logLine - Line to log

logError

public void logError(String logLine,
                     byte[] exByteArray)

Description copied from interface: JobProgressTracker

Call this when you want to log an error line and exception object from any mapper to command line KryoWritableWrapper.convertFromByteArray can be used to get exception object back

Specified by:

logError in interface JobProgressTracker

Parameters:

logLine - Line to log

exByteArray - Exception byte array

logFailure

public void logFailure(String reason)

Description copied from interface: JobProgressTracker

Notify that job is failing

Specified by:

logFailure in interface JobProgressTracker

Parameters:

reason - Reason for failure

updateProgress

public void updateProgress(WorkerProgress workerProgress)

Description copied from interface: JobProgressTracker

Workers should call this method to update their progress

Specified by:

updateProgress in interface JobProgressTracker

Parameters:

workerProgress - Progress of the worker

updateMasterProgress

public void updateMasterProgress(MasterProgress masterProgress)

Description copied from interface: JobProgressTracker

Master should call this method to update its progress

Specified by:

updateMasterProgress in interface JobProgressTracker

Parameters:

masterProgress - Progress of the master

sendMasterCounters

public void sendMasterCounters(GiraphCountersThriftStruct giraphCounters)

Description copied from interface: JobProgressTracker

Master should call this method after all supersteps are finished, and send the aggregated counters to the job client

Specified by:

sendMasterCounters in interface JobProgressTracker

Parameters:

giraphCounters - Giraph-based counters