BspService (Apache Giraph Parent 1.4.0-SNAPSHOT API)

java.lang.Object
- org.apache.giraph.bsp.BspService<I,V,E>

Type Parameters:: I - Vertex id; V - Vertex data; E - Edge data

All Implemented Interfaces:: CentralizedService<I,V,E>, org.apache.zookeeper.Watcher

Direct Known Subclasses:: BspServiceMaster, BspServiceWorker

public abstract class BspService<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>
extends Object
implements org.apache.zookeeper.Watcher, CentralizedService<I,V,E>

Zookeeper-based implementation of CentralizedService.

Nested Class Summary
- Nested classes/interfaces inherited from interface org.apache.zookeeper.Watcher
  org.apache.zookeeper.Watcher.Event

Field Summary

Fields
Modifier and Type	Field and Description
`static String`	`APPLICATION_ATTEMPTS_DIR` Directory of attempts of this application
`protected String`	`applicationAttemptsPath` Path to the application attempts)
`static String`	`BASE_DIR` Base ZooKeeper directory
`protected String`	`basePath` Path to the job's root
`protected String`	`checkpointBasePath` Path to the checkpoint's root (including job id)
`static String`	`CLEANED_UP_DIR` Denotes which workers have been cleaned up
`protected String`	`cleanedUpPath` Path to the cleaned up notifications
`static String`	`COUNTERS_DIR` Counter sub directory
`static String`	`FORCE_CHECKPOINT_USER_FLAG` User sets this flag to checkpoint and stop the job
`static String`	`HALT_COMPUTATION_NODE` Denotes that computation should be halted
`protected String`	`haltComputationPath` If this path exists computation will be halted
`static String`	`INPUT_SPLITS_ALL_DONE_NODE` Input splits all done node
`static String`	`INPUT_SPLITS_WORKER_DONE_DIR` Input splits worker done directory
`static long`	`INPUT_SUPERSTEP` Input superstep (superstep when loading the vertices happens)
`protected String`	`inputSplitsAllDonePath` Input splits all done node
`protected String`	`inputSplitsWorkerDonePath` Input splits worker done directory
`static String`	`JSONOBJ_APPLICATION_ATTEMPT_KEY` JSON application attempt key
`static String`	`JSONOBJ_METRICS_KEY` JSON metrics key
`static String`	`JSONOBJ_NUM_MESSAGE_BYTES_KEY` JSON message bytes count key
`static String`	`JSONOBJ_NUM_MESSAGES_KEY` JSON message count key
`static String`	`JSONOBJ_STATE_KEY` JSON state key
`static String`	`JSONOBJ_SUPERSTEP_KEY` JSON superstep key
`static String`	`KRYO_REGISTERED_CLASS_DIR` Directory to store kryo className-ID assignment
`protected String`	`kryoRegisteredClassPath` Kryo className-ID mapping directory
`static String`	`MASTER_ELECTION_DIR` Where the master election happens
`static String`	`MASTER_JOB_STATE_NODE` Master job state znode above base dir
`static String`	`MASTER_SUFFIX` Suffix denotes a master
`protected String`	`masterElectionPath` Path to the master election path
`protected String`	`masterJobStatePath` Path to the job state determined by the master (informative only)
`static String`	`MEMORY_OBSERVER_DIR` Memory observer dir
`protected String`	`memoryObserverPath` Path where memory observer stores data
`static String`	`METRICS_DIR` Metrics sub directory
`static String`	`PARTITION_EXCHANGE_DIR` Helps coordinate the partition exchnages
`protected String`	`savedCheckpointBasePath` Old checkpoint in case we want to restart some job
`static String`	`SUPERSTEP_DIR` Superstep scope
`static String`	`SUPERSTEP_FINISHED_NODE` Denotes that the superstep is done
`static long`	`UNSET_APPLICATION_ATTEMPT` Unset application attempt
`static long`	`UNSET_SUPERSTEP` Unset superstep
`static String`	`WORKER_FINISHED_DIR` Finished workers notify here
`static String`	`WORKER_HEALTHY_DIR` Healthy workers register here.
`static String`	`WORKER_SUFFIX` Suffix denotes a worker
`static String`	`WORKER_UNHEALTHY_DIR` Unhealthy workers register here.
`static String`	`WORKER_WROTE_CHECKPOINT_DIR` Workers which wrote checkpoint notify here

Constructor Summary

Constructors
Constructor and Description

BspService(org.apache.hadoop.mapreduce.Mapper.Context context, GraphTaskManager<I,V,E> graphTaskManager)
Constructor.

Constructors
Constructor and Description
`BspService(org.apache.hadoop.mapreduce.Mapper.Context context, GraphTaskManager<I,V,E> graphTaskManager)` Constructor.

Method Summary

All Methods Static Methods Instance Methods Concrete Methods
Modifier and Type	Method and Description
`long`	`getApplicationAttempt()` Get the latest application attempt and cache it.
`BspEvent`	`getApplicationAttemptChangedEvent()`
`String`	`getCheckpointBasePath(long superstep)` Generate the base superstep directory path for a given application attempt
`BspEvent`	`getCleanedUpChildrenChangedEvent()`
`ImmutableClassesGiraphConfiguration<I,V,E>`	`getConfiguration()` Get configuration
`org.apache.hadoop.mapreduce.Mapper.Context`	`getContext()`
`org.apache.hadoop.fs.FileSystem`	`getFs()` Get the file system
`protected GraphPartitionerFactory<I,V,E>`	`getGraphPartitionerFactory()` Subclasses can use this to instantiate their respective partitioners
`GraphTaskManager<I,V,E>`	`getGraphTaskManager()`
`static String`	`getHealthyHostnameIdFromPath(String path)` Get the hostname and id from a "healthy" worker path
`String`	`getHostname()`
`String`	`getHostnameTaskId()`
`BspEvent`	`getInputSplitsAllDoneEvent()`
`BspEvent`	`getInputSplitsWorkerDoneEvent()`
`String`	`getJobId()` Get the job id
`JobProgressTracker`	`getJobProgressTracker()` Get JobProgressTracker to report progress to
`org.json.JSONObject`	`getJobState()` Get the master commanded job state as a JSONObject.
`protected long`	`getLastCheckpointedSuperstep()` Get the last saved superstep.
`BspEvent`	`getMasterElectionChildrenChangedEvent()`
`String`	`getPartitionExchangePath(long attempt, long superstep)` Generate the "partition exchange" directory path for a superstep
`String`	`getPartitionExchangeWorkerPath(long attempt, long superstep, WorkerInfo workerInfo)` Based on the superstep, worker info, and attempt, get the appropriate worker path for the exchange.
`long`	`getRestartedSuperstep()` Get the restarted superstep
`String`	`getSavedCheckpointBasePath(long superstep)` In case when we restart another job this will give us a path to saved checkpoint.
`long`	`getSuperstep()` Get the latest superstep and cache it.
`BspEvent`	`getSuperstepFinishedEvent()`
`String`	`getSuperstepFinishedPath(long attempt, long superstep)` Generate the "superstep finished" directory path for a superstep
`static long`	`getSuperstepFromPath(String path)` Get the superstep from a ZooKeeper path
`String`	`getSuperstepPath(long attempt)` Generate the base superstep directory path for a given application attempt
`int`	`getTaskId()`
`String`	`getWorkerCountersFinishedPath(long attempt, long superstep)` Generate the worker "finished" directory path for a superstep, for storing the superstep-related counters
`BspEvent`	`getWorkerHealthRegistrationChangedEvent()`
`protected int`	`getWorkerId(WorkerInfo workerInfo)` For every worker this method returns unique number between 0 and N, where N is the total number of workers.
`protected WorkerInfo`	`getWorkerInfoById(int id)` Returns worker info corresponding to specified worker id.
`String`	`getWorkerInfoHealthyPath(long attempt, long superstep)` Generate the worker information "healthy" directory path for a superstep
`String`	`getWorkerInfoUnhealthyPath(long attempt, long superstep)` Generate the worker information "unhealthy" directory path for a superstep
`String`	`getWorkerMetricsFinishedPath(long attempt, long superstep)` Generate the worker "finished" directory path for a superstep, for storing the superstep-related metrics
`String`	`getWorkerWroteCheckpointPath(long attempt, long superstep)` Generate the worker "wrote checkpoint" directory path for a superstep
`BspEvent`	`getWrittenCountersToZKEvent()`
`ZooKeeperExt`	`getZkExt()` Get the ZooKeeperExt instance.
`void`	`incrCachedSuperstep()` Increment the cached superstep.
`void`	`process(org.apache.zookeeper.WatchedEvent event)`
`protected boolean`	`processEvent(org.apache.zookeeper.WatchedEvent event)` Derived classes that want additional ZooKeeper events to take action should override this.
`void`	`registerBspEvent(BspEvent event)` Register a BspEvent.
`void`	`setApplicationAttempt(long applicationAttempt)` Set the cached application attempt (should only be used for restart from failure by the master)
`void`	`setCachedSuperstep(long superstep)` Set the cached superstep (should only be used for loading checkpoints or recovering from failure).
`void`	`setRestartedSuperstep(long superstep)` Set the restarted superstep

Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.giraph.bsp.CentralizedService
getMasterInfo, getWorkerInfoList

- Field Detail
  - UNSET_SUPERSTEP
```
public static final long UNSET_SUPERSTEP
```
    Unset superstep
    
    See Also:
    
    Constant Field Values
  - INPUT_SUPERSTEP
```
public static final long INPUT_SUPERSTEP
```
    Input superstep (superstep when loading the vertices happens)
    
    See Also:
    
    Constant Field Values
  - UNSET_APPLICATION_ATTEMPT
```
public static final long UNSET_APPLICATION_ATTEMPT
```
    Unset application attempt
    
    See Also:
    
    Constant Field Values
  - BASE_DIR
```
public static final String BASE_DIR
```
    Base ZooKeeper directory
    
    See Also:
    
    Constant Field Values
  - MASTER_JOB_STATE_NODE
```
public static final String MASTER_JOB_STATE_NODE
```
    Master job state znode above base dir
    
    See Also:
    
    Constant Field Values
  - INPUT_SPLITS_WORKER_DONE_DIR
```
public static final String INPUT_SPLITS_WORKER_DONE_DIR
```
    Input splits worker done directory
    
    See Also:
    
    Constant Field Values
  - INPUT_SPLITS_ALL_DONE_NODE
```
public static final String INPUT_SPLITS_ALL_DONE_NODE
```
    Input splits all done node
    
    See Also:
    
    Constant Field Values
  - KRYO_REGISTERED_CLASS_DIR
```
public static final String KRYO_REGISTERED_CLASS_DIR
```
    Directory to store kryo className-ID assignment
    
    See Also:
    
    Constant Field Values
  - APPLICATION_ATTEMPTS_DIR
```
public static final String APPLICATION_ATTEMPTS_DIR
```
    Directory of attempts of this application
    
    See Also:
    
    Constant Field Values
  - MASTER_ELECTION_DIR
```
public static final String MASTER_ELECTION_DIR
```
    Where the master election happens
    
    See Also:
    
    Constant Field Values
  - SUPERSTEP_DIR
```
public static final String SUPERSTEP_DIR
```
    Superstep scope
    
    See Also:
    
    Constant Field Values
  - COUNTERS_DIR
```
public static final String COUNTERS_DIR
```
    Counter sub directory
    
    See Also:
    
    Constant Field Values
  - METRICS_DIR
```
public static final String METRICS_DIR
```
    Metrics sub directory
    
    See Also:
    
    Constant Field Values
  - WORKER_HEALTHY_DIR
```
public static final String WORKER_HEALTHY_DIR
```
    Healthy workers register here.
    
    See Also:
    
    Constant Field Values
  - WORKER_UNHEALTHY_DIR
```
public static final String WORKER_UNHEALTHY_DIR
```
    Unhealthy workers register here.
    
    See Also:
    
    Constant Field Values
  - WORKER_WROTE_CHECKPOINT_DIR
```
public static final String WORKER_WROTE_CHECKPOINT_DIR
```
    Workers which wrote checkpoint notify here
    
    See Also:
    
    Constant Field Values
  - WORKER_FINISHED_DIR
```
public static final String WORKER_FINISHED_DIR
```
    Finished workers notify here
    
    See Also:
    
    Constant Field Values
  - PARTITION_EXCHANGE_DIR
```
public static final String PARTITION_EXCHANGE_DIR
```
    Helps coordinate the partition exchnages
    
    See Also:
    
    Constant Field Values
  - SUPERSTEP_FINISHED_NODE
```
public static final String SUPERSTEP_FINISHED_NODE
```
    Denotes that the superstep is done
    
    See Also:
    
    Constant Field Values
  - HALT_COMPUTATION_NODE
```
public static final String HALT_COMPUTATION_NODE
```
    Denotes that computation should be halted
    
    See Also:
    
    Constant Field Values
  - MEMORY_OBSERVER_DIR
```
public static final String MEMORY_OBSERVER_DIR
```
    Memory observer dir
    
    See Also:
    
    Constant Field Values
  - FORCE_CHECKPOINT_USER_FLAG
```
public static final String FORCE_CHECKPOINT_USER_FLAG
```
    User sets this flag to checkpoint and stop the job
    
    See Also:
    
    Constant Field Values
  - CLEANED_UP_DIR
```
public static final String CLEANED_UP_DIR
```
    Denotes which workers have been cleaned up
    
    See Also:
    
    Constant Field Values
  - JSONOBJ_NUM_MESSAGES_KEY
```
public static final String JSONOBJ_NUM_MESSAGES_KEY
```
    JSON message count key
    
    See Also:
    
    Constant Field Values
  - JSONOBJ_NUM_MESSAGE_BYTES_KEY
```
public static final String JSONOBJ_NUM_MESSAGE_BYTES_KEY
```
    JSON message bytes count key
    
    See Also:
    
    Constant Field Values
  - JSONOBJ_METRICS_KEY
```
public static final String JSONOBJ_METRICS_KEY
```
    JSON metrics key
    
    See Also:
    
    Constant Field Values
  - JSONOBJ_STATE_KEY
```
public static final String JSONOBJ_STATE_KEY
```
    JSON state key
    
    See Also:
    
    Constant Field Values
  - JSONOBJ_APPLICATION_ATTEMPT_KEY
```
public static final String JSONOBJ_APPLICATION_ATTEMPT_KEY
```
    JSON application attempt key
    
    See Also:
    
    Constant Field Values
  - JSONOBJ_SUPERSTEP_KEY
```
public static final String JSONOBJ_SUPERSTEP_KEY
```
    JSON superstep key
    
    See Also:
    
    Constant Field Values
  - WORKER_SUFFIX
```
public static final String WORKER_SUFFIX
```
    Suffix denotes a worker
    
    See Also:
    
    Constant Field Values
  - MASTER_SUFFIX
```
public static final String MASTER_SUFFIX
```
    Suffix denotes a master
    
    See Also:
    
    Constant Field Values
  - basePath
```
protected final String basePath
```
    Path to the job's root
  - masterJobStatePath
```
protected final String masterJobStatePath
```
    Path to the job state determined by the master (informative only)
  - inputSplitsWorkerDonePath
```
protected final String inputSplitsWorkerDonePath
```
    Input splits worker done directory
  - inputSplitsAllDonePath
```
protected final String inputSplitsAllDonePath
```
    Input splits all done node
  - applicationAttemptsPath
```
protected final String applicationAttemptsPath
```
    Path to the application attempts)
  - cleanedUpPath
```
protected final String cleanedUpPath
```
    Path to the cleaned up notifications
  - checkpointBasePath
```
protected final String checkpointBasePath
```
    Path to the checkpoint's root (including job id)
  - savedCheckpointBasePath
```
protected final String savedCheckpointBasePath
```
    Old checkpoint in case we want to restart some job
  - masterElectionPath
```
protected final String masterElectionPath
```
    Path to the master election path
  - haltComputationPath
```
protected final String haltComputationPath
```
    If this path exists computation will be halted
  - memoryObserverPath
```
protected final String memoryObserverPath
```
    Path where memory observer stores data
  - kryoRegisteredClassPath
```
protected final String kryoRegisteredClassPath
```
    Kryo className-ID mapping directory
- Constructor Detail
  - BspService
```
public BspService(org.apache.hadoop.mapreduce.Mapper.Context context,
                  GraphTaskManager<I,V,E> graphTaskManager)
```
    Constructor.
    
    Parameters:
    
    context - Mapper context
    
    graphTaskManager - GraphTaskManager for this compute node
- Method Detail
  - getSuperstepFromPath
```
public static long getSuperstepFromPath(String path)
```
    Get the superstep from a ZooKeeper path
    
    Parameters:
    
    path - Path to parse for the superstep
    
    Returns:
    
    Superstep from the path.
  - getHealthyHostnameIdFromPath
```
public static String getHealthyHostnameIdFromPath(String path)
```
    Get the hostname and id from a "healthy" worker path
    
    Parameters:
    
    path - Path to check
    
    Returns:
    
    Hostname and id from path
  - getSuperstepPath
```
public final String getSuperstepPath(long attempt)
```
    Generate the base superstep directory path for a given application attempt
    
    Parameters:
    
    attempt - application attempt number
    
    Returns:
    
    directory path based on the an attempt
  - getWorkerInfoHealthyPath
```
public final String getWorkerInfoHealthyPath(long attempt,
                                             long superstep)
```
    Generate the worker information "healthy" directory path for a superstep
    
    Parameters:
    
    attempt - application attempt number
    
    superstep - superstep to use
    
    Returns:
    
    directory path based on the a superstep
  - getWorkerInfoUnhealthyPath
```
public final String getWorkerInfoUnhealthyPath(long attempt,
                                               long superstep)
```
    Generate the worker information "unhealthy" directory path for a superstep
    
    Parameters:
    
    attempt - application attempt number
    
    superstep - superstep to use
    
    Returns:
    
    directory path based on the a superstep
  - getWorkerWroteCheckpointPath
```
public final String getWorkerWroteCheckpointPath(long attempt,
                                                 long superstep)
```
    Generate the worker "wrote checkpoint" directory path for a superstep
    
    Parameters:
    
    attempt - application attempt number
    
    superstep - superstep to use
    
    Returns:
    
    directory path based on the a superstep
  - getWorkerMetricsFinishedPath
```
public final String getWorkerMetricsFinishedPath(long attempt,
                                                 long superstep)
```
    Generate the worker "finished" directory path for a superstep, for storing the superstep-related metrics
    
    Parameters:
    
    attempt - application attempt number
    
    superstep - superstep to use
    
    Returns:
    
    directory path based on the a superstep
  - getWorkerCountersFinishedPath
```
public final String getWorkerCountersFinishedPath(long attempt,
                                                  long superstep)
```
    Generate the worker "finished" directory path for a superstep, for storing the superstep-related counters
    
    Parameters:
    
    attempt - application attempt number
    
    superstep - superstep to use
    
    Returns:
    
    directory path based on the a superstep
  - getPartitionExchangePath
```
public final String getPartitionExchangePath(long attempt,
                                             long superstep)
```
    Generate the "partition exchange" directory path for a superstep
    
    Parameters:
    
    attempt - application attempt number
    
    superstep - superstep to use
    
    Returns:
    
    directory path based on the a superstep
  - getPartitionExchangeWorkerPath
```
public final String getPartitionExchangeWorkerPath(long attempt,
                                                   long superstep,
                                                   WorkerInfo workerInfo)
```
    Based on the superstep, worker info, and attempt, get the appropriate worker path for the exchange.
    
    Parameters:
    
    attempt - Application attempt
    
    superstep - Superstep
    
    workerInfo - Worker info of the exchange.
    
    Returns:
    
    Path of the desired worker
  - getSuperstepFinishedPath
```
public final String getSuperstepFinishedPath(long attempt,
                                             long superstep)
```
    Generate the "superstep finished" directory path for a superstep
    
    Parameters:
    
    attempt - application attempt number
    
    superstep - superstep to use
    
    Returns:
    
    directory path based on the a superstep
  - getCheckpointBasePath
```
public final String getCheckpointBasePath(long superstep)
```
    Generate the base superstep directory path for a given application attempt
    
    Parameters:
    
    superstep - Superstep to use
    
    Returns:
    
    Directory path based on the a superstep
  - getSavedCheckpointBasePath
```
public final String getSavedCheckpointBasePath(long superstep)
```
    In case when we restart another job this will give us a path to saved checkpoint.
    
    Parameters:
    
    superstep - superstep to use
    
    Returns:
    
    Direcory path for restarted job based on the superstep
  - getZkExt
```
public final ZooKeeperExt getZkExt()
```
    Get the ZooKeeperExt instance.
    
    Returns:
    
    ZooKeeperExt instance.
  - getRestartedSuperstep
```
public final long getRestartedSuperstep()
```
    Description copied from interface: CentralizedService
    
    Get the restarted superstep
    
    Specified by:
    
    getRestartedSuperstep in interface CentralizedService<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>
    
    Returns:
    
    -1 if not manually restarted, otherwise the superstep id
  - setRestartedSuperstep
```
public final void setRestartedSuperstep(long superstep)
```
    Set the restarted superstep
    
    Parameters:
    
    superstep - Set the manually restarted superstep
  - getFs
```
public final org.apache.hadoop.fs.FileSystem getFs()
```
    Get the file system
    
    Returns:
    
    file system
  - getConfiguration
```
public final ImmutableClassesGiraphConfiguration<I,V,E> getConfiguration()
```
    Description copied from interface: CentralizedService
    
    Get configuration
    
    Specified by:
    
    getConfiguration in interface CentralizedService<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>
    
    Returns:
    
    configuration
  - getContext
```
public final org.apache.hadoop.mapreduce.Mapper.Context getContext()
```
  - getHostname
```
public final String getHostname()
```
  - getHostnameTaskId
```
public final String getHostnameTaskId()
```
  - getTaskId
```
public final int getTaskId()
```
  - getGraphTaskManager
```
public final GraphTaskManager<I,V,E> getGraphTaskManager()
```
  - getWorkerHealthRegistrationChangedEvent
```
public final BspEvent getWorkerHealthRegistrationChangedEvent()
```
  - getApplicationAttemptChangedEvent
```
public final BspEvent getApplicationAttemptChangedEvent()
```
  - getInputSplitsWorkerDoneEvent
```
public final BspEvent getInputSplitsWorkerDoneEvent()
```
  - getInputSplitsAllDoneEvent
```
public final BspEvent getInputSplitsAllDoneEvent()
```
  - getSuperstepFinishedEvent
```
public final BspEvent getSuperstepFinishedEvent()
```
  - getMasterElectionChildrenChangedEvent
```
public final BspEvent getMasterElectionChildrenChangedEvent()
```
  - getCleanedUpChildrenChangedEvent
```
public final BspEvent getCleanedUpChildrenChangedEvent()
```
  - getWrittenCountersToZKEvent
```
public final BspEvent getWrittenCountersToZKEvent()
```
  - getJobState
```
public final org.json.JSONObject getJobState()
```
    Get the master commanded job state as a JSONObject. Also sets the watches to see if the master commanded job state changes.
    
    Returns:
    
    Last job state or null if none
  - getJobId
```
public final String getJobId()
```
    Get the job id
    
    Returns:
    
    job id
  - getApplicationAttempt
```
public final long getApplicationAttempt()
```
    Get the latest application attempt and cache it.
    
    Returns:
    
    the latest application attempt
  - getSuperstep
```
public final long getSuperstep()
```
    Get the latest superstep and cache it.
    
    Specified by:
    
    getSuperstep in interface CentralizedService<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>
    
    Returns:
    
    the latest superstep
  - incrCachedSuperstep
```
public final void incrCachedSuperstep()
```
    Increment the cached superstep. Shouldn't be the initial value anymore.
  - setCachedSuperstep
```
public final void setCachedSuperstep(long superstep)
```
    Set the cached superstep (should only be used for loading checkpoints or recovering from failure).
    
    Parameters:
    
    superstep - will be used as the next superstep iteration
  - setApplicationAttempt
```
public final void setApplicationAttempt(long applicationAttempt)
```
    Set the cached application attempt (should only be used for restart from failure by the master)
    
    Parameters:
    
    applicationAttempt - Will denote the new application attempt
  - registerBspEvent
```
public void registerBspEvent(BspEvent event)
```
    Register a BspEvent. Ensure that it will be signaled by catastrophic failure so that threads waiting on an event signal will be unblocked.
    
    Parameters:
    
    event - Event to be registered.
  - getGraphPartitionerFactory
```
protected GraphPartitionerFactory<I,V,E> getGraphPartitionerFactory()
```
    Subclasses can use this to instantiate their respective partitioners
    
    Returns:
    
    Instantiated graph partitioner factory
  - processEvent
```
protected boolean processEvent(org.apache.zookeeper.WatchedEvent event)
```
    Derived classes that want additional ZooKeeper events to take action should override this.
    
    Parameters:
    
    event - Event that occurred
    
    Returns:
    
    true if the event was processed here, false otherwise
  - process
```
public final void process(org.apache.zookeeper.WatchedEvent event)
```
    Specified by:
    
    process in interface org.apache.zookeeper.Watcher
  - getLastCheckpointedSuperstep
```
protected long getLastCheckpointedSuperstep()
                                     throws IOException
```
    Get the last saved superstep.
    
    Returns:
    
    Last good superstep number
    
    Throws:
    
    IOException
  - getJobProgressTracker
```
public JobProgressTracker getJobProgressTracker()
```
    Description copied from interface: CentralizedService
    
    Get JobProgressTracker to report progress to
    
    Specified by:
    
    getJobProgressTracker in interface CentralizedService<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>
    
    Returns:
    
    JobProgressTrackerClient
  - getWorkerId
```
protected int getWorkerId(WorkerInfo workerInfo)
```
    For every worker this method returns unique number between 0 and N, where N is the total number of workers. This number stays the same throughout the computation. TaskID may be different from this number and task ID is not necessarily continuous
    
    Parameters:
    
    workerInfo - worker info object
    
    Returns:
    
    worker number
  - getWorkerInfoById
```
protected WorkerInfo getWorkerInfoById(int id)
```
    Returns worker info corresponding to specified worker id.
    
    Parameters:
    
    id - unique worker id
    
    Returns:
    
    WorkerInfo

Class BspService<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.zookeeper.Watcher

Field Summary

Constructor Summary

Method Summary

Methods inherited from class java.lang.Object

Methods inherited from interface org.apache.giraph.bsp.CentralizedService

Field Detail

UNSET_SUPERSTEP

INPUT_SUPERSTEP

UNSET_APPLICATION_ATTEMPT

BASE_DIR

MASTER_JOB_STATE_NODE

INPUT_SPLITS_WORKER_DONE_DIR

INPUT_SPLITS_ALL_DONE_NODE

KRYO_REGISTERED_CLASS_DIR

APPLICATION_ATTEMPTS_DIR

MASTER_ELECTION_DIR

SUPERSTEP_DIR

COUNTERS_DIR

METRICS_DIR

WORKER_HEALTHY_DIR

WORKER_UNHEALTHY_DIR

WORKER_WROTE_CHECKPOINT_DIR

WORKER_FINISHED_DIR

PARTITION_EXCHANGE_DIR

SUPERSTEP_FINISHED_NODE

HALT_COMPUTATION_NODE

MEMORY_OBSERVER_DIR

FORCE_CHECKPOINT_USER_FLAG

CLEANED_UP_DIR

JSONOBJ_NUM_MESSAGES_KEY

JSONOBJ_NUM_MESSAGE_BYTES_KEY

JSONOBJ_METRICS_KEY

JSONOBJ_STATE_KEY

JSONOBJ_APPLICATION_ATTEMPT_KEY

JSONOBJ_SUPERSTEP_KEY

WORKER_SUFFIX

MASTER_SUFFIX

basePath

masterJobStatePath

inputSplitsWorkerDonePath

inputSplitsAllDonePath

applicationAttemptsPath

cleanedUpPath

checkpointBasePath

savedCheckpointBasePath

masterElectionPath

haltComputationPath

memoryObserverPath

kryoRegisteredClassPath

Constructor Detail

BspService

Method Detail

getSuperstepFromPath

getHealthyHostnameIdFromPath

getSuperstepPath

getWorkerInfoHealthyPath

getWorkerInfoUnhealthyPath

getWorkerWroteCheckpointPath

getWorkerMetricsFinishedPath

getWorkerCountersFinishedPath

getPartitionExchangePath

getPartitionExchangeWorkerPath

getSuperstepFinishedPath

getCheckpointBasePath

getSavedCheckpointBasePath

getZkExt

getRestartedSuperstep

setRestartedSuperstep

getFs

getConfiguration

getContext

getHostname

getHostnameTaskId

getTaskId

getGraphTaskManager

getWorkerHealthRegistrationChangedEvent

getApplicationAttemptChangedEvent