org.apache.giraph.comm.netty

Class NettyWorkerClient<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

java.lang.Object

org.apache.giraph.comm.netty.NettyWorkerClient<I,V,E>

Type Parameters:

I - Vertex id

V - Vertex data

E - Edge data

All Implemented Interfaces:

WorkerClient<I,V,E>, ResetSuperstepMetricsObserver

public class NettyWorkerClient<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>
extends Object
implements WorkerClient<I,V,E>, ResetSuperstepMetricsObserver

Takes users facing APIs in WorkerClient and implements them using the available WritableRequest objects.

Constructor Summary

Constructors

Constructor and Description
NettyWorkerClient(org.apache.hadoop.mapreduce.Mapper.Context context, ImmutableClassesGiraphConfiguration<I,V,E> configuration, CentralizedServiceWorker<I,V,E> service, Thread.UncaughtExceptionHandler exceptionHandler) Only constructor.

Method Summary

Modifier and Type	Method and Description
void	authenticate() Authenticates, as client, with another BSP worker, as server.
void	closeConnections() Closes all connections.
FlowControl	getFlowControl()
CentralizedServiceWorker<I,V,E>	getService()
PartitionOwner	getVertexPartitionOwner(I vertexId) Lookup PartitionOwner for a vertex.
void	newSuperstep(SuperstepMetricsRegistry metrics) Starting a new superstep.
void	openConnections() Make sure that all the connections to workers and master have been established.
void	sendWritableRequest(int destTaskId, WritableRequest request) Send a request to a remote server (should be already connected)
void	setup(boolean authenticate) Setup the client.
void	waitAllRequests() Wait until all the outstanding requests are completed.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

NettyWorkerClient

public NettyWorkerClient(org.apache.hadoop.mapreduce.Mapper.Context context,
                         ImmutableClassesGiraphConfiguration<I,V,E> configuration,
                         CentralizedServiceWorker<I,V,E> service,
                         Thread.UncaughtExceptionHandler exceptionHandler)

Only constructor.

Parameters:

context - Context from mapper

configuration - Configuration

service - Used to get partition mapping

exceptionHandler - handler for uncaught exception. Will terminate job.

Method Detail

newSuperstep

public void newSuperstep(SuperstepMetricsRegistry metrics)

Description copied from interface: ResetSuperstepMetricsObserver

Starting a new superstep. Re-initialize your metrics.

Specified by:

newSuperstep in interface ResetSuperstepMetricsObserver

Parameters:

metrics - SuperstepMetricsRegistry being used.

getService

public CentralizedServiceWorker<I,V,E> getService()

openConnections

public void openConnections()

Description copied from interface: WorkerClient

Make sure that all the connections to workers and master have been established.

Specified by:

openConnections in interface WorkerClient<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

getVertexPartitionOwner

public PartitionOwner getVertexPartitionOwner(I vertexId)

Description copied from interface: WorkerClient

Lookup PartitionOwner for a vertex.

Specified by:

getVertexPartitionOwner in interface WorkerClient<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

Parameters:

vertexId - id to look up.

Returns:

PartitionOwner holding the vertex.

sendWritableRequest

public void sendWritableRequest(int destTaskId,
                                WritableRequest request)

Description copied from interface: WorkerClient

Send a request to a remote server (should be already connected)

Specified by:

sendWritableRequest in interface WorkerClient<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

Parameters:

destTaskId - Destination worker id

request - Request to send

waitAllRequests

public void waitAllRequests()

Description copied from interface: WorkerClient

Wait until all the outstanding requests are completed.

Specified by:

waitAllRequests in interface WorkerClient<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

closeConnections

public void closeConnections()
                      throws IOException

Description copied from interface: WorkerClient

Closes all connections.

Specified by:

closeConnections in interface WorkerClient<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

Throws:

IOException

setup

public void setup(boolean authenticate)

Description copied from interface: WorkerClient

Setup the client.

Specified by:

setup in interface WorkerClient<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

Parameters:

authenticate - whether to SASL authenticate with server or not: set by giraph.authenticate configuration option.

authenticate

public void authenticate()

Description copied from interface: WorkerClient

Authenticates, as client, with another BSP worker, as server.

Specified by:

authenticate in interface WorkerClient<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

getFlowControl

public FlowControl getFlowControl()

Specified by:

getFlowControl in interface WorkerClient<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

Returns:

the flow control used in sending requests