org.apache.giraph.io.internal

Class WrappedMappingReader<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable,B extends org.apache.hadoop.io.Writable>

java.lang.Object

org.apache.giraph.conf.DefaultImmutableClassesGiraphConfigurable<I,V,E>

org.apache.giraph.worker.WorkerAggregatorDelegator<I,V,E>

org.apache.giraph.io.MappingReader<I,V,E,B>

org.apache.giraph.io.internal.WrappedMappingReader<I,V,E,B>

Type Parameters:

I - vertexId type

V - vertexValue type

E - edgeValue type

B - mappingTarget type

All Implemented Interfaces:

AggregatorUsage, GiraphConfigurationSettable<I,V,E>, ImmutableClassesGiraphConfigurable<I,V,E>, WorkerAggregatorUsage, WorkerBroadcastUsage, WorkerGlobalCommUsage, WorkerReduceUsage

public class WrappedMappingReader<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable,B extends org.apache.hadoop.io.Writable>
extends MappingReader<I,V,E,B>

For internal use only. Wraps MappingReader to make sure proper configuration parameters are passed around, that parameters set in original configuration are available in methods of this reader

Constructor Summary

Constructors

Constructor and Description
WrappedMappingReader(MappingReader<I,V,E,B> baseMappingReader, ImmutableClassesGiraphConfiguration<I,V,E> conf) Constructor

Method Summary

Modifier and Type	Method and Description
void	close() Close this MappingReader to future operations.
MappingEntry<I,B>	getCurrentEntry() Get the current entry.
float	getProgress() How much of the input has the VertexReader consumed i.e.
void	initialize(org.apache.hadoop.mapreduce.InputSplit inputSplit, org.apache.hadoop.mapreduce.TaskAttemptContext context) Use the input split and context to setup reading the vertices.
boolean	nextEntry()
void	setConf(ImmutableClassesGiraphConfiguration<I,V,E> conf) Set the configuration to be used by this object.
void	setWorkerGlobalCommUsage(WorkerGlobalCommUsage usage) Set worker global communication usage

Methods inherited from class org.apache.giraph.worker.WorkerAggregatorDelegator

aggregate, getAggregatedValue, getBroadcast, reduce, reduceMerge

Methods inherited from class org.apache.giraph.conf.DefaultImmutableClassesGiraphConfigurable

getConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

WrappedMappingReader

public WrappedMappingReader(MappingReader<I,V,E,B> baseMappingReader,
                            ImmutableClassesGiraphConfiguration<I,V,E> conf)

Constructor

Parameters:

baseMappingReader - User set baseMappingReader

conf - configuration

Method Detail

setConf

public void setConf(ImmutableClassesGiraphConfiguration<I,V,E> conf)

Description copied from interface: GiraphConfigurationSettable

Set the configuration to be used by this object.

Specified by:

setConf in interface GiraphConfigurationSettable<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

Overrides:

setConf in class DefaultImmutableClassesGiraphConfigurable<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

Parameters:

conf - Set configuration

initialize

public void initialize(org.apache.hadoop.mapreduce.InputSplit inputSplit,
                       org.apache.hadoop.mapreduce.TaskAttemptContext context)
                throws IOException,
                       InterruptedException

Description copied from class: MappingReader

Use the input split and context to setup reading the vertices. Guaranteed to be called prior to any other function.

Specified by:

initialize in class MappingReader<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable,B extends org.apache.hadoop.io.Writable>

Parameters:

inputSplit - Input split to be used for reading vertices.

context - Context from the task.

Throws:

IOException

InterruptedException

setWorkerGlobalCommUsage

public void setWorkerGlobalCommUsage(WorkerGlobalCommUsage usage)

Description copied from class: WorkerAggregatorDelegator

Set worker global communication usage

Overrides:

setWorkerGlobalCommUsage in class WorkerAggregatorDelegator<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

Parameters:

usage - Worker global communication usage

nextEntry

public boolean nextEntry()
                  throws IOException,
                         InterruptedException

Specified by:

nextEntry in class MappingReader<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable,B extends org.apache.hadoop.io.Writable>

Returns:

false iff there are no more vertices

Throws:

IOException

InterruptedException

getCurrentEntry

public MappingEntry<I,B> getCurrentEntry()
                                  throws IOException,
                                         InterruptedException

Description copied from class: MappingReader

Get the current entry.

Specified by:

getCurrentEntry in class MappingReader<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable,B extends org.apache.hadoop.io.Writable>

Returns:

the current entry which has been read. nextVEntry() should be called first.

Throws:

IOException

InterruptedException

close

public void close()
           throws IOException

Description copied from class: MappingReader

Close this MappingReader to future operations.

Specified by:

close in class MappingReader<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable,B extends org.apache.hadoop.io.Writable>

Throws:

IOException

getProgress

public float getProgress()
                  throws IOException,
                         InterruptedException

Description copied from class: MappingReader

How much of the input has the VertexReader consumed i.e. has been processed by?

Specified by:

getProgress in class MappingReader<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable,B extends org.apache.hadoop.io.Writable>

Returns:

Progress from 0.0 to 1.0.

Throws:

IOException

InterruptedException