org.apache.giraph.scripting

Class ScriptLoader

java.lang.Object

org.apache.giraph.scripting.ScriptLoader

public class ScriptLoader
extends Object

Loads scripts written by user in other languages, for example Jython.

Field Summary

Fields

Modifier and Type	Field and Description
static JsonStringConfOption	SCRIPTS_TO_LOAD Option for scripts to load on workers

Method Summary

Modifier and Type	Method and Description
static void	addScriptToLoad(org.apache.hadoop.conf.Configuration conf, DeployedScript script) Add a script to load on workers
static void	addScriptToLoad(org.apache.hadoop.conf.Configuration conf, String script, DeployType deployType, Language language) Add a script to load on workers
static List<DeployedScript>	getLoadedScripts() Get list of scripts already loaded.
static List<DeployedScript>	getScriptsToLoad(org.apache.hadoop.conf.Configuration conf) Get the list of scripts to load on workers
static void	loadScript(org.apache.hadoop.conf.Configuration conf, DeployedScript deployedScript) Load a single deployed script
static void	loadScripts(org.apache.hadoop.conf.Configuration conf) Load all the scripts deployed in Configuration
static void	setScriptsToLoad(org.apache.hadoop.conf.Configuration conf, DeployedScript... scripts) Deploy scripts
static void	setScriptsToLoad(org.apache.hadoop.conf.Configuration conf, String scriptPath, DeployType deployType, Language language) Deploy a script
static void	setScriptsToLoad(org.apache.hadoop.conf.Configuration conf, String script1, DeployType deployType1, Language language1, String script2, DeployType deployType2, Language language2) Deploy pair of scripts

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

SCRIPTS_TO_LOAD

public static final JsonStringConfOption SCRIPTS_TO_LOAD

Option for scripts to load on workers

Method Detail

setScriptsToLoad

public static void setScriptsToLoad(org.apache.hadoop.conf.Configuration conf,
                                    String scriptPath,
                                    DeployType deployType,
                                    Language language)

Deploy a script

Parameters:

conf - Configuration

scriptPath - Path to script

deployType - type of deployment

language - programming language

setScriptsToLoad

public static void setScriptsToLoad(org.apache.hadoop.conf.Configuration conf,
                                    String script1,
                                    DeployType deployType1,
                                    Language language1,
                                    String script2,
                                    DeployType deployType2,
                                    Language language2)

Deploy pair of scripts

Parameters:

conf - Configuration

script1 - Path to script

deployType1 - type of deployment

language1 - programming language

script2 - Path to script

deployType2 - type of deployment

language2 - programming language

setScriptsToLoad

public static void setScriptsToLoad(org.apache.hadoop.conf.Configuration conf,
                                    DeployedScript... scripts)

Deploy scripts

Parameters:

conf - Configuration

scripts - the scripts to deploy

addScriptToLoad

public static void addScriptToLoad(org.apache.hadoop.conf.Configuration conf,
                                   String script,
                                   DeployType deployType,
                                   Language language)

Add a script to load on workers

Parameters:

conf - Configuration

script - Path to script

deployType - type of deployment

language - programming language

addScriptToLoad

public static void addScriptToLoad(org.apache.hadoop.conf.Configuration conf,
                                   DeployedScript script)

Add a script to load on workers

Parameters:

conf - Configuration

script - the script to load

getScriptsToLoad

public static List<DeployedScript> getScriptsToLoad(org.apache.hadoop.conf.Configuration conf)

Get the list of scripts to load on workers

Parameters:

conf - Configuration

Returns:

list of DeployedScripts

loadScripts

public static void loadScripts(org.apache.hadoop.conf.Configuration conf)
                        throws IOException

Load all the scripts deployed in Configuration

Parameters:

conf - Configuration

Throws:

IOException

loadScript

public static void loadScript(org.apache.hadoop.conf.Configuration conf,
                              DeployedScript deployedScript)
                       throws IOException

Load a single deployed script

Parameters:

conf - Configuration

deployedScript - the deployed script

Throws:

IOException

getLoadedScripts

public static List<DeployedScript> getLoadedScripts()

Get list of scripts already loaded.

Returns:

list of loaded scripts