com.qubole.qds.sdk.java.details

Class SparkCommandBuilderImpl

java.lang.Object

com.qubole.qds.sdk.java.details.InvocationCallbackBase<CommandResponse>

com.qubole.qds.sdk.java.details.SparkCommandBuilderImpl

All Implemented Interfaces:

InvokableBuilder<CommandResponse>, SparkCommandBuilder

public class SparkCommandBuilderImpl
extends InvocationCallbackBase<CommandResponse>
implements SparkCommandBuilder

Method Summary

Modifier and Type	Method and Description
SparkCommandBuilder	arguments(String arguments) Specify the spark specific command line options which are passed on to spark-submit.
BaseCommand	build()
SparkCommandBuilder	clusterLabel(String clusterLabel) Specify cluster label corresponding to the cluster to be used to run this command.
SparkCommandBuilder	cmdLine(String cmdLine) For power users, this function provides ability to provide the spark-submit command line directly.
protected BaseCommand.COMMAND_TYPE	getCommandType()
protected com.fasterxml.jackson.databind.node.ObjectNode	getEntity()
protected InvokeArguments<CommandResponse>	getInvokeArguments()
SparkCommandBuilder	language(String language) Specify the language of the program, Scala, SQL, Command, R, or Python.
SparkCommandBuilder	name(String commandName) Specify a name to the command.
SparkCommandBuilder	program(String program) Set the Scala, Python, SQL or R code snippet for the SparkCommand.
SparkCommandBuilder	sql(String sql) Specify SQL query to be executed by command.
SparkCommandBuilder	tags(String[] queryTags) Specify a list of tags for the command so that it is easily identifiable and searchable from the commands list in the Commands History.
SparkCommandBuilder	userProgramArguments(String userProgramArguments) Specify the arguments that the user program takes in.

Methods inherited from class com.qubole.qds.sdk.java.details.InvocationCallbackBase

getArgumentsInvocation, invoke, raw, withCallback

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface com.qubole.qds.sdk.java.api.InvokableBuilder

getArgumentsInvocation, invoke, raw, withCallback

Method Detail

program

public SparkCommandBuilder program(String program)

Description copied from interface: SparkCommandBuilder

Set the Scala, Python, SQL or R code snippet for the SparkCommand. If you have a complete spark-submit command line please use SparkCommandBuilder.sql(String) method.

Specified by:

program in interface SparkCommandBuilder

cmdLine

public SparkCommandBuilder cmdLine(String cmdLine)

Description copied from interface: SparkCommandBuilder

For power users, this function provides ability to provide the spark-submit command line directly. Spark-submit command line is explained in detail here. Please refer this for an example.

Specified by:

cmdLine in interface SparkCommandBuilder

language

public SparkCommandBuilder language(String language)

Description copied from interface: SparkCommandBuilder

Specify the language of the program, Scala, SQL, Command, R, or Python. Required only when a SparkCommandBuilder.program(String) is used.

Specified by:

language in interface SparkCommandBuilder

sql

public SparkCommandBuilder sql(String sql)

Description copied from interface: SparkCommandBuilder

Specify SQL query to be executed by command. Please refer this for an example.

Specified by:

sql in interface SparkCommandBuilder

userProgramArguments

public SparkCommandBuilder userProgramArguments(String userProgramArguments)

Description copied from interface: SparkCommandBuilder

Specify the arguments that the user program takes in. Please refer this for an example.

Specified by:

userProgramArguments in interface SparkCommandBuilder

arguments

public SparkCommandBuilder arguments(String arguments)

Description copied from interface: SparkCommandBuilder

Specify the spark specific command line options which are passed on to spark-submit.

Specified by:

arguments in interface SparkCommandBuilder

clusterLabel

public SparkCommandBuilder clusterLabel(String clusterLabel)

Description copied from interface: SparkCommandBuilder

Specify cluster label corresponding to the cluster to be used to run this command.

Specified by:

clusterLabel in interface SparkCommandBuilder

name

public SparkCommandBuilder name(String commandName)

Description copied from interface: SparkCommandBuilder

Specify a name to the command. It can be useful in filtering command from command history.

Specified by:

name in interface SparkCommandBuilder

tags

public SparkCommandBuilder tags(String[] queryTags)

Description copied from interface: SparkCommandBuilder

Specify a list of tags for the command so that it is easily identifiable and searchable from the commands list in the Commands History.

Specified by:

tags in interface SparkCommandBuilder

getEntity

protected com.fasterxml.jackson.databind.node.ObjectNode getEntity()

getCommandType

protected BaseCommand.COMMAND_TYPE getCommandType()

getInvokeArguments

protected InvokeArguments<CommandResponse> getInvokeArguments()

Specified by:

getInvokeArguments in class InvocationCallbackBase<CommandResponse>

build

public BaseCommand build()