org.apache.spark.launcher

Class InProcessLauncher

Object

org.apache.spark.launcher.AbstractLauncher<InProcessLauncher>

org.apache.spark.launcher.InProcessLauncher

public class InProcessLauncher
extends AbstractLauncher<InProcessLauncher>

In-process launcher for Spark applications.

Use this class to start Spark applications programmatically. Applications launched using this class will run in the same process as the caller.

Because Spark only supports a single active instance of SparkContext per JVM, code that uses this class should be careful about which applications are launched. It's recommended that this launcher only be used to launch applications in cluster mode.

Also note that, when running applications in client mode, JVM-related configurations (like driver memory or configs which modify the driver's class path) do not take effect. Logging configuration is also inherited from the parent application.

Since:

Spark 2.3.0

Constructor Summary

Constructors

Constructor and Description
InProcessLauncher()

Method Summary

Modifier and Type	Method and Description
SparkAppHandle	startApplication(SparkAppHandle.Listener... listeners) Starts a Spark application.

Methods inherited from class org.apache.spark.launcher.AbstractLauncher

addAppArgs, addFile, addJar, addPyFile, addSparkArg, addSparkArg, setAppName, setAppResource, setConf, setDeployMode, setMainClass, setMaster, setPropertiesFile, setVerbose

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

InProcessLauncher

public InProcessLauncher()

Method Detail

startApplication

public SparkAppHandle startApplication(SparkAppHandle.Listener... listeners)
                                throws java.io.IOException

Starts a Spark application.

Specified by:

startApplication in class AbstractLauncher<InProcessLauncher>

Parameters:

listeners - Listeners to add to the handle before the app is launched.

Returns:

A handle for the launched application.

Throws:

java.io.IOException

See Also:

AbstractLauncher.startApplication(SparkAppHandle.Listener...)