2.0.0b53
flyteplugins.spark.task
Directory
Classes
| Class | Description |
|---|---|
PysparkFunctionTask |
Actual Plugin that transforms the local python code for execution within a spark context. |
Spark |
Use this to configure a SparkContext for a your task. |
Variables
| Property | Type | Description |
|---|---|---|
DEFAULT_SPARK_CONTEXT_NAME |
str |