Flyte + Union 2.0: Now accepting interest in our invite-only beta
Register now ↗
Union.ai Docs
|
Version:
Signup
User guide
Tutorials
Reference
Integrations
Platform deployment
Community
Release notes
Union.ai Docs
Signup
Documentation navigation for Byoc including user guides, tutorials, API references, and integration examples
  • Flyte CLI
  • LLM context document
  • Flyte SDK
    • Classes & Protocols
      • Packages
        • flyte
          • Cache
          • CachePolicy
          • Cron
          • Device
          • Environment
          • FixedRate
          • Image
          • ImageBuild
          • Link
          • PodTemplate
          • Resources
          • RetryStrategy
          • ReusePolicy
          • Secret
          • TaskEnvironment
          • Timeout
          • Trigger
        • flyte.app
          • AppEndpoint
          • AppEnvironment
          • ConnectorEnvironment
          • Domain
          • Link
          • Parameter
          • Port
          • RunOutput
          • Scaling
        • flyte.app.extras
          • FastAPIAppEnvironment
          • FastAPIPassthroughAuthMiddleware
        • flyte.config
          • Config
        • flyte.connectors
          • AsyncConnector
          • AsyncConnectorExecutorMixin
          • ConnectorRegistry
          • ConnectorService
          • Resource
          • ResourceMeta
        • flyte.connectors.utils
          • flyte.errors
            • ActionAbortedError
            • ActionNotFoundError
            • BaseRuntimeError
            • CodeBundleError
            • CustomError
            • DeploymentError
            • ImageBuildError
            • ImagePullBackOffError
            • InitializationError
            • InlineIOMaxBytesBreached
            • InvalidImageNameError
            • LogsNotYetAvailableError
            • ModuleLoadError
            • NotInTaskContextError
            • OnlyAsyncIOSupportedError
            • OOMError
            • ParameterMaterializationError
            • PrimaryContainerNotFoundError
            • RemoteTaskNotFoundError
            • RemoteTaskUsageError
            • RestrictedTypeError
            • RetriesExhaustedError
            • RuntimeDataValidationError
            • RuntimeSystemError
            • RuntimeUnknownError
            • RuntimeUserError
            • SlowDownError
            • TaskInterruptedError
            • TaskTimeoutError
            • UnionRpcError
          • flyte.extend
            • AsyncFunctionTaskTemplate
            • ImageBuildEngine
            • ImageBuilder
            • ImageChecker
            • TaskTemplate
          • flyte.extras
            • ContainerTask
          • flyte.git
            • GitStatus
          • flyte.io
            • DataFrame
            • Dir
            • File
          • flyte.io.extend
            • DataFrameDecoder
            • DataFrameEncoder
            • DataFrameTransformerEngine
          • flyte.models
            • ActionID
            • ActionPhase
            • Checkpoints
            • CodeBundle
            • GroupData
            • NativeInterface
            • PathRewrite
            • RawDataPath
            • SerializationContext
            • TaskContext
          • flyte.prefetch
            • HuggingFaceModelInfo
            • ShardConfig
            • StoredModelInfo
            • VLLMShardArgs
          • flyte.remote
            • Action
            • ActionDetails
            • ActionInputs
            • ActionOutputs
            • App
            • Project
            • Run
            • RunDetails
            • Secret
            • Task
            • TaskDetails
            • Trigger
            • User
          • flyte.report
            • Report
          • flyte.storage
            • ABFS
            • GCS
            • S3
            • Storage
          • flyte.syncify
            • Syncify
          • flyte.types
            • FlytePickle
            • Renderable
            • TypeEngine
            • TypeTransformer
            • TypeTransformerFailedError
      • Uctl CLI
        • uctl
        • uctl version
        • uctl append
          • uctl append identityassignments
        • uctl apply
          • uctl apply app
          • uctl apply clusterconfig
          • uctl apply clusterconfigid
          • uctl apply clusterpoolconfig
        • uctl config
          • uctl config discover
          • uctl config docs
          • uctl config init
          • uctl config validate
        • uctl create
          • uctl create app
          • uctl create clusterpool
          • uctl create clusterpoolassignment
          • uctl create execution
          • uctl create policy
          • uctl create project
          • uctl create role
        • uctl delete
          • uctl delete app
          • uctl delete cluster
          • uctl delete cluster-pool-attributes
          • uctl delete cluster-resource-attribute
          • uctl delete clusterconfig
          • uctl delete clusterpool
          • uctl delete clusterpoolassignment
          • uctl delete execution
          • uctl delete execution-cluster-label
          • uctl delete execution-queue-attribute
          • uctl delete identityassignments
          • uctl delete plugin-override
          • uctl delete policy
          • uctl delete role
          • uctl delete task-resource-attribute
          • uctl delete workflow-execution-config
        • uctl demo
          • uctl demo exec
          • uctl demo reload
          • uctl demo start
          • uctl demo status
          • uctl demo teardown
        • uctl get
          • uctl get app
          • uctl get cluster
          • uctl get cluster-pool-attributes
          • uctl get cluster-resource-attribute
          • uctl get clusterconfig
          • uctl get clusterconfigs
          • uctl get clusterpool
          • uctl get clusterpoolconfig
          • uctl get clusterswithconfig
          • uctl get echo
          • uctl get execution
          • uctl get execution-cluster-label
          • uctl get execution-queue-attribute
          • uctl get executionoperation
          • uctl get identityassignment
          • uctl get launchplan
          • uctl get plugin-override
          • uctl get policy
          • uctl get project
          • uctl get role
          • uctl get task
          • uctl get task-resource-attribute
          • uctl get workflow
          • uctl get workflow-execution-config
        • uctl register
          • uctl register examples
          • uctl register files
        • uctl update
          • uctl update cluster-pool-attributes
          • uctl update cluster-resource-attribute
          • uctl update execution
          • uctl update execution-cluster-label
          • uctl update execution-queue-attribute
          • uctl update launchplan
          • uctl update launchplan-meta
          • uctl update plugin-override
          • uctl update project
          • uctl update task-meta
          • uctl update task-resource-attribute
          • uctl update workflow-execution-config
          • uctl update workflow-meta
      • Integrations
        • Connectors
          • Classes
            • Packages
              • flyteplugins.connectors.bigquery
                • BigQueryConfig
                • BigQueryConnector
                • BigQueryTask
              • flyteplugins.connectors.bigquery.connector
                • BigQueryConnector
                • BigQueryMetadata
              • flyteplugins.connectors.bigquery.task
                • BigQueryConfig
                • BigQueryTask
              • flyteplugins.connectors.databricks
                • Databricks
                • DatabricksConnector
              • flyteplugins.connectors.databricks.connector
                • DatabricksConnector
                • DatabricksJobMetadata
              • flyteplugins.connectors.databricks.task
                • Databricks
                • DatabricksFunctionTask
              • flyteplugins.connectors.snowflake
                • Snowflake
                • SnowflakeConfig
                • SnowflakeConnector
              • flyteplugins.connectors.snowflake.connector
                • SnowflakeConnector
                • SnowflakeJobMetadata
              • flyteplugins.connectors.snowflake.task
                • Snowflake
                • SnowflakeConfig
          • Dask
            • Classes
              • Packages
                • flyteplugins.dask
                  • Dask
                  • Scheduler
                  • WorkerGroup
                • flyteplugins.dask.task
                  • Dask
                  • DaskTask
                  • DownloadCodeBundleSchedulerPlugin
                  • DownloadCodeBundleWorkerPlugin
                  • Scheduler
                  • WorkerGroup
            • OpenAI
              • flyteplugins.openai.agents
              • Polars
                • Classes
                  • Packages
                    • flyteplugins.polars.df_transformer
                      • ParquetToPolarsDecodingHandler
                      • ParquetToPolarsLazyFrameDecodingHandler
                      • PolarsLazyFrameToParquetEncodingHandler
                      • PolarsToParquetEncodingHandler
                • PyTorch
                  • Classes
                    • Packages
                      • flyteplugins.pytorch
                        • Elastic
                      • flyteplugins.pytorch.task
                        • Elastic
                        • RunPolicy
                        • TorchFunctionTask
                  • Ray
                    • Classes
                      • Packages
                        • flyteplugins.ray
                          • HeadNodeConfig
                          • RayJobConfig
                          • WorkerNodeConfig
                        • flyteplugins.ray.task
                          • HeadNodeConfig
                          • RayFunctionTask
                          • RayJobConfig
                          • WorkerNodeConfig
                    • SGLang
                      • Classes
                        • Packages
                          • flyteplugins.sglang
                            • SGLangAppEnvironment
                      • Spark
                        • Classes
                          • Packages
                            • flyteplugins.spark
                              • ParquetToSparkDecoder
                              • Spark
                              • SparkToParquetEncoder
                            • flyteplugins.spark.df_transformer
                              • ParquetToSparkDecoder
                              • SparkToParquetEncoder
                            • flyteplugins.spark.task
                              • PysparkFunctionTask
                              • Spark
                        • Union
                          • Classes
                            • Packages
                              • flyteplugins.union.internal.validate.validate.validate_pb2
                                • flyteplugins.union.internal.validate.validate.validate_pb2_grpc
                                  • flyteplugins.union.remote
                                    • ApiKey
                                  • flyteplugins.union.utils.auth
                                    • AppClientCredentials
                              • vLLM
                                • Classes
                                  • Packages
                                    • flyteplugins.vllm
                                      • VLLMAppEnvironment
                                • Weights & Biases
                                  • Classes
                                    • Packages
                                      • flyteplugins.wandb
                                        • Wandb
                                        • WandbSweep
                                The page you navigated to does not exist, so we brought you to the closest page to it.
                                Union.ai BYOC
                                Reference
                                Integrations
                                Spark
                                Packages
                                2.0.0b53

                                Packages

                                Package Description
                                flyteplugins.spark
                                flyteplugins.spark.df_transformer
                                flyteplugins.spark.task
                                On this page