Skip to content

Main Navigation

Sidebar Navigation

Introduction

Union and Flyte

Platform architecture

Data plane setup

Data plane setup on AWS

Data plane setup on GCP

Single sign on setup

Microsoft Entra ID

Other identity providers

Configuring your data plane

Multi-cluster

Getting started

Installing development tools

Creating the project

Looking at the dependencies

Looking at the workflow code

Running in a local Python environment

Running in a local cluster

Setting up the project on Union

Deploying the project on Union

More resources

Building workflows

Workflows

Standard workflows

Subworkflows

Dynamic workflows

Eager workflows

Tasks

Task types

Task parameters

Task caching

Task software environment

ImageSpec

ImageSpec with ECR

ImageSpec with GAR

Environment variables

Secrets

Task hardware environment

Customizing task resources

Accelerators

Interruptible instances

Launch plans

Running launch plans

Reactive workflows

Artifacts

Declaring artifacts

Materializing artifacts

Consuming artifacts in workflows

Connecting workflows with artifact event triggers

Development cycle

Registering workflows

Task resource validation

Interactive tasks

Setting up CI/CD deployment

UnionRemote

Data input/output

FlyteFile

Accelerated datasets

Administration

User management

Applications

CLI Authentication

Integrations

Enabling AWS resources

Enabling AWS S3

Enabling AWS Secrets Manager

Enabling AWS ECR

Enabling GCP resources

Enabling Google Cloud Storage

Enabling Google Secret Manager

Enabling Google Artifact Registry

Enabling BigQuery

Agents

Apache Airflow

Apache Airflow agent example

AWS SageMaker

AWS SageMaker agent example

Databricks

Databricks agent example

File sensor

File sensor example

Google BigQuery

Google BigQuery agent example

MemVerge Memory Machine Cloud (MMC)

MemVerge Memory Machine Cloud (MMC) agent example

NVIDIA DGX

OpenAI ChatGPT

OpenAI ChatGPT agent example

Snowflake

Snowflake agent example

Web console

Execution list

Execution view

Logging

Task-level monitoring

Workflow list

Workflow view

Launching workflows and tasks

Task list

Task view

Launch plan list

Launch plan view

Artifact list

Artifact view

Usage

FAQ

On this page

Table of Contents for current page

Administration

This section covers the administration of Union.

Previous pageAccelerated datasets

Next pageUser management