Skip to main content
Back to top
Ctrl
+
K
Union and Flyte
Platform architecture
Data plane setup
Data plane setup on AWS
Data plane setup on GCP
Single sign on setup
Microsoft Entra ID (formerly Azure AD)
Other identity providers
Configuring your data plane
Multi-cluster and multi-cloud
Getting started
Installing development tools
Creating the project
Looking at the dependencies
Looking at the workflow code
Running in a local Python environment
Running in a local cluster
Setting up the project on Union
Deploying the project on Union
Learning more about Union and Flyte
Building workflows
Workflows
Standard workflows
Subworkflows
Dynamic workflows
Eager workflows
Tasks
Task types
Task parameters
Task caching
Task software environment
ImageSpec
ImageSpec with ECR
ImageSpec with GAR
Environment variables
Secrets
Task hardware environment
Customizing task resources
Accelerators
Interruptible instances
Launch Plans
Running launch plans
Reactive workflows
Artifacts
Declaring artifacts
Materializing artifacts
Consuming artifacts
Connecting workflows with artifact event triggers
Development cycle
Registering workflows
Task resource validation
Interactive tasks
Setting up CI/CD deployment
UnionRemote
Data input/output
FlyteFile
Accelerated datasets
Administration
User management
Applications
CLI Authentication
Integrations
Enabling AWS resources
Enabling AWS S3
Enabling AWS Secrets Manager
Enabling AWS ECR
Enabling GCP resources
Enabling Google Cloud Storage
Enabling Google Secret Manager
Enabling Google Artifact Registry
Enabling BigQuery
Agents
Apache Airflow agent
Apache Airflow agent example
AWS SageMaker inference agent
AWS SageMaker agent example
Databricks agent
Databricks agent example
File sensor agent
File sensor agent example
Google BigQuery agent
Google BigQuery agent example
MemVerge Memory Machine Cloud (MMC) agent
MemVerge Memory Machine Cloud (MMC) agent example
NVIDIA DGX agent
OpenAI ChatGPT agent
OpenAI ChatGPT agent example
Snowflake agent
Snowflake agent example
Web console
Execution list
Execution view
Logging
Task-level monitoring
Workflow list
Workflow view
Launching workflows and tasks
Task list
Task view
Launch plan list
Launch plan view
Artifacts list
Artifact view
Usage
FAQ
.md
.pdf
Data input/output
Data input/output
#
This section covers how to manage data input and output in Union.
