The page you navigated to () does not exist, so we brought you to the closest page to it.
You have switched from the to the variant of this site. There is no equivalent of . We have taken you to the closest page in the variant.
flyte.extras
Flyte extras package. This package provides various utilities that make it possible to build highly customized workflows.
-
ContainerTask: Execute arbitrary pre-containerized applications, without needing the
flyte-sdkto be installed. This extra usesflyte copilotsystem to inject inputs and slurp outputs from the container run. -
DynamicBatcher / TokenBatcher: Maximize resource utilization by batching work from many concurrent producers through a single async processing function. DynamicBatcher is the general-purpose base; TokenBatcher is a convenience subclass for token-budgeted LLM inference with reusable containers.
-
Sleep: Route a task to the backend
core-sleepplugin, which executes in leaseworker with no task pod.
Directory
Classes
| Class | Description |
|---|---|
BatchStats |
Monitoring statistics exposed by `DynamicBatcher. |
ContainerTask |
This is an intermediate class that represents Flyte Tasks that run a container at execution time. |
DynamicBatcher |
Batches records from many concurrent producers and runs them through. |
Prompt |
Simple prompt record with built-in token estimation. |
Sleep |
Route a task to the backend core-sleep plugin. |
SleepTask |
|
TokenBatcher |
Token-aware batcher for LLM inference workloads. |
Protocols
| Protocol | Description |
|---|---|
CostEstimator |
Protocol for records that can estimate their own processing cost. |
TokenEstimator |
Protocol for records that can estimate their own token count. |