DownloadCodeBundleWorkerPlugin

Package: flyteplugins.dask.task

A Dask plugin to download and set up the code bundle on each worker.

class DownloadCodeBundleWorkerPlugin(
    code_bundle: flyte.models.CodeBundle,
)

Methods

setup()

def setup(
    worker,
)

Runs on each worker as it is initialized.

teardown()

def teardown(
    worker: Worker,
) -> None | Awaitable[None]

Run when the worker to which the plugin is attached is closed, or when the plugin is removed.

transition()

def transition(
    key: Key,
    start: WorkerTaskStateState,
    finish: WorkerTaskStateState,
    kwargs: **kwargs,
)

Throughout the lifecycle of a task (see :doc:Worker State <worker-state>), Workers are instructed by the scheduler to compute certain tasks, resulting in transitions in the state of each task. The Worker owning the task is then notified of this state transition.

Whenever a task changes its state, this method will be called.

.. warning::

This is an advanced feature and the transition mechanism and details
of task states are subject to change without deprecation cycle.

Parameters

key : start : Start state of the transition. One of waiting, ready, executing, long-running, memory, error. finish : Final state of the transition. kwargs : More options passed when transitioning