Custom tasks#

Flytekit ships with an extensible task system to make it easy for anyone to extend and add new task types.

Note

To contribute a new task type, see the prebuilt container task plugins and user container task plugins documentation.

Base task#

kwtypes

This is a small helper function to convert the keyword arguments to an OrderedDict of types.

PythonTask

Base Class for all Tasks with a Python native Interface.

Task

The base of all Tasks in flytekit.

TaskResolverMixin

Flytekit tasks interact with the Union platform very, very broadly in two steps.

IgnoreOutputs

This exception should be used to indicate that the outputs generated by this can be safely ignored.

Python function task#

PythonFunctionTask

A Python Function task should be used as the base for all extensions that have a python function.

PythonInstanceTask

This class should be used as the base class for all Tasks that do not have a user defined function body, but have a platform defined execute method.

Shell task#

SQLite3 task#

SQLite3Task

Run client side SQLite3 queries that optionally return a FlyteSchema object.

SQLite3Config

Use this configuration to configure if sqlite3 files that should be loaded by the task.