The page you navigated to () does not exist, so we brought you to the closest page to it.
You have switched from the to the variant of this site. There is no equivalent of . We have taken you to the closest page in the variant.
2.1.9
ShardConfig
Package: flyte.prefetch
Configuration for model sharding.
Parameters
class ShardConfig(
engine: typing.Literal['vllm'],
args: *args,
)Create a new model by parsing and validating input data from keyword arguments.
Raises
ValidationError if the input data cannot be
validated to form a valid model.
self is explicitly positional-only to allow self as a field name.
| Parameter | Type | Description |
|---|---|---|
engine |
typing.Literal['vllm'] |
The sharding engine to use (currently only “vllm” is supported). |
args |
*args |
Arguments for the sharding engine. |