2.0.0b53
flyteplugins.vllm
Directory
Classes
| Class | Description |
|---|---|
VLLMAppEnvironment |
App environment backed by vLLM for serving large language models. |
Variables
| Property | Type | Description |
|---|---|---|
DEFAULT_VLLM_IMAGE |
Image |
|
Version: