AWS SageMaker inference agent

AWS SageMaker inference agent#

The AWS SageMaker inference agent allows you to deploy models, and create and trigger inference endpoints. You can also fully remove the SageMaker deployment.


To use the AWS SageMaker inference agent, run the following command:

pip install flytekitplugins-awssagemaker

Example usage#

For a usage example, see AWS SageMaker inference agent example.

Local testing#

To test the SageMaker inference agent locally, create a class for the agent task that inherits from AsyncAgentExecutorMixin. This mixin can handle synchronous tasks and allows Flytekit to mimic FlytePropeller’s behavior in calling the agent.

Union cluster deployment#

After you have finished testing the agent locally, contact the Union team to enable it in your cluster.