As far as I know, AWS Sagemaker supports two approaches for the model inference: Provisioned and Serverless. This is specified in the endpoint configuration. My question is that when I train a model in AWS Canvas, I can only use the Provisioned approach, where I should specify the instance type that is supposed to host the model. I want to use serverless inference, but I do not see this option in AWS Canvas. I would appreciate your ideas on this.
1 Answer
The Canvas itself doesn't support server-less deployment, but you can export the notebook to train the model and use it for server-less deployment.
For more details, you can visit this AWS official document : https://docs.aws.amazon.com/sagemaker/latest/dg/canvas-notebook.html