Automate data preprocessing on AWS sagemaker

Question

Is there a way to Automate the data preprocessing on Sagemaker on weekly basis the preprocessing can include many simple transformations over the data in MBs from S3.

My Idea of Automation is like Triggering a script or a notebook instance that could run weekly

Alohahaha · Accepted Answer · 2018-12-21 18:59:30Z

2

Have you considered using Lambda + CloudWatch Event/Rule? You can write a lambda function which creates a SageMaker job and create a CloudWatch Event rule to trigger it once a week. Therefore, you don't need to have a notebook instance running 24 hours every day.

Here is an example - https://docs.aws.amazon.com/AmazonCloudWatch/latest/events/RunLambdaSchedule.html

Hope this helps!

edited Dec 21, 2018 at 18:59

answered Dec 19, 2018 at 2:09

Alohahaha

1062 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Automate data preprocessing on AWS sagemaker

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related