Just saw some post about Ansible. Also lightly tried other Infrastructure as Code like Terraform. Feel getting pretty large/complex yaml files when deploying decent size infrastructure.

How do people feel just using AWS SDK or other cloud SDK to write your own deployment tools? Since it is pure code, it is easy to refactor and test.

I did some prototype building DataPunch project (https://github.com/datapunchorg/punch) to deploy Data Infrastructure using AWS Go SDK. It provides one click command like “punch install SparkOnEKS” which will automatically deploy a ready-to-use Apache Spark environment on AWS.

Want to seek feedbacks and see whether other people have similar ideas?

Thanks, Bo