Inspired by the "NSA-proof your e-mail in 2 hours" article, I created a similarly complete setup for a personal (mail/web/...)server on a VPS as al3x did a couple of weeks ago using the scripts I had, and wrote an idiot-proof tutorial on how to set it up (https://github.com/pjan/the-ansibles/blob/master/docs/cloudbox.md). Manual steps are minimal, and "It just works" - start to finish should take you less than an hour.
If you haven't tried Ansible before, there's no more excuse not to now.
Enjoy.