what design considerations should I be cognizant of?
- is a simple ping enough?
- should I implement a crawler and test http status codes?
- is it necessary to go further and use something like phantomjs?
Also, some sites and services do this and I would love to lean on external (free) sources and parse rss/atom feeds but this will be very granular
Any data sources or design tips would be helpful