Probers for my hosting

I have a VM from Hetzner for my wife’s website and my own. I run several probers hourly from cron on the VM and on a machine in my house (so they aren’t singly homed) to ensure that the VM, DNS, Apache, and websites are working properly:

  • The simple link checker I wrote checks my wife’s website, the development version of my wife’s website, and my website. Checking the development version of my wife’s website gives me an early notification when I’ve broken something during development rather than finding out after deploying to production.
  • I run a separate prober to check external links on my wife’s website and my website. This prober is only run on my hosting because 1) it’s not easily available for MacOS X and 2) the checks aren’t essential.

    The reason to run this in addition to the previous checker is that this tool supports checking external links without recursing through the external sites, which the previous tool doesn’t. The reason to run the previous tool is that it reports any HTTP result that isn’t 200 OK, making it easy to find unnecessary redirects (301, 302) that I can change to remove the redirect.

  • Check that a magic string is present in the response from https://www.arianetobin.ie/ to detect failures: probe-arianetobin.ie.

  • Check that A, AAAA, and MX records are correct for every domain: check-dns-for-hosting.

  • Check that HTTP requests are redirected to HTTPS, that requests for DOMAIN are redirected to www.DOMAIN, and that requests for dormant domains are redirected to the correct domain: check-redirects-for-hosting.