In the interests of proper devops, I want a testing site that can come up and test (eventually completely) the auto deployment of my site.
All the way from my deployment server to full operations.
Once all the bits and pieces are installed, configured, and up, then execute a test set of jobs to make sure its configured properly. So non trivial jobs, depending what a site is configured for, starting with trivial hostname style up to proper mpi type tests.
I have 2 options for testing a site as far as I can tell.
1. configure and then textually verify my config files. not ideal.
2. bring up entire parallel site and submit jobs and check they complete properly.
I want the option 2, to know that my site is good. It would be a small site, the compute nodes of no consequence its the other stuff one is really testing. The configs of bdii, ce, batch, 1...n worker nodes, vobox, se (nominal transient storage).
The technical details of docker/vm/real i dont think are relevant. Certificates and dns would be required for this site.
I would suspect this would appear no different from the current concept of a wlcg tier3 ?
One would then bring it up nightly or by nightly to verify the contents of your version controlled site.
Testing on vc update i think is not practical/possible.
This would then mean I am testing everything except the host certificates for the real site and the hostnames for the real site.
An alternate idea would be to keep the test site running, and only reinstall it when testing of the version control requires it.
Thoughts, comments, welcome.