It looks like currently the On Premise Probe can only be started manually and also runs in the foreground. I can probably write my own scripts for this, but It would be nice to have canonical supported versions.