On container removal, remove startup files from the cluster