At least a company admin should be able to delete or unpublish content in the company app store to clean things up.