Hi Jelle,
Currently this is not possible out-of-the-box with ATS, although it is definitely on our backlog to implement at some point.
However, there are some options to get notifications about test case/suite results. The option that we currently use in one of our projects, is that we configured a scheduled nightly build/deployment of our app through Jenkins. This kicks off a selected test suite (regardless of whether or not there was a new deployment) and sends an email with the result of that test suite afterwards.
This all works via the ATS CI/CD API. Find more info here: https://docs.mendix.com/ats/refguide/rg-version-2/cicd-api
If you want to know more about the specific solution that we created, or any other questions regarding this, just let me know.
With kind regards,
Joris van der Heijden
ATS consultant at Mansystems