I just noticed this within the release notes of 9.24.4:
We fixed an issue that allowed for adding custom icons to native pages, as native pages do not support custom icons. (Ticket 186783)
So it seems that using custom icons via an icon collection doesn't work for Native apps. Hope this helps for anyone else who's running into this problem.