I found some papers (not specifically Mendix) in academic journals while researching this as part of a postgrad course. It’s an area that doesn’t have many peer reviewed papers if that is what you need. Most of these are in journals that are behind paywalls and can’t be shared publicly.

If you are looking for Mendix best practice, then there are some excellent blog posts that may be of use.
https://www.mendix.com/blog/

This post by Ryan has a lot of very useful tips to remember when building a Mendix application,
https://medium.com/mendix/how-to-develop-with-best-practices-mendix-how-to-1040f341672

Hope this is of some help.