Hi,
you can use ML kit and integrate the LLM chat bot in mendix.
Please refer mendix document https://docs.mendix.com/refguide/machine-learning-kit/using-ml-kit/
https://www.mendix.com/blog/introducing-the-mendix-ml-kit-for-low-code-deployment/