Does the CSV output look correct if you load it into a text editor like VS Code?
If it does, then I think the problem is with your spreadsheet software not understanding the UTF-8 output from Mendix.
If this is Excel, the issue could be that it expects a BOM in the file. There is a workaround documented here.
I hope this helps.