I don't believe there's an option to remove the quotes from the default CSV export. The quotes are there to ensure that a comma in your data doesn't affect the formatting of the entire file. Most applications handle these quotes as delimiters just fine.
If you really need to export without the quotes, you can probably accomplish this with the Excel Exporter module. It handles CSV files, though I can't say for certain whether you can enable/disable the text delimiter.