Sounds like whatever is importing from CSV doesn't know how to import from CSV. As I said, quotations are perfectly valid. In fact they are at times necessary. For example, let's say you used the Name Format:
{LN}, {FN}
(which would be last name comma first name) and exported the "Name" column, you'll get things like:
"Cooper, Corey"
If you omit the quotes, anything attempting to read the CSV file would think that is two columns instead of just one column which it really is. What are you using to import into your database?