this sounds like an encoding issue. When you drop the CSV file on MyDataMerge, a popup will come up where you can select item delimiter and encoding.
Just try the different encodings until you got the correct one.
Common standard is UTF-8, you may ask your client for sending you the files in UTF-8 in future.
Official MyDataMerge Team