remove the Unicode Byte-Order Mark (BOM)

[guest]

remove the Unicode Byte-Order Mark (BOM) from all your files... to find them on a linux box do the following:

find /path/to/editor -type f | while read line; do hd "$line" | grep -q 'ef bb bf' && echo "$line"; done > listOfBOMedFiles.txt

to remove them then:

cat listOfBOMedFiles.txt | while read line; do dd if=$line of=$line.noBOM ibs=3 skip=1; mv $line.noBOM $line; done

[ray]

Sorry, I don't know what you are on about. Could you give a more detailed explanation of the problem you have?

[ray]

rev [895]: Seeing that this affects only a minority of files, I committed this without proper explanatory statement from the reporter

[gogo]

Hmmm, your commit seems to have changed a lot of language files there Ray.

I'm not so sure this was a good idea. Provided a user is using UTF-8 (and you know, we pretty much require this) then the BOM (which isn't really a BOM in UTF-8, it's just a marker that says "this is utf-8" is invisible to them).

I'd say you should roll back this change in the interest of not fixing what's not broke.

[ray]

rev [901]: reverted changes from rev [895]

You are absolutely right. I shouldn't have done this in the first place.

I close this now invalid. The reporter can come and reopen, if he can give good reasons for the change