doc: clarify automatic encoding detection

Fixes #1103
This commit is contained in:
Andrew Gallant
2019-01-26 13:55:17 -05:00
parent afb89bcdad
commit 6d5dba85bd
3 changed files with 11 additions and 3 deletions

View File

@@ -609,7 +609,8 @@ topic, but we can try to summarize its relevancy to ripgrep:
the most popular encodings likely consist of ASCII, latin1 or UTF-8. As
a special exception, UTF-16 is prevalent in Windows environments
In light of the above, here is how ripgrep behaves:
In light of the above, here is how ripgrep behaves when `--encoding auto` is
given, which is the default:
* All input is assumed to be ASCII compatible (which means every byte that
corresponds to an ASCII codepoint actually is an ASCII codepoint). This