From 4cf4fad16a902c355890500d0825a6ccf50fa670 Mon Sep 17 00:00:00 2001 From: David Harrison Date: Thu, 25 Apr 2019 13:11:26 -0700 Subject: [PATCH] Update Moses Python Port Link Change documentation based on https://github.com/pytorch/text/pull/361. --- README.rst | 5 ++--- 1 file changed, 2 insertions(+), 3 deletions(-) diff --git a/README.rst b/README.rst index 5689709d72..b6a3b7cf7f 100644 --- a/README.rst +++ b/README.rst @@ -33,10 +33,9 @@ If you want to use English tokenizer from `SpaCy `_, you need pip install spacy python -m spacy download en -Alternatively, you might want to use Moses tokenizer from `NLTK `_. You have to install NLTK and download the data needed:: +Alternatively, you might want to use the `Moses `_ tokenizer port in `SacreMoses `_ (split from `NLTK `_). You have to install SacreMoses:: - pip install nltk - python -m nltk.downloader perluniprops nonbreaking_prefixes + pip install sacremoses Documentation =============