Not a member of Pastebin yet?
Sign Up,
it unlocks many cool features!
- cat commoncrawl.de-en.en europarl-v7.de-en.en news-commentary-v11.de-en.en > training.en
- cat training.de | ../../moses-scripts/scripts/tokenizer/normalize-punctuation.perl -l de | ../../moses-scripts/scripts/tokenizer/tokenizer.perl -threads 4 -a -l de > training.tok.de
- cat training.en | ../../moses-scripts/scripts/tokenizer/normalize-punctuation.perl -l en | ../../moses-scripts/scripts/tokenizer/tokenizer.perl -threads 4 -a -l en > training.tok.en
- ../../moses-scripts/scripts/recaser/train-truecaser.perl -corpus data/corpus.clean.tok.de -model data/truecase-model.de
- ../../moses-scripts/scripts/recaser/train-truecaser.perl -corpus data/corpus.clean.tok.en -model data/truecase-model.en
Add Comment
Please, Sign In to add comment