text2token.py

source

convert raw text to tokenized text

usage: text2token.py [-h] [--nchar NCHAR] [--skip-ncols SKIP_NCOLS]
                     [--space SPACE] [--non-lang-syms NON_LANG_SYMS]
                     [--trans_type {char,phn}]
                     [text]

Positional Arguments

Named Arguments