Type VS Token| Corpora| Keywords in Corpus Linguistics| Concordance Urdu/Hindi | pdf Notes скачать в хорошем качестве

Type VS Token| Corpora| Keywords in Corpus Linguistics| Concordance Urdu/Hindi | pdf Notes

Tokens: the number of individual words in the text. In our case, it is 4,107 tokens. Types: the number of types in a word frequency list is the number of unique word forms, rather than the total number of words in a text. Our text has 1,206 types. Type/Token Ratio (TTR): the number of types divided by the number of tokens. This tells you how rich or "lexically varied" the vocabulary in the text is. In our example, the Type-Token ratio is: 1206 (types) ÷ 4107 (tokens) x 100 = 29.36 % Standard Type/Token ratio: It is difficult to compare the TTR of smaller against larger texts, because as the text gets bigger, so the number of new word types being counted falls. In order to remedy this, WordSmith can calculate TTR based on every 1000 words and produce an average TTR. This figure (rather than simple TTR) would be the one to use in such cases.