Concept - Penn Treebank
- A tree bank is a parsed text corpus that annotates sentence structure such as POS and phrases (s.46).
- The Penn Tree Bank uses 36 POS categories and was built from the Wall Street Journal corpus (s.46). Almost all POS taggers are trained on the WSJ corpus available from the LDC (Linguistic Data Consortium) (s.46).
- Statistical parsers are built from tree banks of sentences parsed by hand (s.53).
Tag examples (s.47): CC coordinating conjunction; CD cardinal number; DT determiner; EX existential there; FW foreign word; IN preposition/subordinating conjunction; JJ adjective (JJR comparative, JJS superlative); LS list item marker; MD modal; NN noun singular/mass; NNS plural noun; POS possessive ending; UH interjection; VB base form; VBD past tense; VBG gerund/present participle; VBN past participle; VBP non-3rd person singular present; WDT wh-determiner. Also seen on s.48: PRP$ possessive pronoun, RB adverb, VBZ verb 3rd person singular present; s.56: NNP proper noun.