• Back to Basque-BDT page
  • Token Distribution across Number

    The following histogram captures the token distribution per different part-of-speech (POS) tags.

    Legend on the top-right shows the different values the Number attribute takes.
    'NA' denotes those tokens which do not possess the Number attribute.

    Number

    Token examples for each POS:

     NOUN       PUNCT       VERB       AUX       PROPN       CCONJ       ADJ       ADV       NUM       DET       ADP       PART       PRON       X       INTJ       SYM      

    Number agreement rules:

    The following decision tree visualizes the rules used for classifying presence/absence of morphological agreement between two tokens that are connected by a dependency relation denoted by relation. head-pos and child-pos refer to the POS tag of the head and child token respectively.

    Each node of the tree represents a portion of the data. samples denotes the number of training data points in that node. value is the class distribution within that node. Each edge denotes the feature used for splitting.
    Leaf nodes contain the description of all of the features that appear in that leaf. * denotes that the feature can take any value.

    Tree for p=0.01

    Click on to show summary of agreement rules.

    1. PROPN tokens agree when the dependent token belongs to [PROPN] for the dependency relations: anything(None)

    2. PROPN tokens agree when the dependent token belongs to [NOUN] for the dependency relations: appositional modifier(appos)

    Number

    Examples for each leaf node:

     Leaf-0       Leaf-1       Leaf-2       Leaf-3      

    Click on to expand the tree.