{
  "generator": {
    "matra": "0.3.0",
    "udpipe_model": {
      "name": "english-ewt-ud-2.5-191206",
      "sha256": "784bd0fa85e3d831fd02a55290d0acfd05c953159dc38cc33d52e1b28add9957"
    }
  },
  "page": "explanation/concepts.md",
  "paragraphs": [
    {
      "compression_ratio": null,
      "kind": "paragraph",
      "lexical_density": 0.5882,
      "readability_grade": 6.4662,
      "sentences": 2,
      "text": "Analysis returns one nested value. Each level owns the level below it and carries its own data.",
      "words": 17
    },
    {
      "compression_ratio": 0.5492,
      "kind": "paragraph",
      "lexical_density": 0.4933,
      "readability_grade": 7.0637,
      "sentences": 4,
      "text": "Paragraph.text is the text the parser reads, a markdown paragraph's inline markup removed. Sentence.text is rebuilt from the tokens, so its spacing can differ from the source. Both are normalized, and each carries a span, in UTF-8 bytes, saying where in the analysed text it came from. Each paragraph that is not a quote is parsed on its own, so a sentence always belongs to exactly one paragraph, rather than being matched back by text.",
      "words": 77
    },
    {
      "compression_ratio": null,
      "kind": "paragraph",
      "lexical_density": 0.5641,
      "readability_grade": 6.4236,
      "sentences": 3,
      "text": "Inside a sentence, exactly one token has head equal to 0: the root. Every other token names its governor in head and the relation in dep. Those two columns are what turn a flat token list into a tree.",
      "words": 40
    },
    {
      "compression_ratio": null,
      "kind": "paragraph",
      "lexical_density": 0.5294,
      "readability_grade": 5.2694,
      "sentences": 2,
      "text": "Words keep their reading order left to right; height is depth in the tree. built is the root, everything else hangs off it directly or through one more hop, so its tree_depth is 2.",
      "words": 34
    },
    {
      "compression_ratio": 0.5795,
      "kind": "paragraph",
      "lexical_density": 0.6,
      "readability_grade": 9.1233,
      "sentences": 3,
      "text": "The same two columns, read from matra's output for five short sentences. The table is what a Sentence holds; the arcs below it draw each head and dep. The first sentence carries a negation, the second a modal, the third a clausal complement, the fourth a root adverbial, and the fifth two Hearst pairs: the structural primitives described further down.",
      "words": 61
    },
    {
      "compression_ratio": null,
      "kind": "paragraph",
      "lexical_density": 0.4,
      "readability_grade": 8.3533,
      "sentences": 1,
      "text": "The pipeline produces them in this order, and each is a different kind of result.",
      "words": 15
    },
    {
      "compression_ratio": null,
      "kind": "list_item",
      "lexical_density": 0.7083,
      "readability_grade": 9.655,
      "sentences": 3,
      "text": "Structure, read and parsed by Engine::analyze. Sections, paragraphs, sentences, tokens, and the structural primitive fields. Derived from the parse, checkable against the source bytes.",
      "words": 25
    },
    {
      "compression_ratio": null,
      "kind": "list_item",
      "lexical_density": 0.7027,
      "readability_grade": 9.9497,
      "sentences": 3,
      "text": "Measures, filled by Engine::analyze as its last step. Six Option<f64> slots filled by the metric suite: three per paragraph, two per document, plus the materialized passive_ratio. None means not computed, which is distinct from a computed zero.",
      "words": 40
    },
    {
      "compression_ratio": null,
      "kind": "list_item",
      "lexical_density": 0.5385,
      "readability_grade": 11.9842,
      "sentences": 2,
      "text": "Outcomes, from free functions over the Document: summarize and keyphrases, with _with forms that name the method. They return Summary and Keyphrases values, each carrying the document's provenance with the method and its parameters, never fields on the tree.",
      "words": 40
    },
    {
      "compression_ratio": null,
      "kind": "list_item",
      "lexical_density": 0.6047,
      "readability_grade": 10.5814,
      "sentences": 3,
      "text": "Semantic, with the reference embedder behind the model2vec feature. clusters returns a Clusters value whose provenance carries the embedder's identity and the threshold you supplied. This tier depends on the model, so by design it never becomes a field on Document or Sentence.",
      "words": 44
    },
    {
      "compression_ratio": 0.519,
      "kind": "paragraph",
      "lexical_density": 0.5507,
      "readability_grade": 9.6071,
      "sentences": 4,
      "text": "A structural primitive is a construction read off the dependency graph and reported as a field. Six of them are computed once and travel with the sentence into every language binding: five at Sentence construction, and hearst_pairs as the engine parses each paragraph, because its detector lives outside the domain (a Sentence built by hand has an empty hearst_pairs). They name an arc shape. They never name a judgment.",
      "words": 69
    },
    {
      "compression_ratio": null,
      "kind": "paragraph",
      "lexical_density": 0.75,
      "readability_grade": null,
      "sentences": 1,
      "text": "Two consequences of reporting arcs rather than readings:",
      "words": 8
    },
    {
      "compression_ratio": 0.6198,
      "kind": "paragraph",
      "lexical_density": 0.6111,
      "readability_grade": 6.5405,
      "sentences": 5,
      "text": "root_mood consults neither negation nor modals. The detector reads the root and its finiteness carriers. Nothing else. The sky is not blue reports Ind and also carries a negation; an indicative root that no modal governs is Ind with no modal whose head_id is the root's id. Combining the facts is your code's job.",
      "words": 56
    },
    {
      "compression_ratio": null,
      "kind": "paragraph",
      "lexical_density": 0.4848,
      "readability_grade": 8.3667,
      "sentences": 3,
      "text": "Overlap is intentional. never in the example above is both a Negation and a RootAdverbial, because it satisfies both arc shapes. Neither field is assigning it a meaning, so neither has to win.",
      "words": 33
    },
    {
      "compression_ratio": null,
      "kind": "paragraph",
      "lexical_density": 0.5714,
      "readability_grade": 18.6257,
      "sentences": 2,
      "text": "Passive voice is the seventh construction, a flag rather than a list of arcs: Sentence::passive is true when a token carries nsubj:pass, nsubjpass, or aux:pass, and its document-level share is the passive_ratio field of DocumentMetrics.",
      "words": 39
    },
    {
      "compression_ratio": null,
      "kind": "paragraph",
      "lexical_density": 0.64,
      "readability_grade": 13.829,
      "sentences": 2,
      "text": "Reporting verbs and root adverbials are open word classes, so matra ships no lexicon for either. Sentence::clausal_complements_in and Sentence::root_adverbials_in filter by a list you supply.",
      "words": 26
    },
    {
      "compression_ratio": null,
      "kind": "paragraph",
      "lexical_density": 0.5625,
      "readability_grade": 8.18,
      "sentences": 2,
      "text": "Situation model covers what this output is for. Programming model covers the surface that produces it.",
      "words": 16
    }
  ]
}
