{
  "generator": {
    "matra": "0.3.0",
    "udpipe_model": {
      "name": "english-ewt-ud-2.5-191206",
      "sha256": "784bd0fa85e3d831fd02a55290d0acfd05c953159dc38cc33d52e1b28add9957"
    }
  },
  "page": "capabilities.md",
  "paragraphs": [
    {
      "compression_ratio": null,
      "kind": "paragraph",
      "lexical_density": 0.6522,
      "readability_grade": 6.8515,
      "sentences": 2,
      "text": "Every value the pipeline returns, by tier. The tables say which language surfaces carry each value: fields cross to Python, methods do not.",
      "words": 23
    },
    {
      "compression_ratio": null,
      "kind": "paragraph",
      "lexical_density": 0.5,
      "readability_grade": 10.73,
      "sentences": 1,
      "text": "Produced by Engine::analyze, as the document is read and parsed.",
      "words": 11
    },
    {
      "compression_ratio": null,
      "kind": "paragraph",
      "lexical_density": 0.75,
      "readability_grade": 3.4667,
      "sentences": 2,
      "text": "The ten CoNLL-U columns plus one derived flag. All cross to Python.",
      "words": 13
    },
    {
      "compression_ratio": null,
      "kind": "paragraph",
      "lexical_density": 0.8571,
      "readability_grade": null,
      "sentences": 2,
      "text": "Token::feat(key) reads one morphological feature. Rust only.",
      "words": 9
    },
    {
      "compression_ratio": null,
      "kind": "paragraph",
      "lexical_density": 0.4545,
      "readability_grade": 4.7914,
      "sentences": 2,
      "text": "All eleven cross to Python. The methods below are Rust only.",
      "words": 11
    },
    {
      "compression_ratio": null,
      "kind": "paragraph",
      "lexical_density": 0.5313,
      "readability_grade": 7.9813,
      "sentences": 1,
      "text": "provenance records the matra version, the schema version (\"2.0\"), the parser with its model, digest and licence, the format, and the input's path, and the length and SHA-256 of the analysed text.",
      "words": 34
    },
    {
      "compression_ratio": null,
      "kind": "paragraph",
      "lexical_density": 0.5349,
      "readability_grade": 12.5023,
      "sentences": 3,
      "text": "Produced by Engine::analyze, as its last step, into ParagraphMetrics on each paragraph and DocumentMetrics on the document. Every ratio is Option<f64>, and None means not computed, which is distinct from a computed zero. Methodology gives each formula and the exact condition for None.",
      "words": 46
    },
    {
      "compression_ratio": null,
      "kind": "paragraph",
      "lexical_density": 0.6316,
      "readability_grade": 11.0939,
      "sentences": 2,
      "text": "Every measure is per document. Aggregating across documents is the caller's decision: the counts sum, and vocabulary_ttr does not.",
      "words": 20
    },
    {
      "compression_ratio": null,
      "kind": "paragraph",
      "lexical_density": 0.575,
      "readability_grade": 12.565,
      "sentences": 2,
      "text": "Free functions over a Document, needing no engine and no parser. Both return a Summary: the document's provenance with the method and n recorded, and sentences, each a SummarySentence (index, span, text, score), in document order, capped at 2,000 sentences.",
      "words": 41
    },
    {
      "compression_ratio": null,
      "kind": "paragraph",
      "lexical_density": 0.6667,
      "readability_grade": 15.4667,
      "sentences": 1,
      "text": "Python spells them matra.summarize(doc, n=3) and matra.summarize(doc, n=3, method=\"textrank\"), over the Document an engine returned.",
      "words": 18
    },
    {
      "compression_ratio": null,
      "kind": "paragraph",
      "lexical_density": 0.4737,
      "readability_grade": 10.4516,
      "sentences": 1,
      "text": "TextRank's summary of The Federalist No. 10 at the default length, and every sentence's score it was chosen from:",
      "words": 21
    },
    {
      "compression_ratio": null,
      "kind": "paragraph",
      "lexical_density": 0.5854,
      "readability_grade": 10.8245,
      "sentences": 3,
      "text": "Free functions over a Document. Both return a Keyphrases: the document's provenance with the method and n recorded, and phrases, each a Keyphrase (phrase, score, occurrences, the span of every place it was found), highest score first, capped at 200,000 tokens.",
      "words": 42
    },
    {
      "compression_ratio": null,
      "kind": "paragraph",
      "lexical_density": 0.7778,
      "readability_grade": 14.4244,
      "sentences": 1,
      "text": "Python spells them matra.keyphrases(doc, n=10) and matra.keyphrases(doc, n=10, method=\"yake\").",
      "words": 12
    },
    {
      "compression_ratio": null,
      "kind": "paragraph",
      "lexical_density": 0.5,
      "readability_grade": 8.0082,
      "sentences": 1,
      "text": "The two rank by different properties of the text, and on The Federalist No. 10 their top twelve lists share no phrase:",
      "words": 22
    },
    {
      "compression_ratio": null,
      "kind": "paragraph",
      "lexical_density": 0.5455,
      "readability_grade": 7.4727,
      "sentences": 2,
      "text": "Not a field on any type above. The port and clusters are always compiled; the Model2Vec adapter is behind the model2vec feature.",
      "words": 22
    },
    {
      "compression_ratio": null,
      "kind": "paragraph",
      "lexical_density": 0.68,
      "readability_grade": 12.467,
      "sentences": 2,
      "text": "Capped at 2,000 sentences. Python spells them matra.clusters(doc, embedder, threshold=0.85) and Model2Vec (including Model2Vec.potion_base_8m); matra.clusters takes a Model2Vec or any object with embed and identity.",
      "words": 28
    },
    {
      "compression_ratio": null,
      "kind": "paragraph",
      "lexical_density": 0.5833,
      "readability_grade": 12.3622,
      "sentences": 3,
      "text": "Engine::new() is the no-setup constructor: locate the model directory from the environment, then build the standard pipeline, fetching the pinned English model if it is not on disk. It reads no configuration file; Engine::from_config(&Config::resolve()?) reads one.",
      "words": 40
    },
    {
      "compression_ratio": null,
      "kind": "paragraph",
      "lexical_density": 0.6579,
      "readability_grade": 10.7834,
      "sentences": 2,
      "text": "engine.analyze_all(inputs) returns a lazy iterator of per-document results, one per input in order, and one bad file does not abort the stream. Python's Engine.analyze_all(dir=path) is the same lazy walk, yielding a Document or a DocumentError dict per file.",
      "words": 43
    },
    {
      "compression_ratio": 0.4809,
      "kind": "paragraph",
      "lexical_density": 0.5497,
      "readability_grade": 10.9527,
      "sentences": 6,
      "text": "Every heading, paragraph, sentence and token carries a span into the analysed text, in UTF-8 bytes, and skipped lists what the reader saw and did not analyse (a table, a code block, front matter), each with its span. Every byte of a markdown or plain-text input that is not whitespace lies in exactly one heading, paragraph or skipped span, so nothing is dropped without a trace. The text fields are normalized: Paragraph.text is what the parser reads, a markdown paragraph's inline markup removed, and Sentence.text is rebuilt by the provider, the UDPipe adapter joining the token forms with a space unless a token carries SpaceAfter=No. The span, not the text, says where a value came from. Each paragraph is parsed on its own and its sentences are attached to it, so the chain from a token up through its sentence, paragraph, and section holds by construction rather than by text matching.",
      "words": 155
    },
    {
      "compression_ratio": null,
      "kind": "paragraph",
      "lexical_density": 0.7333,
      "readability_grade": 9.1733,
      "sentences": 3,
      "text": "Domain model is the full type graph. Methodology is every formula. Errors is every failure.",
      "words": 15
    }
  ]
}
