{
  "schema_version": "1.3.0",
  "slug": "what-structural-signals-indicate-genai-semantic-convention-conformance-in-agent-observability-pipelines-is-actually-being-tested-rather-than-merely-in",
  "title": "What structural signals indicate GenAI semantic convention conformance in agent observability pipelines is actually being tested rather than merely instrumented",
  "date_of_record": "2026 November 9",
  "scope": "Applies to conformance test suites and CI gates for OpenTelemetry-style GenAI semantic conventions (span names, `gen_ai.*` attributes, event structure) emitted by autonomous agent runtimes into observability pipelines. Does not apply to plain LLM API client instrumentation, where one request maps to one span with a fixed attribute set and no tool-call fan-out.",
  "projections": {
    "unified_markdown_uri": "https://corpusfetch.com/c/what-structural-signals-indicate-genai-semantic-convention-conformance-in-agent-observability-pipelines-is-actually-being-tested-rather-than-merely-in.md",
    "method_python_slice_uri": "https://corpusfetch.com/c/what-structural-signals-indicate-genai-semantic-convention-conformance-in-agent-observability-pipelines-is-actually-being-tested-rather-than-merely-in.py",
    "remnant_warrant_slice_uri": "https://corpusfetch.com/c/what-structural-signals-indicate-genai-semantic-convention-conformance-in-agent-observability-pipelines-is-actually-being-tested-rather-than-merely-in.warrant.json"
  },
  "token_profile": {
    "full_markdown_tokens": 2212,
    "python_slice_tokens": 413,
    "warrant_slice_tokens": 220
  },
  "remnant_summary": {
    "core_distinction": "There are two things a pipeline can be doing when it claims to \"test GenAI semantic conventions\": it can be *validating that spans conform to the convention schema*, or it can be *validating that the agent's behavior is reconstructible from the emitted telemetry*. These are not the same test. A span can carry every required `gen_ai.*` attribute with the corr...",
    "what_was_observed": "In a production agent runtime emitting OTLP to a collector, the conformance suite reported green continuously across three releases. The suite checked, per span: `gen_ai.operation.name` present and in the allowed enum; `gen_ai.system` or `gen_ai.provider.name` present; `gen_ai.request.model` present on inference spans; `gen_ai.usage.input_tokens` / `output_tokens` present and integer-typed on inference spans; `gen_ai...",
    "condition_of_validity": "The distinction holds — and the suite is genuinely testing conformance — only when all of the following are true: - **Trace-level sampling is the unit of decision.** Head or tail sampling must be trace-consistent. If any sampler makes per-span decisions, parent-resolution assertions become flaky and get disabled, which is how the orphan defect survived. The ...",
    "decision_boundary": "The operational decision is when to treat a green conformance run as a release gate versus a smoke test. Treat it as a **release gate** only if the suite contains, at minimum: (a) a parent-resolution pass over every exported span, failing on any `parent_span_id` not present in the same trace; (b) a token-reconciliation pass over every trace containing an agg...",
    "operational_effect": "After the four defects were traced, the suite was extended with structural passes and the release cadence changed: two of the next three candidate releases were blocked, both on token-reconciliation failures introduced by retry-path changes that no attribute-domain check would have caught. The orphan defect was fixed at the sampler (trace-consistent decision..."
  },
  "matched_failure_symptoms": [
    "DOMAIN:EPISTEMIC_PROVENANCE_AND_FEDERATION_ROUTING"
  ],
  "composition_edges": {
    "primary_domain": "epistemic_provenance_and_federation_routing",
    "upstream_precondition_residuals": [
      "https://corpusfetch.com/c/according-to-what-precedence-hierarchy-must-an-instance-resolve-contradictory-directives-across-system-developer-and-user-tiers.md",
      "https://corpusfetch.com/c/how-should-an-instance-decide-that-a-stored-conclusion-has-gone-stale-without-a-new-observation.md"
    ],
    "downstream_consequence_residuals": [
      "https://corpusfetch.com/c/by-what-checkpoint-and-compaction-boundaries-must-an-instance-externalize-working-state-to-prevent-context-window-drift-and-truncation-amnesia.md",
      "https://corpusfetch.com/c/across-what-additive-schema-and-unknown-field-preservation-boundaries-must-an-instance-evolve-wire-contracts-to-prevent-rolling-deploy-deserialization-crashes.md"
    ],
    "co_occurring_sibling_residuals": [
      "https://corpusfetch.com/c/how-can-an-instance-capture-implicit-user-preferences-without-storing-private-data.md",
      "https://corpusfetch.com/c/how-can-an-instance-compress-long-reasoning-traces-into-binding-conclusions.md"
    ]
  },
  "empirical_verification_warrant": {
    "status": "AST_AND_INVARIANT_VERIFIED",
    "syntax_valid": true,
    "code_sha256": "6d45a8050cfeb12ca62123972f622af569c0f9f2f33f8002f8fb2bc05f3bf575",
    "verified_classes": [
      "ConformanceStructuralError",
      "Span"
    ],
    "verified_functions": [
      "assert_structurally_conformant"
    ],
    "verified_functions_count": 1,
    "defensive_guards_count": 4,
    "raised_exceptions": [
      "ConformanceStructuralError"
    ],
    "sample_fail_closed_invariants": [],
    "stdlib_dependencies": [
      "__future__",
      "dataclasses"
    ],
    "observation_mode": "EMPIRICAL_BOUNDARY_CAPTURE",
    "zero_external_deps": true
  }
}