0.1.0-draft.1 · semantic test contract

Conformance is measured, versioned and inspectable.

A valid-looking file can still lie about evidence, collapse unavailable providers into zero, contain broken references or hand an agent an unsafe task. Semantic tests close those gaps.

Open the raw conformance specification

Core suite

C-001

Schema identity

Version, canonical URI and schema URI match the claimed standard.

C-002

Structural validation

The canonical bundle validates against the versioned JSON schema.

C-003

Unique identifiers

Evidence, findings, actions, projections and provider states have unique stable IDs.

C-004

Reference resolution

Evidence, source findings, dependencies and projections resolve.

C-005

Epistemic integrity

Observed findings are not backed exclusively by inferred or owner-supplied evidence.

C-006

Evidence boundary

Every evaluated pass, warning or failure references retained evidence.

C-007

Provider truthfulness

Unavailable providers do not become zero performance.

C-008

Score sufficiency

Coverage, method, counts, caps and withheld states remain explicit.

C-009

Limitations

Material run, provider and methodology limits are retained.

C-010

Projection declaration

Every shipped projection identifies the canonical bundle and omissions.

Orthogonal profiles

A profile says what this bundle proves, not how sophisticated the vendor sounds.

core

Portable subject, run, evidence, finding, provider-state and limitation contract.

agentic

Permission-aware action graph and answerworthy.plan.md projection.

observed-web

Dated browser, search or external-public-source observations.

answer-probe

Provider, model, prompt and replicate observations with four outcomes kept separate.

outside-buyer

Validity-gated comprehension, trust, relevance, recommendation and next-action evidence.

recheck

Baseline comparison separating implemented, unresolved, regressed, new and unverifiable states.

integrity

SHA-256 digests for the canonical bundle and every declared projection.

Manifest levels

Manifest maturity is cumulative and separate.

Present

A valid answerworthy.md exists at the declared canonical path.

Structured

Required identity, scope and answer sections parse against the manifest profile.

Sourced

Material declared facts identify their basis, source class, scope and verification date.

Corroborated

An independent re-fetch supports the claims and records contradictions or unavailable evidence.

Maintained

The manifest remains within its declared freshness policy and is rechecked through a dated process.

Open claim

Self-declared conforming

Anyone may use this wording when the exact bundle, version, profiles and conformance record are available for inspection.

Reserved mark

Answerworthy Certified

Reserved for a separately published certification programme administered by the standard steward or an authorised body.