Entity & pathway retrieval
Precision@k · recall@k · synonym resolution · typo tolerance · specialty coverage · geographic coverage.
Status: protocol designGLOBAL BENCHMARK PORTAL™
Publish the test before publishing the claim.
V10 defines benchmark families for search, graph quality, evidence provenance, workflow performance, safety and economics. No performance score is presented as externally validated until an independent study exists.
Relationship quality
Edge accuracy · duplicate resolution · path validity · ontology consistency · update integrity.
Status: protocol designTrust & provenance
Provenance completeness · freshness · conflict detection · source quality · reviewer agreement.
Status: protocol designOperational value
Time-to-route · acknowledgement · unresolved cases · handoff failures · task completion.
Status: requires pilotGoverned AI behaviour
Abstention quality · unsafe suggestion rate · escalation success · explanation comprehension.
Status: requires expert studyScalable unit economics
Cost/query · cost/user · gross margin · support burden · retention · expansion.
Status: requires live operationBENCHMARK RELEASE GATE
A score is publishable only when four things exist.
- Frozen benchmark dataset or transparent sampling method.
- Named comparator and evaluation protocol.
- Repeatable results with versioned code/model configuration.
- Independent or third-party review for important public claims.