Record the pilot. Keep the evidence with the score.
Assess a proposed configuration using eight criteria. The overall score appears only when all criteria have been assessed. Your entries describe your test, not a published vendor rating.
WEIGHT 20%
Required source coverage
Collect the agreed known examples and document source gaps, access route and historical limits.
WEIGHT 15%
Narrative grouping
Show why examples belong together and let the reviewer examine different stances or interpretations.
WEIGHT 15%
Evidence traceability
Trace each material finding to original records, timestamps and an inspectable source basis.
WEIGHT 10%
Actor & relationship explanation
Define network relationships and separate observed behavior, coordination and attribution.
WEIGHT 10%
Relevance & review load
Assess relevant, irrelevant and ambiguous examples and record the human review required.
WEIGHT 10%
Alert & operational handoff
Measure agreed timing and route the finding to a named owner with context and next steps.
WEIGHT 10%
Exports & required controls
Demonstrate usable exports and the identity, retention and integration requirements in scope.
WEIGHT 10%
Commercial & service clarity
Document product access, analyst work, USD costs, support hours and change triggers.
RATING KEY
0 assessed, not demonstrated · 1 partial, material gaps · 2 demonstrated, conditions documented · 3 demonstrated for the agreed test. Use notes to retain the supporting records and limits.
