Integrity

Coverage

  • 603 logical evidence files
  • 54 compatible groups
  • 30 problems

Subject readiness, tier recall, and exporter problems; missing values never become zero

Answer-key coverage

Every run-referenced subject remains visible, including subjects with no scored trial

SubjectTier countsDefectsRunsAction
feat(proxy): reclaim space from the blob storeT1 3 / T2 7 / T3 6 / T4 42074Inspect subject

Tier recall matrix

Each row is one cohort, reviewer, configuration, and build; values are exporter medians within that row

Recall by discovery tier Higher recall uses a stronger tint; exact values and unavailable states remain visible
Subject / compatible group
Tier 1
Tier 2
Tier 3
Tier 4
proxy default
Reviewer afi · Tool afi · cli · Build afi 0.30.0 · 1 scored / 1 recorded
66.7%
28.6%
50%
50%
proxy default
Reviewer afi · Tool afi · cli · Build afi 0.30.0 · 1 scored / 1 recorded
33.3%
0%
16.7%
0%
proxy default
Reviewer afi · Tool afi · cli · Build afi 0.30.0 · 1 scored / 1 recorded
33.3%
14.3%
50%
50%
proxy default
Reviewer afi · Tool afi · cli · Build afi 0.30.0 · 2 scored / 2 recorded
33.3%
14.3%
50%
50%
proxy default
Reviewer afi · Tool afi · cli · Build afi 0.30.0 · 1 scored / 1 recorded
0%
14.3%
33.3%
0%
proxy default
Reviewer afi · Tool afi · cli · Build afi 0.30.0 · 2 scored / 2 recorded
0%
0%
0%
0%
proxy default
Reviewer afi · Tool afi · cli · Build afi 0.30.0 · 1 scored / 1 recorded
0%
14.3%
0%
0%
proxy default
Reviewer afi · Tool afi · cli · Build afi 0.30.0 · 0 scored / 2 recorded
Not recorded
Not recorded
Not recorded
Not recorded
proxy default
Reviewer afi · Tool afi · cli · Build afi 0.30.0 · 1 scored / 1 recorded
33.3%
28.6%
50%
0%
proxy default
Reviewer afi · Tool afi · cli · Build afi 0.30.0 · 0 scored / 1 recorded
Not recorded
Not recorded
Not recorded
Not recorded
proxy default
Reviewer afi · Tool afi · cli · Build afi 0.30.0 · 1 scored / 1 recorded
0%
0%
0%
0%
proxy default
Reviewer afi · Tool afi · cli · Build afi 0.30.0 · 0 scored / 3 recorded
Not recorded
Not recorded
Not recorded
Not recorded
ReviewerSubjectConfigurationBuildScored / recordedTier 1Tier 2Tier 3Tier 4
afi
afi · cli		proxydefault Default profile · Anthropic · opus 5 highafi 0.30.01/166.7%28.6%50%50%
afi
afi · cli		proxydefault Default profile · Minimax · m3 highafi 0.30.01/133.3%0%16.7%0%
afi
afi · cli		proxydefault Default profile · OpenAI · gpt 5.6 terra highafi 0.30.01/133.3%14.3%50%50%
afi
afi · cli		proxydefault Default profile · Anthropic · fable 5 highafi 0.30.02/233.3%14.3%50%50%
afi
afi · cli		proxydefault Default profile · Z.AI · glm 5.2 highafi 0.30.01/10%14.3%33.3%0%
afi
afi · cli		proxydefault Default profile · OpenAI · gpt oss 120b highafi 0.30.02/20%0%0%0%
afi
afi · cli		proxydefault Default profile · DeepSeek · v4 flash highafi 0.30.01/10%14.3%0%0%
afi
afi · cli		proxydefault Default profile · Mistral AI · devstral 2512 highafi 0.30.00/2Not recordedNot recordedNot recordedNot recorded
afi
afi · cli		proxydefault Default profile · Moonshot AI · kimi k3 highafi 0.30.01/133.3%28.6%50%0%
afi
afi · cli		proxydefault Default profile · Anthropic · opus 5 highafi 0.30.00/1Not recordedNot recordedNot recordedNot recorded
afi
afi · cli		proxydefault Default profile · Z.AI · glm 4.7 flash highafi 0.30.01/10%0%0%0%
afi
afi · cli		proxydefault Default profile · Qwen · qwen3 coder 30b a3b instruct highafi 0.30.00/3Not recordedNot recordedNot recordedNot recorded
All 54 comparison groups

proxy

benchee benchee-dashboard-1 built from 10f4ec58 Static benchmark evidence ·