Comparison builder
default
afi / afi · cli / proxy / Default profile / Z.AI · glm 5.3 flash high / afi 0.30.0
P50 across 3 scored trials
3 recorded; malformed and unscored trials remain inspectable but do not participate in aggregate metrics
Recall45%
Model-judged precisionN/A
Total bill$0.0288
Duration4m 45s
Per-metric distributions
Exact Type-7 percentiles over complete scored samples; partial scored samples remain unavailable; non-scored trials are disclosed below
Recall 3/3 scored trials measured
P50 45% P95 45%
Model-judged precision 0/3 scored trials measured
N/A no qualified judge decided these findings, so only locality was measured
N/A · 0 measured
Total bill 3/3 scored trials measured
P50 $0.0288 P95 $0.0314
Duration 3/3 scored trials measured
P50 4m 45s P95 5m 4s
| Metric | Availability | Measured | Min | P50 | P95 | Max |
|---|---|---|---|---|---|---|
Findingsfinding_count | Measured | 3/3 | 8 | 9 | 9 | 9 |
Defects foundfound | Measured | 3/3 | 7 | 9 | 9 | 9 |
Defects missedmissed | Measured | 3/3 | 11 | 11 | 12.8 | 13 |
Unkeyed findingsunkeyed | Measured | 3/3 | 0 | 0 | 0.8999999999999999 | 1 |
Intended findingsintended | Measured | 3/3 | 0 | 0 | 0 | 0 |
Recallrecall | Measured | 3/3 | 35% | 45% | 45% | 45% |
Model-judged precisionprecision | N/A no qualified judge decided these findings, so only locality was measured | 0/3 | - | - | - | - |
F1f1 | N/A no qualified judge decided these findings, so only locality was measured | 0/3 | - | - | - | - |
Tier 1 recalltier_1 | Measured | 3/3 | 33.3% | 33.3% | 33.3% | 33.3% |
Tier 2 recalltier_2 | Measured | 3/3 | 42.9% | 42.9% | 42.9% | 42.9% |
Tier 3 recalltier_3 | Measured | 3/3 | 33.3% | 50% | 50% | 50% |
Tier 4 recalltier_4 | Measured | 3/3 | 25% | 50% | 50% | 50% |
Security recallcategory_security | Measured | 3/3 | 50% | 50% | 50% | 50% |
Defect recallcategory_defect | Measured | 3/3 | 30.8% | 53.8% | 53.8% | 53.8% |
Maintainability recallcategory_maintainability | Measured | 3/3 | 0% | 0% | 0% | 0% |
Performance recallcategory_performance | Measured | 3/3 | 33.3% | 33.3% | 63.3% | 66.7% |
Median anchor distanceanchor_median | Measured | 3/3 | 0 | 0 | 0 | 0 |
Worst anchor distanceanchor_max | Measured | 3/3 | 0 | 0 | 2.6999999999999997 | 3 |
Refusals a judge overturnedanchor_missed | Not recorded no judging pass has looked beyond the scored slack | 0/3 | - | - | - | - |
Review billreview_bill | Measured | 3/3 | $0.0120 | $0.0288 | $0.0314 | $0.0317 |
Judge billjudge_bill | N/A no qualified judge decided these findings, so only locality was measured | 0/3 | - | - | - | - |
Total billtotal_bill | Measured | 3/3 | $0.0120 | $0.0288 | $0.0314 | $0.0317 |
Tokenstokens | Measured | 3/3 | 38866 | 69713 | 71687.6 | 71907 |
Durationseconds | Measured | 3/3 | 1m 42s | 4m 45s | 5m 4s | 5m 6s |
Carried findingscarried | Not recorded the reviewer reported no reuse figure | 0/3 | - | - | - | - |
Compatibility identity
Any change to these inputs creates another group
- Reviewer
- afi
- Reviewer tool
- afi · cli
- Subject
- proxy
- Reviewed SHA
9b51f95ef609a219e211e37b082cd2e6913190e0- Key fingerprint
bd331c0b144e- Settings fingerprint
be7c5b1aa470- Configuration ID
config-e5f3155850f5053d- Build
- afi 0.30.0 /
b0f313c0b59a66ecc7612396dc8db0ea5da13a7a - Harness
- bench 1 /
d5372b5a9797137af68e35c478f308f58ca4510cdirty - Adapter
- afi 1 /
sha256:a1a935298956020ee6d767a756847abb4c00694c88c2eb80d454886ebc4acf8c - Build ID
build-944472ec933601e7- Cohort ID
cohort-fdab2adfb8a4bd39- Comparison ID
comparison-491a157d4c780a6f
Trials
Select View evidence to inspect one run; the static table is paginated at 100 trials
| Details | ||||||||
|---|---|---|---|---|---|---|---|---|
| afi afi · cli | default | proxy | 35% | N/A | 8 | scored | View evidence | |
| afi afi · cli | default | proxy | 45% | N/A | 9 | scored | View evidence | |
| afi afi · cli | default | proxy | 45% | N/A | 9 | scored | View evidence |