Comparison builder

default

afi / afi · cli / proxy / Default profile / Z.AI · glm 5.3 flash high / afi 0.30.0

P50 across 2 scored trials

2 recorded; malformed and unscored trials remain inspectable but do not participate in aggregate metrics

Recall35%
Model-judged precisionN/A
Total bill$0.0271
Duration6m 16s

Per-metric distributions

Exact Type-7 percentiles over complete scored samples; partial scored samples remain unavailable; non-scored trials are disclosed below

Recall 2/2 scored trials measured
P50 35% P95 39.5%
Model-judged precision 0/2 scored trials measured
N/A no qualified judge decided these findings, so only locality was measured
N/A · 0 measured
Total bill 2/2 scored trials measured
P50 $0.0271 P95 $0.0303
Duration 2/2 scored trials measured
P50 6m 16s P95 6m 58s
MetricAvailabilityMeasuredMinP50P95Max
Findings
finding_count
Measured 2/2899.910
Defects found
found
Measured 2/2677.98
Defects missed
missed
Measured 2/2121313.914
Unkeyed findings
unkeyed
Measured 2/22222
Intended findings
intended
Measured 2/20000
Recall
recall
Measured 2/230%35%39.5%40%
Model-judged precision
precision
N/A
no qualified judge decided these findings, so only locality was measured
0/2----
F1
f1
N/A
no qualified judge decided these findings, so only locality was measured
0/2----
Tier 1 recall
tier_1
Measured 2/233.3%33.3%33.3%33.3%
Tier 2 recall
tier_2
Measured 2/214.3%28.6%41.4%42.9%
Tier 3 recall
tier_3
Measured 2/250%50%50%50%
Tier 4 recall
tier_4
Measured 2/225%25%25%25%
Security recall
category_security
Measured 2/20%25%47.5%50%
Defect recall
category_defect
Measured 2/238.5%42.3%45.8%46.2%
Maintainability recall
category_maintainability
Measured 2/20%0%0%0%
Performance recall
category_performance
Measured 2/233.3%33.3%33.3%33.3%
Median anchor distance
anchor_median
Measured 2/20000
Worst anchor distance
anchor_max
Measured 2/20000
Refusals a judge overturned
anchor_missed
Not recorded
no judging pass has looked beyond the scored slack
0/2----
Review bill
review_bill
Measured 2/2$0.0237$0.0271$0.0303$0.0306
Judge bill
judge_bill
N/A
no qualified judge decided these findings, so only locality was measured
0/2----
Total bill
total_bill
Measured 2/2$0.0237$0.0271$0.0303$0.0306
Tokens
tokens
Measured 2/24655560327.572722.7574100
Duration
seconds
Measured 2/25m 28s6m 16s6m 58s7m 3s
Carried findings
carried
Not recorded
the reviewer reported no reuse figure
0/2----

Compatibility identity

Any change to these inputs creates another group

Reviewer
afi
Reviewer tool
afi · cli
Subject
proxy
Reviewed SHA
9b51f95ef609a219e211e37b082cd2e6913190e0
Key fingerprint
bd331c0b144e
Settings fingerprint
be7c5b1aa470
Configuration ID
config-e5f3155850f5053d
Build
afi 0.30.0 / b0f313c0b59a66ecc7612396dc8db0ea5da13a7a
Harness
bench 1 / 10b3b2068100b7ba429855e062500eaf83b90120 dirty
Adapter
afi 1 / sha256:a1a935298956020ee6d767a756847abb4c00694c88c2eb80d454886ebc4acf8c
Build ID
build-4ceb7cbd44e9619b
Cohort ID
cohort-0dee68ba643f6b7b
Comparison ID
comparison-485020d36bca168c

Trials

Select View evidence to inspect one run; the static table is paginated at 100 trials

Details
afi
afi · cli
default Default profile · Z.AI · glm 5.3 flash high
proxy40%N/A10 scoredView evidence
afi
afi · cli
default Default profile · Z.AI · glm 5.3 flash high
proxy30%N/A8 scoredView evidence
benchee benchee-dashboard-1 built from 10f4ec58 Static benchmark evidence ·