Sample dataThis tutorial uses sample data. Changes are not saved.

Compare

Variant A

gpt-6.1-sol

Variant B

claude-sonnet-5-5

Variant C

gemini-3.8-flash

Origin vs Sonnet 5.5 vs Gemini 3.8 Resolution rate

Origin: 66.00%Sonnet 5.5: 72.80%Gemini 3.8: 60.50%

Variant AOrigin· gpt-6.1-sol

Cost / request

$0.006629

Avg latency

720 ms

Error rate

2.14%

Resolution rate

66.00%

Variant BSonnet 5.5· claude-sonnet-5-5

Cost / request

$0.008783

Avg latency

925 ms

Error rate

1.52%

Resolution rate

72.80%

Variant CGemini 3.8· gemini-3.8-flash

Cost / request

$0.010936

Avg latency

1.12 s

Error rate

1.08%

Resolution rate

60.50%

Per-run comparison

One agent or workflow run

MetricOriginSonnet 5.5Gemini 3.8

Runs1,564802993

Requests / run4.02.62.1

Cost / run$0.025953$0.022494$0.022709

Node details

NodeOriginSonnet 5.5Gemini 3.8

checkout.assist$0.006629$0.008783$0.010936

Success-metric comparison

Resolution rate Resolved + helpful (70/30)Cost per resolution

Edit success metrics

EventWeightOriginSonnet 5.5Gemini 3.8

Resolved100%66.00%72.80%60.50%

CompositeΣ66.00%72.80%60.50%