Sample dataThis tutorial uses sample data. Changes are not saved.

Compare

Variant A

gpt-6.1-sol

Variant B

claude-sonnet-5-5

Variant C

gemini-3.8-flash

Origin vs Sonnet 5.5 vs Gemini 3.8 Resolution rate

Origin: 62.00%Sonnet 5.5: 68.80%Gemini 3.8: 56.50%

Variant AOrigin· gpt-6.1-sol

Cost / request

$0.007899

Avg latency

761 ms

Error rate

1.12%

Resolution rate

62.00%

Variant BSonnet 5.5· claude-sonnet-5-5

Cost / request

$0.009830

Avg latency

954 ms

Error rate

0.68%

Resolution rate

68.80%

Variant CGemini 3.8· gemini-3.8-flash

Cost / request

$0.005959

Avg latency

556 ms

Error rate

1.74%

Resolution rate

56.50%

Per-run comparison

One agent or workflow run

MetricOriginSonnet 5.5Gemini 3.8

Runs5,2512,1671,138

Requests / run2.62.14.0

Cost / run$0.020307$0.020503$0.023418

Node details

NodeOriginSonnet 5.5Gemini 3.8

support.reply$0.007899$0.009830$0.005959

Success-metric comparison

Resolution rate Resolved + helpful (70/30)Cost per resolution

Edit success metrics

EventWeightOriginSonnet 5.5Gemini 3.8

Resolved100%62.00%68.80%56.50%

CompositeΣ62.00%68.80%56.50%