qutebrowser/qutebrowser/f631cd4422744160d9dcf7a0455da532ce973315 · v35616345bb8052ea303186706cec663146f0f184

Fix for qutebrowser/qutebrowser@f631cd44

Verdict

41.0%
Lineman saved $0.2837
Baseline cost$0.6922
Lineman cost$0.4086
Baseline turns33
Lineman turns22
Baseline duration2m 34s
Lineman duration1m 29s
Lineman version0.1.0

Quality - SWE-bench Docker Harness

Baseline
Not yet evaluated
Lineman
Not yet evaluated

Analysis

(narrative skipped)

Baseline

Turns33
Tool calls32
Cache read1,155,386
Cache write48,891
Output tokens10,811
Total cost$0.6922

Lineman

Turns22-33%
Tool calls21-34%
Cache read590,122-49%
Cache write38,951-20%
Output tokens5,693-47%
Total cost$0.4086

Tool Call Timeline

#Baseline toolCharsLineman toolCharsΔ
1Read/private/var/folders/04/qmf7f1qx7nj2_2mczkd4msth0000gn/T/bench-baseline-instance_qutebrowser__qutebrowser-f631cd4422744160d9dcf7a0455da532ce973315-v35616345bb8052ea303186706cec663146f0f184/ISSUE.md1.1klinemanread_file ISSUE.md1.4k+27%
2Grepchangelog315Grepchangelog66-79%
3Grepchangelog1.2klinemanread_file_context qutebrowser/app.py — changelog upgrade version48-96%
4Grepchangelog_after_upgrade590linemanread_file_context qutebrowser/config/configdata.yml — changelog upgrade48-92%
5Grepqutebrowser_version_changed9.5kGrepchangelog1.7k-83%
32Read/private/var/folders/04/qmf7f1qx7nj2_2mczkd4msth0000gn/T/bench-baseline-instance_qutebrowser__qutebrowser-f631cd4422744160d9dcf7a0455da532ce973315-v35616345bb8052ea303186706cec663146f0f184/qutebrowser/config/configfiles.py offset=64 limit=20994
Total35.4k23.5k-34%