Skip to content
exExperimentos
Agents & systemsResults7 Oct 2026

144 recoveries, one carefully bounded task

The earlier recovery experiment proved that the pieces connected. This follow-up asks whether adding recent conversation history helps a worker resume after an independent reviewer has repaired the code.

Key finding

All 144 supervised continuations completed; a smaller handoff used fewer worker tokens.

Edited finding from the pinned experiment record. The report and figure metadata preserve the original workload and limits.

The boundary

One interval-merging task, seven unchanged acceptance cases and six synthetic failure histories. This measures the supervised system, not standalone Qwen accuracy.

Data

Reviewed aggregate results with explicit units, sources and qualification limits. Different cohorts remain separate.

Recorded result

Less history used fewer worker tokens

Same supervised interval-merge task · both modes completed 72/72

Less history used fewer worker tokensMinimal · 72 runs: 1,677,430 worker tokens; Recent · 72 runs: 3,929,677 worker tokens. Totals include long-history outliers. General coding accuracy and dollar cost are not measured.Minimal · 72 runs1,677,430Minimal · 72 runs: 1,677,430 worker tokensRecent · 72 runs3,929,677Recent · 72 runs: 3,929,677 worker tokens0worker tokens
  1. Minimal · 72 runs1,677,430
  2. Recent · 72 runs3,929,677

worker tokens

Totals include long-history outliers. General coding accuracy and dollar cost are not measured.

View data & source
Less history used fewer worker tokens · worker tokens
ConfigurationValue
Minimal · 72 runs1,677,430
Recent · 72 runs3,929,677

Origin: reviewed report table. Revision 7e6fdbe3b1d1.

Download measurement metadata (JSON)

Write-ups

Report agentic-workflows/awq-glm-supervised-recovery-2026-10-07/README.md

Can a compact handoff preserve recovery?

The earlier recovery experiment proved that the pieces connected. This follow-up asks whether adding recent conversation history helps a worker resume after an independent reviewer has repaired the code.

The worker was a selectively quantized Qwen3.8-27B across two RTX 3090s. GLM repaired all 18 initial bundles. Each validated handoff and patch then reached eight matched continuations. Three harnesses, two reasoning efforts, two context modes, six histories and two repeats produced 144 scored continuations.

The result

142 passed after the first handoff; two needed a second review. All 144 eventually passed the original acceptance checks. Both context modes completed 72/72, with 71/72 first-handoff passes each.

Minimal context used 1,677,430 worker tokens; recent history used 3,929,677. Across all six matched harness/effort comparisons, recent context increased paired median worker time by 8.9–203.2% and coding tokens by 3.2–184.0%. Long-history outliers influence the totals, so the paired comparisons matter more than a single aggregate ratio.

What I would keep

Minimal is the provisional choice for this workflow. Installed recovery defaults were left unchanged. Scored worker, summarizer and reviewer usage totals 9,717,148 tokens; shared first-bundle work is counted once. That token total does not imply a dollar cost.

The next useful test is a broader task corpus. Repeating one task under different failure histories demonstrates recovery behavior, while leaving general coding competence unresolved.

Evidence and publication boundary

This is an edited account of the recorded experiment. The linked archive is private; the methods, aggregate findings and limits are included above. Reference recordings, raw conversations, authentication material and workstation configuration are excluded.

More in Agents & systems