SwarmProof
A verified-remediation CLI. Claude and Codex propose a fix, your own test suite gives the verdict, and a hashed Evidence Pack records the result.
- Status
- Status: Alpha
- Stack
- Python 3.11 standard library, Claude CLI, Codex CLI, GitHub Actions
- Last commit
- 5 November 2026
- Sources
- Each tag opens the README line that makes the claim, at commit
8e2f113.
The problem
An agent that says “fixed” proves nothing. README L14 (source in the SwarmProof repository) Before you merge an agent’s change you need 3 things: proof that it passes your tests, proof that nobody edited the tests to get there, and a record you can check later without calling a model again.
What I built
The README is in French; this page renders it in English.
swarmproof fixruns Claude and Codex on a throwaway copy; the source repository is never modified. README L47–50 (source in the SwarmProof repository)- It ignores the engine’s own “completed” status and computes success from each agent’s result. README L57–58 (source in the SwarmProof repository)
- It restores the test files from the clean copy before judging, so a fix cannot pass by editing the tests (proof: SwarmProof README L60–61).
- Your test command gives the verdict:
PASS,FAIL, orINCONCLUSIVEwhen infrastructure fails. README L62 (source in the SwarmProof repository) - An Evidence Pack with a SHA-256 manifest that
swarmproof verifychecks offline. README L64–67 (source in the SwarmProof repository)
System as built
Throwaway copy of the repository
The source repository is never modified.README L50 (source in the SwarmProof repository)
The swarm proposes fixes
Codex and Claude CLIs, with bounded retries and a cap on calls.README L53–56 (source in the SwarmProof repository)
Engine status ignored
engine_okis computed from each agent, even when the engine says COMPLETED.README L57–58 (source in the SwarmProof repository)Tests restored
From the clean copy, before any verdict.README L60–61 (source in the SwarmProof repository)
Your test command runs
PASS,FAILorINCONCLUSIVE; partial proposals are refused.README L61–63 (source in the SwarmProof repository)Evidence Pack written
Report, trace, diff, source and evaluated trees,
manifest.sha256.README L64–65 (source in the SwarmProof repository)swarmproof verifyChecks every hash and can replay the tests offline, with no model call.README L66–67 (source in the SwarmProof repository)
How it is verified
- 97 tests in a standard-library suite that runs in about 1.4 s, per README. README L248 (source in the SwarmProof repository)
- GitHub Actions CI: the latest run on
mainpassed on 5 November 2026. - Demo pack v2 is a real multi-file run: PASS on 4 tests, a fix applied atomically to 2 files, and
shasum -a 256 -c manifest.sha256OK on 30 files, per README. README L125–144 (source in the SwarmProof repository) - An independent red team tested v0.1. 3 critical vulnerabilities were fixed in v0.2, with regression tests in
tests/test_security.py. README L198–199 (source in the SwarmProof repository)
What this means for your project
- You can accept an agent’s fix on evidence: your tests, restored before judging, decide. That is an Agent or MCP build.
- Reviewers get a pack they can verify offline, without model calls and without trusting the agent.
- An Architecture review can check whether your tests are strong enough to act as the judge.
Status & limits
- Alpha, v0.2.1, released 5 November 2026. README L23 (source in the SwarmProof repository)
- The pack proves internal consistency, not origin. It is not signed yet, so it does not prove who produced it. README L17–21 (source in the SwarmProof repository)
- One run on one repository: a feasibility proof, not a statistical study. It does not show that a swarm beats a single agent. README L28–29 (source in the SwarmProof repository) README L230 (source in the SwarmProof repository)
- It needs executable tests. If your tests are weak, the verdict is weak. README L226 (source in the SwarmProof repository)
Links
Next case study: Confidant
Want this pattern in your stack?
Contracted and paid on Upwork, at $90/h.